Technical
My blog is where I took notes as I dove deeper and deeper down the rabbit hole
Bomb Squad Robot
When the police respond to a bomb threat, they drive a robot in remotely to handle the situation from the safety of a truck. Their ability to see is quite limited - this project aimed to attach a 360° camera to the top, and stream that data over a 5G network for an easier to use experience.
Toy Robot Prototype
Created a little robot toy that would track people’s faces, and respond to their expressions, using a Real Sense camera.
The brains of the robot were run on an arduino. The limited bandwidth meant that memory had to be counted by the byte.
To implement, I made an animation player in C++ to handle the audio and expressions, and drove them from the real sense camera.
MS Word
Collaboration with Chris Rojas, who built an upward facing stereoscopic depth camera prototype. This MS Word simulation was intended to show how a different embedding angle could be used in everyday programs - in this case using gestures as hotkeys that could become sliders. IE: Trigger the command for font size and use a gesture to change the font to a particular size. By combining this technology with eye tracking, you could add context to what feature you wanted to incrementally increase or decrease.
Facial Recognition
Simple demo showing how you can use facial feature recognition to drive a CG mirror.
3D Printed Facial Mocap Helmet
After migrating our pipeline to video based facial animation using Unreal Animator, I wanted a way to stabilize the video, to get the best output possible. Before investing in an expsensive motion capture helmet, I 3D printed one to make sure it worked. It did!
