Shaders
Point Cloud Edit
Sam’s Friend was a children’s book which turned the page if it recognized the story had been read aloud, or if the reader showed that page to the computer. The main character’s friend was displayed (filtered in depth to only show the reader) as the main character’s imaginary friend.
Seth Gibson got an initial point cloud running for me in Unity, and I edited HLSL to get the visual effect I was looking for.
Virtual Hand
Stan Melax wrote a physics engine to simulate hand tracking based on infrared and RGB camera data, and needed a pretty visualization of his work.
This was a simple Final Fantasy inspired loading screen, where the hand was visualized with a ghostly cast. To get the effect I wanted I had to make a shader.
Virtual Pinboard
Visually underwhelming but technically cool - this shader runs the depth buffer on an infrared camera through a process that captures the depth of an object or person you point the depth enabled tablet at, and saves out that data as a virtual pinboard. It also loads the RGB camera as a reflection on the pins.