Motion Capture
AI Driven Mocap for VR
This motion capture pipeline used Metahuman characters in Unreal, Unreal Animator with a motion capture helmet (hand made) for facial and Move.AI for the body mocap.
This pipeline can be combined with photography + lighting / props or a fully 3D modelled environment for a plug n play mass content production pipeline.
Facial Animation
I created a pipeline for converting photogrammetry scans into rigged mixamo models.
This highlights the next phase of research, in which I used an obscure startup stereoscopic camera for point and click scans, which I converted into blendshapes and then drove using LIVE Face, and an IphoneX.
Although the research was never implemented, the goal was to create a pipeline for extremely high-quality human interactions, using minimum labor.
Discovering Ardi
Ardipithecus Ramidus is one of the oldest known ancestors of Homo Sapiens (us). These animations are recreations of what she would have looked like, based on paleontology findings.
Getting the movement was important, and so we used House of Moves to capture a gymnast performing Ardi’s actions, then ran it through software to recalibrate the motion capture based on the length of her bones.
I then cleaned up the animation, and added secondary animation to the environment.
PS - These videos are rather old, please forgive the lower quality.
