We used the cgtinker’s BlendArTrack (stylised ‘blendartrack’) app and add-on for Blender and an iPhone with Face ID technology to capture a few seconds of my facial motion and import the face mesh data into Blender and retexture.

Typically, this process is quite complicated and requires several discreet pieces of hardware and software to accomplish; however, thanks to the simplicity and integration of the BlendArTrack software, the entire process took less than an hour.

The process is so simple that it is almost trivial. The app uses the technology in the Face ID system to accurately track minute facial expressions, such as blinking and raising one’s eyebrows, which can then be imported into Blender via the add-on.

The final stage is UV Editing or mapping. The facial mesh had already been kindly unwrapped for us, so all that was required were some minor adjustments. We used an old photo and cleaned up the UV so that it lined up with the photograph.

Final Animation

Leave a Reply