Skip to content

Face Tracking

Face Tracking can detect and track digital content to the user’s face. This is great for building face-filter experiences which allow users to try on different virtual glasses or hats for example.

We recommend coupling face tracked experiences with Screen UI components to make the most out of your experiences.

When you create your Designer experience, you will be asked whether you want your first scene to be World, Image, or Face tracked.

Upon selecting Face Tracking, your scene will automatically be switched to 3D mode, with a head mesh displayed on the canvas to indicate where to place your content.

The head mesh will automatically hide content inside the head.

Creating a Face Tracking experience

In addition to tracking the center of the head (known as the origin), you can use Attachment points to track content from various places on the user’s face. These attachment points will remain accurate, even as the user’s expression changes.

To assign a component to an attachment point, simply click and drag over the highlighted attachment point.

Dragging a component to an attachment point

The following attachment points are available:

Note that ‘left’ and ‘right’ here are from the user’s perspective in the experience.

Attachment pointDiagram ID
OriginA
Left eyebrowB
Right eyebrowC
Left earD
Right earE
Left eyeF
Right eyeG
Nose bridgeH
Nose tipI
Nose baseJ
Bottom lipK
ChinL

You can change a component’s attachment point at any time. To do so, click on your chosen component and then go to the Project Properties Panel. Find the Attachment points drop-down menu and then select a new attachment point.

Changing a component's chosen attachment point

The head mesh allows you to run Actions via varying facial movements. The following table describes these movements:

TriggerDescription
On mouth openWhen the user opens their mouth.
On head tilt leftWhen the user tilts their head to the left of the screen.
On head tilt rightWhen the user tilts their head to the right of the screen.
On head shakeWhen the user tilts and/or moves their head from side to side in quick succession.