Image2Expression Blender Add-On
Added 2024-04-04 05:15:02 +0000 UTCInstructions
1) Download
2) Install add-on and dependencies
Run Blender, click Edit->Preferences->Add-ons, then click Install and select the zip file you downloaded in step (1).
Find the add-on in the list, and check the tickbox to activate it.
**** IMPORTANT ****
You must install dependencies before the add-on will function correctly.
Expand the pane for the Image2Expression add-on, then click Download & Install Dependencies.
This may take a few minutes to complete, and may stall the UI while doing so. This is normal.
After installation is complete, close the Preferences window, and you should now see the "Image2Expression" add-on tab in the 3D Viewport on the right.
3) Add a model with ARKit blendshapes to the scene
The add-on only works with meshes with blendshapes that match Apple's ARKit standard (eyeBlinkLeft, eyeLookDownLeft, etc). You can see the full list [here](https://developer.apple.com/documentation/arkit/arfaceanchor/blendshapelocation).
Once the model has been added to the scene, select the mesh object(s) containing the blendshapes, and click the + symbol to add the model to the list of targets.
Objects in this list will have their blendshape weights adjusted to match the expression in the photo at the next step. If your model has separate meshes (e.g. for eyebrows, glasses, hair, etc), make sure you add all objects to this target list.
4) Add a reference image to the scene
Add an image to the scene that contains the expression you want to extract. For best results, try and ensure:
a) there is only one person in the photo,
b) the person is facing the camera, and
c) the person's face is as evenly lit as possible.
5) Run
Click "Run", and the blendshapes will be applied to your meshes.
6) Symmetry/Swap Left-Right
The add-on also comes with two options. Tick the "Symmetry" checkbox to apply the blendshape weights from one side of the reference face to both sides of the target face.
When "Symmetry" is checked, ticking the "Swap L/R" checkbox will change which side of the reference face is used.
When "Symmetry" is unchecked, ticking the "Swap L/R" checkbox will use both sides of the reference face, but will change which side of the reference face is applied to which side of the target mesh.
