NokiMo
cebstudios
cebstudios

patreon


Dev Preview - Mediapipe and new method of retarget

This is a preview video of the reviewed code for mediapipe.

In this post you can download a demo file with a model from Vroid and the script

You also have the option to load the py code in your own scene


We provided the mapping to be used with Rokoko Studio and AutoRig Pro


The youtube video explains how to use it.



The easiest way to install the python packages inside blender to be able to use this blend file and run your own pose estimation, is doing this:

go to your blender installation folder, and copy its path

In this example, the path to blender is:

D:\Blender\Blender_exe\blender-2.93.1-windows-x64\2.93

replace the path below with the one in your system:

-- Installing Mediapipe

D:\Blender\Blender_exe\blender-2.93.1-windows-x64\2.93\python\bin\python.exe D:\Blender\Blender_exe\blender-2.93.1-windows-x64\2.93\python\lib\site-packages\pip install mediapipe

-- Installing OpenCV

D:\Blender\Blender_exe\blender-2.93.1-windows-x64\2.93\python\bin\python.exe D:\Blender\Blender_exe\blender-2.93.1-windows-x64\2.93\python\lib\site-packages\pip install opencv-python


Dev Preview -  Mediapipe and new method of retarget

Comments

Yes it is possible, and it is the next part to work (as soon as the body is finished, and it almost is) The plan is to have the hands and the face using Mediapipe. After that, the plan is to go back on the deeplabcut method for facial MOCAP

Hi, is it possible to add the mediapipe Hands module to the code, to include hands tracking as well?


Related Creators