NokiMo
Innovate Futures @ Benji
Innovate Futures @ Benji

patreon


Stable Diff Mimic Motion Live Portrait Workflow V3 - For Patreon

Video : https://youtu.be/rT6W0Qu6R30

Video : https://youtu.be/rT6W0Qu6R30

Are you ready to unlock the full potential of LivePortrait JK Notes custom nodes package version two? Join us in this comprehensive video guide where we delve into the exciting updates and enhancements of LivePortrait. From improved performance to innovative features like alternative face detection libraries using MediaPipe, we explore how this new version revolutionizes the creation of AI animations and videos. With faster processing speeds and seamless integration, LivePortrait is set to elevate your workflow and bring your creative visions to life like never before.

Discover how LivePortrait opens up a world of possibilities for AI video generators and content creators. From the convenience of capturing videos from webcams to the advanced features like image-to-video conversions and face-swapping, LivePortrait offers a diverse range of tools to enhance your video production experience. With a focus on efficiency and customization, this new version of LivePortrait empowers users to create engaging and lifelike AI characters and animations with ease.

Experience firsthand the speed and precision of LivePortrait as we demonstrate the seamless workflow from loading videos to generating stunning AI animations. With improved GPU processing and a user-friendly interface, LivePortrait streamlines the creation process, allowing you to focus on unleashing your creativity. Join us on this journey as we explore the endless possibilities of LivePortrait and witness the transformative power of AI technology in video production.

Version 3 Workflow Available to download below:

Comments

Hi Benji I can't get your workflow up and running ;( It has missing node types: ReActorFaceSwap/FaceModel/RestoreFace and the ReActor Node keeps failing in comfyui manager (Im a bit of a beginner here...) Would love your help here. Thanks in advance!

Justin Cavanas

python 3.10 which is the update version of 3.9, therefore it should not have problem using 3.10. As a lot of people are using it as well. When you are using Comfy UI portable version, you should use the Python.exe in the ComfyUI project folder. python_embeded/Python.exe That way, you don't need to do another Conda. And 12.1 cuda is good to go.

Benjamin Law

Hi! I;m curious, this doesn’t seem to run on python 3.10 for me, and I see 3.9 in the instructions on the live portrait github: do I need to set up new conda env for 3.9 to run this? Do i need a separate comfyui install to use it? Preferred cuda? Currently running 3.10.15 python and 12.1 cuda. Thanks!

talon nightshade

xinsir / controlnet-tile-sdxl-1.0 https://huggingface.co/xinsir/controlnet-tile-sdxl-1.0

Benjamin Law

Thank you I will. What Sdxl Tile Controlnet are you using in the Upscaler (the Upscaler Load Controlnet Model node)? the xinsir model I tried causing the OOM problem always. Could you please share the link for the model used in the workflow?

modiin wrestler

If you think , just running the Mimic Motion sampler can have a good face , good motions. Then you really need to go through the detail before you continue. Otherwise you will never have a good video generated.

Benjamin Law

Amazing works thank you a lot for sharing!! I tried you more advanced workflows v4,v8 and they are all flickering and give garbage faces and hands this is the only one that was right for me I guess but the OOM problem of the tile controlnet by by Xinsir doesn't let it finish the job never. so please share the one you are using thank you.

modiin wrestler

what tile controlnet are you using? I tried Controlnet Tile Sdxl 1.0 by Xinsir but I am just getting OOM out of memory and it all fails

modiin wrestler

The face model where are have talked about before. Build your own using images. https://www.patreon.com/posts/108662611?utm_campaign=postshare_creator&utm_content=android_share

Benjamin Law

Chole.safetensors is missing ?

Mohit Gupta

Hi, you can click refresh browser, it will appear if you installed but fail to load on screen.

Benjamin Law

Hello, is there some common problem with installing? ComfyUI-Vextra-Nodes and Derfuu_ComfyUI_ModdedNodes they are constantly failing to load... My server is on Ubuntu

Igor

Try it out😄👍

Benjamin Law

Thank you!

Luisa Pugliese


Related Creators