WAN ANIMATE 2.2 V2 IMAGE TO VIDEO TO VIDEO WORKFLOW!

Which folder do the vitpose models like onnx models of whole body go into?

Avishek

Greetings! Now that I upgraded my membership I am re-posting hoping I can get help and make this work. I did a fresh install on a different drive using your *.bat and everything worked fine, even sage attention and triton. My problem persist and after the workflow finishes, I end up in my output folder with only 1 png for the face, 1 gif for the face, 1 png for the animation and 1 gif for the animation but NO VIDEO at all. The only difference from before is that now I SEE both Video Combination processes RAN but still the video is no where to be found and there's no video shown in the workflow itself. Please help! Thank you! FORGOT to mention that I have disabled the whole masking section 4 because I only want to transfer the animation from the reference video to the reference image or in other words, make the subject of my image do the movements from the reference video only while keeping the subject and background of my reference image.

Melissa DeLaFey

First of all, thanks! I have had always problem with GrowMask Node, as my reference charachter has long curly hair, after a lot of attempts I got that I had to grow from 10 to 70 to have right hair syle (otherwise my chachter will assume same haircut of the original charachter of the video). But since a couple of days this parameter is not good anymore, someone can explain me why? Something changed?

Giusparsifal

Thank you for this workflow. It's working perfectly on a 3090. I used your one-click bat for a completely clean install. This is so awesome after several weeks of unsuccessfully trying wan animate workflows only to have repeated errors. Looking forward to trying some of your other workflows. Keep up the fantastic work!

Bafangit

I've tried the following methods but it still doesn't work: - Fresh install everything. Using 1-Click install bat file - Manually delete "ComfyUI-WanVideoWrapper" folder in Custom Nodes. Then Install through ComfyUI manager UI, and also another try with URL - Cut down the frame cap to only 72

EtD

Forever stuck at WanVideo Sampler node The display near the top left show: (1) 86% - WanVideo Sampler (#4 - 0%) I'm running on 4060 Ti 16gb VRAM It's been like this for about 45 minutes already, and Task Manager show ~0% GPU activity. Memory ram also at normal level (compared to when I don't use ComfyUI)

EtD

hey! im wondering if its possible to replace the pose and face portion of this workflow with a more depth map like preprocessor. id like to use wan 2.2 to make things that were more similar to what QR monster controlnet used to be able to do using stable diffusion back in the day. is this possible?

Sheel Doshi

Hi guys, is there a discord channel or a chat service to use to communicate to each other to help each other?

newtoai

After using for a few days now this is the best animate WF by far. Amazing work!! However, MASKING video for a face replacement doesn't work very well and looks distorted and not much like the reference image, even with a good quality image. I've tried with face tracking nodes enabled and disabled, as per notes. What am I missing?

Victor Tabram

Thank you as always Aitrepeneur! I hope you or someone here can help me out. When I run the workflow I get everything working except at the very end the final video is not generated/saved. I see all the process going without errors and in my output folder are only *.png and *.gif. The whole far right section of the two video combine nodes is not working. It is active but it does not do anything. How do you connect that section? I don't see any spaghetti going to that far right 3 nodes in your WF like they are isolated? Please send help! Cheers!

Melissa DeLaFey

I so far added a 18 second video and it worked

Edward Anderson

What is the longest generation this wf can handle? Can it do 1-2 minutes, or capped at 5-10 seconds?

Delavestra

Hi there! The rank64 lightx2v has versions 128 and rank 256... what's the difference? Do we want to use the latest ones?

Delavestra

you need to enable the workflow with the button on the left, check the video

Aitrepreneur

dm me with more info, never saw this before

Aitrepreneur

I just changed the installer, it should now freeze your current env so less things should break

Aitrepreneur

Prompt has no outputs

bff udf

I am getting the error Prompt execution failed Prompt has no outputs:

Anthony

Error No input found for flattened id [265] slot [-1] i get this error, how to fix?

Reina Stryfe

I need you to do a pip lsit for me so I know what Cuda, Torch and ptyhon you are running, i get fucked over every time you make an installer. Its easier if i just match your env

nurtu

All good. Installing missing nodes via Comfy Manager didn't do the requirements! Had to run: ..\..\python_embeded\python.exe -m pip install -r ComfyUI-SecNodes\requirements.txt

Victor Tabram

All works great!!!! best so far..... until I try the SEC masking. I get this error on SecModelLoader: Failed to load SeC model: No module named 'iopath' (I've got the model in the sams folder)

Victor Tabram

Its nice that you have a .bat file but seriously it reinstalls already existing packages and fucks up my chain of compatible versions which results in no workflow no longer working. Im lucky i had a pip freeze so i can force reinstall my versions.

nurtu

you are running out of vram for some reason, just restart comfyui and try again

Aitrepreneur

you can try this: go inside the ComfyUI_windows_portable\python_embeded folder, click on the folder path, type cmd press enter, this will open a cmd window inside that folder and there type: python.exe -m pip uninstall -y onnxruntime-gpu python.exe -m pip install --upgrade "onnxruntime==1.20.1" finish the install and then relaunch comfyui if everything else was installed

Aitrepreneur

I am running a 5090. The workflow worked on time but now I am gettin this error message: torch.acceleratorerror: cuda error: out of memory cuda kernel errors might be asynchronously reported at some other api call, so the stacktrace below might be incorrect. for debugging consider passing cuda_launch_blocking=1 compile with `torch_use_cuda_dsa` to enable device-side assertions.

Torsten

I got exactly the same problem. Might the WanVideo Model (FP8) and the WanVideo Lora/WanVideo VAE ( both FP16) cause this problem?

Freno Deckilin

I did everything as explained in the video, but sadly I get this error in the middle of the process: PoseAndFaceDetection [ONNXRuntimeError] : 1 : FAIL : Non-zero status code returned while running QuickGelu node. Name:'/model.0/act/Mul/QuickGeluFusion/' Status Message: CUDA error cudaErrorNoKernelImageForDevice:no kernel image is available for execution on the device And I see the "Pose and Face detection" node is in a purple square, where the process stops. I checked the "Mask" and "Background_image" because I use the automatic masking. Any idea what could cause this issue? I also tried "Triton" enabled and disabled, same eror. BTW, my card is 5070 Ti , 16 gb vRAM The whole console process is in this screenshot: https://ibb.co/84GNtx4M

TomiTom1234

I got this error, is it lack of memory? : WanVideoSampler self and mat2 must have the same dtype, but got Half and Float8_e4m3fn

May Link

Thanks. It really works. Just one question, when it uses VIT poses, it randomly track the pose of random character, can we control that too like making it to track particular character pose from the video?

Maja Ji

DID YOU MANAGE TO SOLVE IT? HOW DO I DOWNLOAD THE NODES THAT ARE MISSING?

May Link

TomiTom1234

I don't have a mac so I can't test anything on it beforehand however runpod is a website so you can already use it no problem

Aitrepreneur

Hey there! I’m on a Mac and I’m thinking about joining your Patreon. Just wondering if you have any workflows that are Mac-friendly or that show how to use RunPod specifically on a Mac? Thanks

ELITE AI EDUCATION

try changing browser

Aitrepreneur

I can't zoom in or zoom out on the workflow and sometimes I can't upload a video reference.

Cristo

Obviously 😀

Aitrepreneur

And if there is a way to use face and poses from two different videos?

Dawid Ogiegło

Damn... This is the best WAN Animate workflow I've had so far.

Max Schreck

Do you folks have any suggestion what could the way to zoom out an input video a bit?

Dawid Ogiegło

Appreciate it and it's all good. Take care of yourself first, I don't mine support quality content.

L Hill

no? https://huggingface.co/Aitrepreneur/FLX/resolve/main/vitpose_h_wholebody_data.bin?download=true

Aitrepreneur

Some of the models, such as vitpose_h_wholebody_data.bin are missing from your huggingface.

Karl Wikman

Thanks! (first!)

HealingPaint