AnimateDiff Lightning - Local Install Guide + Workflow
Added 2024-03-23 00:27:31 +0000 UTCHere is my Tutorial and the ComfyUI Workflow below. Make sure you UPDATE your ComfyUI + Extensions first!
Model: https://huggingface.co/ByteDance/AnimateDiff-Lightning/tree/main
ComfyUI Manager (in case you don't have it):
1) go into custom nodes Folder and write CMD in the address bar and hit enter.
2) git clone https://github.com/ltdrdata/ComfyUI-Manager
3) hit enter, wait for it to finish, close CMD and start Comfyui. Now you have the manager.
4) open my workflow and click on "Install Mission Nodes" and install all missing nodes
Comments
It was a lot of guessing, tries and errors :-D
Thomas Coispel
2024-04-08 11:20:48 +0000 UTCThanks for that solution ! I will test it in the future. Meanwhile I've managed to link the following nodes : - Load image - image scale to side - RepeatImageBatch (x16) -VAE Encode - KSampler By setting steps to 5 (with a model at 4 steps), I success to make some interesting IMG2VIDEO outputs
Thomas Coispel
2024-04-08 11:16:24 +0000 UTCI have the following problem. Error occurred when executing GMFSS Fortuna VFI: No module named 'cupy'
EuropesHeart
2024-04-03 20:50:52 +0000 UTCHi, you can use a "Video Load (Path)" Node from the Video Helper Suite Nodes Pack and put that into a VAE Encoder and then into the Latent Input of the Ksmapler. Make sure you use a mp4 with 512 and no longer than 16 frame. Then set the ksampler to euler_acestral and play with the denoise setting. I didn't find a img2video way, since it needs at least 2 frames. You might be able to do img2video with a IPAdapter for stlye transfere though. But i was told IPAdapter does not play well with this model. So a lot of experimentation might be needed
Olivio Sarikas
2024-03-23 23:34:33 +0000 UTCThanks for sharing ! How can we add a Img2Vid imput with this workflow ? (in ComfyUI)
Thomas Coispel
2024-03-23 14:15:26 +0000 UTC
