NokiMo
Innovate Futures @ Benji
Innovate Futures @ Benji

patreon


AI Video + TTS + Lipsync

How is it? just a raw output video from ComfyUI, no upscale, no enhanced color.

I try using Kling AI gen a video, then brin to Comfyui.
I made a tts node (testing stage), combine with LatentSync for Lipsync.

Comments

The TTS is not Kling, as I mentioned in the post, other tts and lipsync https://www.patreon.com/posts/120349210?utm_campaign=postshare_creator&utm_content=android_share

Benjamin Law

instead of Kling, I would prefer something I can host myself on RunPod or on my home computer and tweak with it. For example let it generate longer vides using some multi-scene trick. It would be great if that TTS also support European languages if it is not doing it already. Other than that, the animation looks great!

Lukáš Satin

equivalent :) because it's using the same AI model.

Benjamin Law

I have installed LatentSync on Windows 11 through WSL using the Ubuntu 22.04 distribution and Gradio. When using ComfyUI, could there be differences in the results compared to LatentSync on WSL, or are they equivalent?

Dani Bellver Hidalgo


Related Creators