All Patreon Sharings and Scripts

this already exists in WAN first last frame presets workflows. we dont have atm but i plan to make

Furkan Gözükara

Is it possible we can get this? https://github.com/raindrop313/ComfyUI-WanVideoStartEndFrames

Hockey

hi in which app?

Furkan Gözükara

Hi, how can I save my personnal presets on SwarmUI

Julius

that sounds interesting. i will check if i can make. perhaps with newest AI tech we may make that easily. but best side of gradio apps that they are based on official pipelines so they are best quality and most accurate implementation

Furkan Gözükara

you build a lot of gradio based apps, which is very cool. Have you though about doing a small series of how to take a hashed out complex comfyUI workflow, and build a self contained single course gradio based application like you do. I love that you create and share and I am very happy to test and use, but I would lover to learn how to do something similar for my workflows. I love comfyUI, but would love to be able to have my workflows as apps, so that making new ones does not break them.. Also, would be cool to have option to pull in models we may already have from a central model storage.

James Charleston II

nice will check

Furkan Gözükara

https://github.com/microsoft/VibeVoice what about it ?

Alexandr Mishuk

the models doesnt support 10-20 yet but it would be fast since it wont need block swap

Furkan Gözükara

How fast do you think we can generate videos with Wan 2.2 and an RTX Pro 6000 Blackwell? 😊 Or could we get a one shot 10-20 second video generation?

Robert Arsene

https://youtu.be/8cMIwS9qo4M this video very up to date follow this 21:32 Part 2: Massed Compute Cloud GPU Tutorial 22:03 Massed Compute - Deploying a GPU Instance (H100) 23:40 Massed Compute - Setting Up the ThinLinc Client & Shared Folder 25:07 Massed Compute - Connecting to the Remote Machine via ThinLinc 26:06 Massed Compute - Transferring Files to the Instance 27:04 Massed Compute - Step 1: Installing ComfyUI 27:39 Massed Compute - Step 2: Installing MultiTalk Nodes 28:11 Massed Compute - Step 3: Downloading Models with Ultra-Fast Speed 30:22 Massed Compute - Step 4: Launching ComfyUI & First Generation 32:45 Massed Compute - Accessing the Remote ComfyUI from Your Local Browser 35:07 Massed Compute - Downloading Generated Videos to Your Local Computer 36:08 Massed Compute - Advanced: Integrating with the Pre-installed SwarmUI 38:06 Massed Compute - Crucial: How to Stop Billing by Deleting the Instance 38:33 Part 3: RunPod Cloud GPU Tutorial

Furkan Gözükara

Regards running on MC, what is the best process?

Walker4k

it works with our existing config and kohya perfect. i also plan to make a comparison video hopefully

Furkan Gözükara

Checking out the new Flux.1 KREA. Can't wait to see how it finetunes.

Tan

yes i plan to do ty for reminding

Furkan Gözükara

There's a new AI image editor called HiDream-E1-1 out that seems similar to Flux Kontext and BAGEL. Though it has a better license than Flux Kontext (it looks like it can be used commercially, like BAGEL can, unlike Flux Kontext). And I assume it might be better quality than BAGEL or that it can run or 24 GB GPUs easier than BAGEL can. If it would be runnable on 24 GB GPUs (though if it goes over into RAM that would be okay too though ideally it wouldn't be too slow)could you please create an easy install for it (eg. with a gui)?

cool1

we have hidream in swarmui already to use this video shows but i plan to investigate further : https://youtu.be/fTzlQ0tjxj0

Furkan Gözükara

yes please remind me in few days

Furkan Gözükara

Hi Mate, will you update your Joy Caption setup to beta one model version ? Im curious how good it is.

Bartosz Polecki

Hey bro, have you read about the new AI image generator HiDreamAI? They say it’s better than Flux, with a lot more parameters and better instruction interpretation. Hopefully, you’ll be able to include it in your materials and tools in the near future as well, so we can learn how to work properly with that model and even train our own models. greetings, bro!

Civitaier

i am waiting 2.5 they said they will publish

Furkan Gözükara

i saw this but this is only useful for blurry video. you still need it?

Furkan Gözükara

I'd love you to do this video de-blurer please https://github.com/DachunKai/Ev-DeblurVSR

Philip Heggie

will be really cool have this one local too: Hunyuan3D 2.0 2MV

Sérgio Merêces

sadly i dont know any good Turkish atm. but if you know any good repo i might make installer

Furkan Gözükara

Hi, Furkan is there a good text to speech model with Turkish support in your 1 click install archive for 5000 series?

umut yilmaz

Thanks. Hopefully I will add to very best one soon

Furkan Gözükara

Hi Furkan, great to see your github is back :) Cheers! Do you know a good free video upscaler for use with framepack?

Chris

100%. and i will look controlnet upscaler sounding good

Furkan Gözükara

it's clearly worthy of attention. https://github.com/SandAI-org/Magi-1 and this https://huggingface.co/jasperai/Flux.1-dev-Controlnet-Upscaler

Alexandr Mishuk

thanks adding to list

Furkan Gözükara

Hi! I found this project to generate music and add sounds to video. Tried the demo seems great! Can you consider it for adding the project here? :) https://zeyuet.github.io/AudioX/

Andrea Taini

yes hopefully will make a tutorial for it soon

Furkan Gözükara

what about https://github.com/HiDream-ai/HiDream-I1 ?

Alexandr Mishuk

perhaps inpainting text may help did you try? here a tutorial : https://youtu.be/hewDdVJEqOQ

Furkan Gözükara

Hi, good afternoon. Which AI model would you recommend to generate images that already include text within them? My goal is to create images where the text is integrated from the beginning, so I don’t have to add it manually afterward. For example, if the image shows a car, I’d like it to already include something like “Edu’s Car”. I have InvokeAI installed, but I haven’t been able to achieve the desired result. Could you guide me on how to do it or suggest a more suitable tool?

Andres Eduardo Damonte

you can try InvokeAI : https://www.patreon.com/posts/112912425

Furkan Gözükara

I'm having an awful time with inpainting with Flux in SD Forge and Swarm UI. Do we have a better inpaint AI software?

Hockey

well there are control nets for this but i am searching for SOTA that will do as we want like OpenAI image model.

Furkan Gözükara

Is there an AI software we got here that has the ability to alter the style of an image but retaining the structure? For instance, in Photoshop you can apply filters which doesn't alter the structure.

Hockey

i dont understand your question can you elaborate?

Furkan Gözükara

Can you write up a models directory that is remote from your installs so that we don't have to cart the folders from one place to another with each update? We get things working and, these environments are rather fragile, they don't want to try to just 'update'. A shared pool of models would be best.

Taiga

hello fixed use the latest zip file please it has working notebook ty

Furkan Gözükara

Thank you. Here is my notebook for your ease: https://www.kaggle.com/code/namlh2004/notebook203c8143c4

Nam Lê Hoàng

checking right now

Furkan Gözükara

Hi, I am from Discord server. Here is the my problem: Can you check the Kaggle version of IDM-VTON project again ? https://github.com/FurkanGozukara/IDM-VTON/blob/main/app_VTON.py I followed the instructions in Youtube and Kaggle file in Patreon, it could run 3 weeks ago. But now when I ran, it showed me the error: ValueError: When localhost is not accessible, a shareable link must be created. Please set share=True or check your proxy settings to allow access to localhost. I tried to set share=True, but it didn't work.

Nam Lê Hoàng

hi latest version is here : https://www.patreon.com/posts/wan-2-1-ultra-as-123105403 i am about to update to next version soon

Furkan Gözükara

thanks for reply.. i have installed your 1 click installation package, what is v33 and how can i get it please?

Milan Šaffek

hello it was broken. just few minutes ago fixed with v33. are you on v33 right now? if you are on v33 what you can do is monitor your VRAM usage is slowly increase number of persistent parameters until it becomes too slow. like increase it with 500m at a time.

Furkan Gözükara

Hey, i have also issues with training on rtx 4090. i tried 24g or 16g presets, and all are very slow about (50s /it).. Where i could find Number of Persistent Parameters In Dit ?

Milan Šaffek

yes you are right. lower steps = lower VRAM and faster generation

Furkan Gözükara

Furkan, I found the reason: if I use different number of steps, I get different VRAM usage. 81 or more use more than 23.5 GB at once. 40 steps use about 10 GB. It is right? I think the problem might be the Number of Persistent Parameters In Dit (VRAM). For 24 GB it is set to 0.

Roman Fierce

Wow weird. so now you have idea therefore you can slightly increase according to your system.

Furkan Gözükara

Hi Furkan! I hope you have a great day. I am having constant issues with current presets. They go over 23.5GB of my VRAM (RTX 4090) and then the generation stops. Do others report the same issues? Is there a way to make the program use less VRAM? Thanks. Update: I switched to 16GB preset and VRAM usage currently is at 19.1GB. My system uses only 1GB and I don't use any AI apps in parallel. That's weird.

Roman Fierce

Kaggle currently banned Gradio. But usually I make. For example I was gonna make for Wan 2.1, even prepared, but Gradio not working :(

Furkan Gözükara

If the requirements are rather low, will there be a Kaggle Notebook, as well?

Philipp Capetian

yes i was working but now working on Wan 2.1 even better

Furkan Gözükara

Could you do a tutorial on the Skyreels v1 image2video and text to video please, for Comfyui (local)? With info about setting things up. I tried setting that up but keep getting errors when I try to queue a prompt (size mismatch. So I've not set things up right). Also I only saw a workflow for image2video not the text one too.

cool1

VRAM is more important because when it doesn't fit into VRAM, it will use RAM and it will be many times slower. So go with highest VRAM :) to compare their speed you can run both GPUs on RunPod and compare or look their CUDA core counts

Furkan Gözükara

Does anyone know if VRAM is more important for speed or the graphic card itself? Only cheap 16 Gb card I can find in a laptop is the Quadro RTX 5000. It's slower than the RTX 3080, the question is how much slower. =S I use a RTX 2060 with 6 Gb VRAM today.

Hockey

Yes. Sorry for the delay. I have a lot of real life back-logs but it is a high priority

Furkan Gözükara

Are you working on Hunyuan Video Lora training?

VelorianX

nice. hopefully very soon with more features than official version i will publish

Furkan Gözükara

It's less gpu intensive then trellis also

Sylvain

yes i am following every changes. my tutorial will be based on that hopefully

Furkan Gözükara

Well that was easy. Due to the UV version delivered with the bmaltais/musubi-tuner-gui, the complete installation of musubi-tuner and the GUI and all Python requirements was done with the three commands: git clone --recursive https://github.com/bmaltais/musubi-tuner-gui.git cd musubi-tuner-gui .\gui.bat

Jason Dawn

Hi, do you have plan to make an installer for https://github.com/kohya-ss/musubi-tuner in combination with this gradio UI: https://civitai.com/articles/10335/hunyuan-video-lora-trainning-with-gui-in-windows Edit: Actually the creator of Kohya_SS GUI started to work on a GUI for Musubi-Tuner: https://github.com/bmaltais/musubi-tuner-gui

Jason Dawn

thanks will work on it soon hopefully

Furkan Gözükara

Tested it today - it's definitely gives more solid results

George Gostyshev

great one thanks should make installer. i wonder if better than trellis

Furkan Gözükara

https://github.com/Tencent/Hunyuan3D-2 Could be great to have one)

George Gostyshev

i agree hopefully try to cover

Furkan Gözükara

seconded. i run local LLM's often. I would have benefitted massively from explanations of different settings especially.

Mike

yes i wanted to cover them as well but i never had time until now :D except very few cases

Furkan Gözükara

In the 'about' section it says "I will share the very best tutorials and scripts and installers and guides for:" and one of the things it says is "Large Language Models (LLMs)". Will there be more tutorials on the free local large language models (maybe including those that can do agent type stuff) and local apps for them please (like GPT4ALL, oobabooga text gen etc)? Like doing clever things that might be profitable with them?

cool1

yes coming soon hopefully :)

Furkan Gözükara

Hi Furkan, please make a tutorial on hunyuan Lora/finetunig :) :)

Louis L'herrou

nice i will checkout

Furkan Gözükara

I'd love this 2d to 3d video converter https://github.com/TencentARC/StereoCrafter

Philip Heggie

i plan to make a tutorial for this hopefully soon

Furkan Gözükara

Hi Furkan, i thought you also had a tutorial on ltx image to video in swarmui, maybe i am confusing it with some other tutorial. did you do that on youtube about ltx and swarm?

Chris

nice gonna check out

Furkan Gözükara

Hi. Pay attention to this cool image upscaler. The quality is fire. It works on the basis of SD https://github.com/ArcticHare105/S3Diff

Kappa_Neuro

yep it is almost ready. i made some nice upgrades :)

Furkan Gözükara

You need to update the Nvidia sana image generator because a new model of sana nvidia avialabnle that is "SANA_1600M_2Kpx_BF16.pth.

Anshul Gupta

yes we have please read here : https://www.patreon.com/posts/108419878

Furkan Gözükara

Thanks, Do you have a tutorial to change the hugging face cache folder to a different drive

Philip Heggie

surely you can install models on other drives. especially you can change your hugging face cache folder to a different drive . just install python cuda cudnn c++ tools ffmpeg and similar thing on C

Furkan Gözükara

I'm running out of space on windows c: drive because of AI can I install on a new 1TB F: drive to save space on c: drive please?

Philip Heggie

Thank you very much, looking forward!

Chris

i just asked that if possible in SwarmUI

Furkan Gözükara

Hi Furkan, do you know how to get this done in swarmui? Looks like details can be improved greatly with modification of sigma shift: https://github.com/Jonseed/ComfyUI-Detail-Daemon

Chris

your best shot is using ctrl-f in here : https://github.com/FurkanGozukara/Stable-Diffusion/blob/main/Patreon-Posts-Index.md that is what i am using constantly to see. patreon system so bad for a better presentation

Furkan Gözükara

I don't find how things are organized to be very useful. I don't want to access things using chronological order, but by topic / category. Eg flux, sdxl, sd1.5, etc. Stuff is munged together it's an effort to tease out the information I'm looking for within this patreon

gravy

hopefully i am going to investigate this and make auto downloader

Furkan Gözükara

Hi Furkan, do you know if controlnets can be installed and used in swarmui with flux models? there are no models in the dropdown menu of swarmiu controlnet section. do i have to download them or are there none for flux yet?

Chris

yes i didnt describe anything. the bigger image dataset 256 images works best. check out into of this tutorial : https://youtu.be/FvpWy1x5etM

Furkan Gözükara

i don't know txt mlp or other blocks. as far as i know there are 19 double layer and 38 single layer blocks in MMDiT model of the FLUX

Furkan Gözükara

yes i am following it is great one

Furkan Gözükara

Furkan, look what a cool and promising thing! It works with images now, but it will work with videos soon! Maybe you'll even make an 1-click-installer and interface :D https://github.com/wangjiangshan0725/RF-Solver-Edit

Kappa_Neuro

Why didn't you exclude txt, mlp and other blocks when learning on 1 block (layer)?

Kappa_Neuro

Hi, Furkan! Which dataset are you currently using to test training? How did you describe this dataset? I just noticed that there is a problem with the hair color change in your tests, but I don't remember you describing your hair in your dataset.

Kappa_Neuro

i still find pre alpha best thus waiting next version to update it takes huge time the guy changes so much

Furkan Gözükara

But isn't that note about "Note: Alpha Two is not a general instruction follower and will not follow prompts outside its training data well. Use this feature with caution." isn't it the same thing as with joycaption alpha 1 as well. (or maybe he just meant the additional instructions he trained it for - the 100K ones weren't enough and varied enough to make it _very_ flexible for that)? In the Joycaption alpha 2 release notes he said he added "100k more captions based on a quick set of instructions I threw together. The instructions are nowhere near comprehensive, so Alpha Two isn't a general instruction follower. But the new Caption Types you'll find in the demo are part of this expansion of capabilities. " But alpha 1 isn't a general instruction follower either outside the training set (which is about 100K less than alpha 2 I think), eg. I don't think you can put in the custom prompt "...write the caption in British English/UK spelling" and have it properly do that (maybe because none of the training captions had it with that spelling). Though you can put in the custom prompt things like who the person is and where the shot is and it sometimes takes that into account when describing the image (in alpha 1. I assume it might do that in alpha 2 too). For alpha 2 in the release notes he said he manually checked the different versions against 15 validation images with human written captions I think (though that seems quite a low number for proper validation, ideally he could have checked a lot more), so for accuracy on those checks, his scores were 22.6 for PreAlpha, 21.5 for Alpha 1 (so alpha 1 was actually slightly less accurate than the prealpha based on those 15 validation images), 22.8 score for Alpha 2. So alpha 2 is, according to him, the most accurate so far (though only 0.2 better than the previous best one - PreAlpha), but also has more custom options (even though it could be better and follow instructions better, maybe if it was trained on more content with more variety of captions).

cool1

ye i know alpha 2 but it is i think even worse than alpha 1. pre alpha still working best. i skipped that version since it is "Note: Alpha Two is not a general instruction follower and will not follow prompts outside its training data well. Use this feature with caution."

Furkan Gözükara

Hi, Furkan! Let's update the model in the image description interface (JoyCaption https://www.patreon.com/posts/110613301) The second alpha version has been released: https://civitai.com/articles/7697/joycaption-alpha-two-release Demo: https://huggingface.co/spaces/fancyfeast/joy-caption-alpha-two Model: https://huggingface.co/fancyfeast/llama-joycaption-alpha-two-hf-llava

Kappa_Neuro

it is hard to train a new language not easy task

Furkan Gözükara

I managed install it locally, its easy, also i wanted to train my voice, but Polish language, and as I think, it needs a lot of hours to learn new language as for test i used only 2 minutes of my voice lol, and result ... voice was similar but completely not Polish accent. Or I do not know how to use a vocab list

Arkadiusz D

i am closely following for a full tutorial with fine tuning

Furkan Gözükara

Did you try T5 TTS ? https://github.com/SWivid/F5-TTS

Arkadiusz D

it is so hard to test and especially installation of this part will be biggest challenge cd submodules/gaustudio-diff-gaussian-rasterization python setup.py install cd ../../ python setup.py develop also they have no demo app :D

Furkan Gözükara

Hi, can you watch this neural network? Is it really possible to install it on Windows? No matter how many times I tried, it doesn't work out. https://github.com/GAP-LAB-CUHK-SZ/gaustudio

Kappa_Neuro

i think swarmui may support this let me ask

Furkan Gözükara

OmniGen https://github.com/VectorSpaceLab/OmniGen

Arkadiusz D

I also wish to use but I think its only for Linux ?, not Windows ?

Arkadiusz D

hopefully yes. currently editing the FLUX fine tuning tutorial

Furkan Gözükara

Hi are you going to do Hallo2 https://fudan-generative-vision.github.io/hallo2/#/

Philip Heggie

yes it is on my todo list hopefully

Furkan Gözükara

Did you hear about https://huggingface.co/spaces/ohayonguy/PMRF ??? I wish to know how to install it locally

Arkadiusz D

yep possible but usually ai picks problems that comes with ai images :D

Furkan Gözükara

this is really pretty cool. some automation combined with this tool and we could easily make proper good sized datasets for flux that expand the range of emotions on a models face.

Patrick Major

I am gonna make Fine Tuning which is better than DoRA :) but If Kohya adds DoRA I plan to research it as well

Furkan Gözükara

awesome ty so much

Furkan Gözükara

You might want to make an app for expression-editor cog image by fofr Easily Change Facial Expressions On Images https://github.com/fofr/cog-expression-editor https://www.youtube.com/watch?v=DC3sYgj_byc

Philip Heggie

Hi, Could you please kindly make a video/tutorial on DoRA character training? I saw astonishing results online using DoRA with flux.

V Santhosh

HopeFOLEY lol

Nobodys Hero

yep coming soon hopefully

Furkan Gözükara

+1

Tobe2d

yes it is on my todo list hopefully

Furkan Gözükara

Hi can you make an app for Flux PuLID please https://github.com/ToTheBeginning/PuLID https://www.youtube.com/watch?v=NA_NpkIYsEo Flux Pulid - Create Consistent Characters From A Single Image - No Lora Needed!

Philip Heggie

nice will do hopefully

Furkan Gözükara

Would you mind making an installer for FoleyCrafter which automatically add synced sound effects to your mp4 videos https://www.youtube.com/watch?v=o8uhRTuqvvY and https://github.com/open-mmlab/foleycrafter

Philip Heggie

i published it if you missed : https://www.patreon.com/posts/110060645

Furkan Gözükara

Thank You. It's also lightning fast when processing very small images too.

Philip Heggie

nice. surely i will add hopefully soon

Furkan Gözükara

I found it worked very well on small images. It alters images less than supir so think it might work good for videos with less difference between frame to frame. Thankyou for adding to your list.

Philip Heggie

I tested it and it wanst good but surely i can make. adding to list

Furkan Gözükara

Would you mind doing windows install with batch image support for GigaGAN upscaler please for AURA-SR GigaGAN Open-Source Super-Resolution Upscaler it's on pinokio without batch support. https://discord.com/channels/1121039057993089076/1144758664746512435/threads/1255601335307468910

Philip Heggie

thanks just set your rank. it allows you to have special rank color and access patreon chat

Furkan Gözükara

Uhm... what's special rank on discord. My discord name is "igothics"

The Strategist

yes. this means while installation there was an error so it was incomplete. please reinstall and send me all install logs : monstermmorpg@gmail.com

Furkan Gözükara

Does anyone know how to fix this error? \gradio_demo.py", line 13, in import einops ModuleNotFoundError: No module named 'einops'

PirateDiffusion.com

well maybe they updated

Furkan Gözükara

--share=TRUE seems to work, altghough it gives me a weird gradio hex address that I am not used to...

Bas Uterwijk

"gradio_demo.py: error: argument --share: expected one argument"

Bas Uterwijk

in the start_SUPIR_Windows.bat like this python gradio_demo.py %lowvram% %tiledVAE% %theme% %cpuMove% --open_browser --share

Furkan Gözükara

Bas Uterwijk

we have --share args

Furkan Gözükara

I am trying to ass the --listen flag anywhere in a .bat file but no luck so far. Does anyone know how to access my Supir from another PC on my home network?

Bas Uterwijk

nice

Furkan Gözükara

Looks like a bug was found in gradio, now you can just add a few lines of code to change oobabooga theme colors on everything easily! I wonder if this can be done in forge/auto1111, would make great tutorial also! https://github.com/oobabooga/text-generation-webui/issues/5731

Karl B

I saw that. I should make. I plan to cover voice cloning

Furkan Gözükara

Any chance you can make an easy one click installer for this voice cloning with oobabooga with mic. Uses alltalk_tts. His workflow in comments. https://www.reddit.com/r/StableDiffusion/comments/1bbtu7l/oobabooga_with_voice_cloning_now_working_great/

Karl B

if working you are fine. SUPIR is standalone app right now not extension or module

Furkan Gözükara

Sorry for the nonsense, so I don't need to install today's update? will everything work for me anyway, based on the v22 update for March 5th? I just thought that this update would work in my SD as an add-on module.

VRMOTION

yes you dont need runpod at all. if you have 24 gb gpu you can run everything perfectly

Furkan Gözükara

That is, I don't need to install RUNPOD to make everything work on the computer:?

VRMOTION

100% i have everything for both locally and on cloud

Furkan Gözükara

And is it possible to use it locally in your SD 1.5 without the Internet?

VRMOTION

runpod is a cloud service which you access from browser. however the scripts made for runpod can be used on linux because runpod uses linux as operating system. so you can use runpod even from your mobile phone with browser. that is the difference.

Furkan Gözükara

I'm a little confused. is runpod not for Windows but for Linux? can I install this on windows?

VRMOTION

yes hopefully i will make script for it for both runpod and kaggle. it is a great new web ui.

Furkan Gözükara

Thanks for your work! Can you please do one more script for runpod https://github.com/lllyasviel/stable-diffusion-webui-forge It's upgrade for auto1111 with new upgrade for controlnet extention

Anton Kuvshinov

please use this script on runpod web ui version works amazing : https://www.patreon.com/posts/84896373

Furkan Gözükara

I use the standard one to load the runpod fast, but controlnet does not update the old version, how should I code? and should I update ? thanks

baran mengül