This Is How I Am Doing Research To Find Best Training Hyper Parameters For SDXL DreamBooth Training
Added 2023-11-05 23:21:44 +0000 UTCThis Is How I Am Doing Research To Find Best Training Hyper Parameters For SDXL DreamBooth Training
Join discord and tell me your discord username to get a special rank : SECourses Discord
Started 6 different Automatic1111 SD Web UI on a 6x RTX 4090 GPUs having RunPod machine.
Doing x/y/z checkpoint comparison to find best hyper parameters for Stable Diffusion XL (SDXL) DreamBooth training with:
U-NET only
vs
U-NET + Text Encoder 1
vs
U-NET + Text Encoder 2
vs
U-NET + Text Encoder 1 + Text Encoder 2
Comparing lots of checkpoints with lots of different prompts.
Being sure to not overtraining and cooking model with Text Encoder training is super important.
Hopefully the results will become a public tutorial video later.
The new found config will be posted here : https://www.patreon.com/posts/very-best-for-of-89213064
Comments
it depends on purpose. for example for stylized output some civitiai models are better. i say compare both sdxl base and civitai model
Furkan Gözükara
2024-01-06 16:22:27 +0000 UTCi tried but couldnt get better results
Furkan Gözükara
2024-01-06 16:22:01 +0000 UTCIs it possible to start the training from a fp16 checkpoint from civitai? Or do we have to use the SDXL base model?
mypatreonemailacc
2024-01-06 16:12:15 +0000 UTCHave you tried any of the "no parameter" optimizers like Prodigy or DAdapt? Do you recommend them?
mypatreonemailacc
2023-11-29 17:26:23 +0000 UTCI am using Automatic1111. Diffusers is really really harder to replicate to get same results as Automatic1111. Auto1111 has so many additional improvements
Furkan Gözükara
2023-11-22 00:31:48 +0000 UTCWhen you are evaluating a lot of different checkpoints and prompts do you still use auto1111 or something more automatic to run the whole xyz plot? I tried to come up with a diffuser workflow but I don't get the same results as in auto1111
Cristina Segalin
2023-11-21 23:34:50 +0000 UTCi prefer to train without them but of course you can enable it if you have different aspect ratios. the effect being different
Furkan Gözükara
2023-11-12 13:55:05 +0000 UTCIs there a reason "Enable Buckets" is disabled in the 24GB config?
mypatreonemailacc
2023-11-12 12:48:26 +0000 UTCas far as i know it works great on ubuntu. try driver 525 nvidia driver and let me know. also what performance are you getting?
Furkan Gözükara
2023-11-11 11:53:12 +0000 UTCFurkan, Did you know if RTX 4090 had same performance issue on ubuntu as well? I wasn’t able to find your solution to solve the issue. I just switched from windows to ubuntu
So Sha
2023-11-11 07:36:05 +0000 UTC
