NokiMo
Furkan Gözükara
Furkan Gözükara

patreon


JoyCaption : Amazing Image Captioner - Batch Processing and Multi-GPU - Windows, RunPod, Massed Compute 1-Click Installers

Added 2023-11-27 22:11:00 +0000 UTC

This post is now obsolete : https://www.patreon.com/posts/118827960

New post : https://www.patreon.com/posts/118827960

New scripts are published at : https://www.patreon.com/posts/118827960

https://www.patreon.com/posts/118827960

Patreon exclusive posts index to find our scripts easily, Patreon scripts updates history to see which updates arrived to which scripts and amazing Patreon special generative scripts list that you can use in any of your task.

Join discord to get help, chat, discuss and also tell me your discord username to get your special rank : SECourses Discord

Please also Star, Watch and Fork our Stable Diffusion & Generative AI  GitHub repository and join our Reddit subreddit and follow me on LinkedIn (my real profile)

=======

For mass editing captions > https://www.patreon.com/posts/108992085

Latest installers : Joy_Caption_v25.zip

24 November 2024 Update V23

24 November 2024 Update V23

22 September 2024 Update V20

19 September 2024 Update V17

15 September 2024 Update V16

27 August 2024 Update V12

26 August 2024 Update V11

25 August 2024 Update V10

24 August 2024 Update V6 Big Update

24 August 2024 Update

Windows Requirements

How to Install and Use on Windows

How to Install and Use on Cloud

Regarding Default Expert Settings

App Screenshots and Examples

 

 

 

Comments

published for you it took more than 1 day :D https://www.patreon.com/posts/118827960

Furkan Gözükara

2024-12-28 14:41:48 +0000 UTC

published for you it took more than 1 day :D https://www.patreon.com/posts/118827960

Furkan Gözükara

2024-12-28 14:41:40 +0000 UTC

published for you it took more than 1 day :D https://www.patreon.com/posts/118827960

Furkan Gözükara

2024-12-28 14:41:18 +0000 UTC

published for you it took more than 1 day :D https://www.patreon.com/posts/118827960

Furkan Gözükara

2024-12-28 14:41:14 +0000 UTC

looks like the guy doesnt gonna make next version so i will add alpha 2 as well :D give me some time

Furkan Gözükara

2024-12-27 17:34:30 +0000 UTC

Thank you for your powerful and actual works in AI themes. I was/am your subscriber long time and I see how you do very interesting, useful works and comparison testing. ... I am waiting also the joy v2 :) and many others projects in this AI chaos in our world! https://huggingface.co/spaces/fancyfeast/joy-caption-alpha-two Best regards Anton Finland

Ant-2014

2024-12-27 09:42:03 +0000 UTC

i am waiting next version pre alpha is best i think

Furkan Gözükara

2024-12-23 00:29:27 +0000 UTC

Please add alpha two.

Mario Santiago

2024-12-22 22:33:20 +0000 UTC

you are welcome

Furkan Gözükara

2024-11-28 00:50:29 +0000 UTC

Thanks for adding the new Stop Batch Processing option.

cool1

2024-11-28 00:08:51 +0000 UTC

upgrade to v24 - overwrite previous app and it is there :)

Furkan Gözükara

2024-11-27 23:50:24 +0000 UTC

Can you add a stop button, for the batch processing

Nicolas Nicolau

2024-11-27 21:54:01 +0000 UTC

ye sometimes restart fixes great

Furkan Gözükara

2024-11-14 20:55:12 +0000 UTC

I restarted the Pod, and that solved it.

Ava Frigg

2024-11-14 17:42:13 +0000 UTC

I get this error with OOM on trying to batch process my imgs. I have no other terminal running and no other apps which consume GPU memory. Using runpod: Loading tokenizer Loading LLM on device cuda:0 Loading VLM's custom text model Loading checkpoint shards: 25%|███████████████████████████▌ | 1/4 [00:00<00:02, 1.25it/s] Error loading custom text model: CUDA out of memory. Tried to allocate 112.00 MiB. GPU 0 has a total capacity of 47.54 GiB of which 78.94 MiB is free. Process 3637526 has 40.17 GiB memory in use. Process 3771132 has 7.28 GiB memory in use. Of the allocated memory 6.75 GiB is allocated by PyTorch, and 283.46 MiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True to avoid fragmentation. See documentation for Memory Management (https://pytorch.org/docs/stable/notes/cuda.html#environment-variables) Checking contents of text_model directory: - adapter_config.json - README.md - adapter_model.safetensors

Ava Frigg

2024-11-14 12:48:52 +0000 UTC

hello. please reinstall and send me install logs. i just tested a fresh install and 0 issues. your model downloads looks like failed also follow this video it is requirements : https://youtu.be/DrhUHnYfwC0

Furkan Gözükara

2024-11-01 23:58:10 +0000 UTC

Got this error when when I ran this for the first time. Seems there is a backup but maybe it's not as good? Is this something I can manually do? Loading VLM's custom text model Error loading custom text model: We couldn't connect to 'https://huggingface.co' to load this file, couldn't find it in the cached files and it looks like meta-llama/Meta-Llama-3.1-8B is not the path to a directory containing a file named config.json. Checkout your internet connection or see how to run the library in offline mode at 'https://huggingface.co/docs/transformers/installation#offline-mode'. Checking contents of text_model directory: - adapter_config.json - adapter_model.safetensors - README.md Falling back to default model

Brian Skipper

2024-11-01 23:39:40 +0000 UTC

this is due to your ISP very likely. use warp vpn for installation and should get fixed. you dont need clouflare zero trust : https://youtu.be/0RSaYlmmblc

Furkan Gözükara

2024-10-15 09:27:00 +0000 UTC

Using cached https://download.pytorch.org/whl/cu124/torch-2.4.1%2Bcu124-cp310-cp310-win_amd64.whl (2506.2 MB) ERROR: THESE PACKAGES DO NOT MATCH THE HASHES FROM THE REQUIREMENTS FILE. If you have updated the package versions, please update the hashes. Otherwise, examine the package contents carefully; someone may have tampered with them. torch==2.4.1 from https://download.pytorch.org/whl/cu124/torch-2.4.1%2Bcu124-cp310-cp310-win_amd64.whl#sha256=db873d7c9f4b959ea818780736ad55c3b120d0337b12ef84a0ad5e9a6fc6b147 (from -r requirements.txt (line 4)): Expected sha256 db873d7c9f4b959ea818780736ad55c3b120d0337b12ef84a0ad5e9a6fc6b147 Got 3d880258ee1ea10e8b107466d19766c641695b61fee202c133a4b732c2fe8eca

Ying Mo

2024-10-15 03:01:44 +0000 UTC

Thank you

cool1

2024-10-06 13:02:34 +0000 UTC

maybe not immediate stop but that kind of stop may work. will look that ty

Furkan Gözükara

2024-10-06 13:00:13 +0000 UTC

Okay thanks I'll do that (ctrl+c in the command prompt window then then double click on the start .bat file). Kohya has a stop button (eg. to stop training part way through) but if it's a difficult thing to add that's okay. I don't know if adding a checkbox for stopping the batch would be easier, so it didn't need to stop immediately but could check that value in the gui just before it starts captioning the next file in the list and if the value is true/checked break out of the batch captioning loop. But if that would be difficult that's okay.

cool1

2024-10-06 07:48:46 +0000 UTC

well just restart. cancelling is really harder task

Furkan Gözükara

2024-10-06 00:33:24 +0000 UTC

In JoyCaption UI, once you've started the batch mode and it goes through each file in the folder (which can take quite a long time depending on number of files), currently if you've made a mistake you need to wait for it to complete all files in the folder. Would it be possible to add a "stop" or "cancel" button please so you could abort it part way through (eg. if you've forgotten to add the caption prefix or some other setting)?

cool1

2024-10-05 23:22:23 +0000 UTC

i don't plan alpha 2 atm "Note: Alpha Two is not a general instruction follower and will not follow prompts outside its training data well. Use this feature with caution." from which point you found it better?

Furkan Gözükara

2024-09-27 20:57:43 +0000 UTC

Can you add Alpha Two ? A README with command to use it without the GUI would be awesome also :) EDIT : To try it locally $ git clone https://huggingface.co/spaces/fancyfeast/joy-caption-alpha-two $ cd joy-caption-alpha-two $ python -m venv venv $ .\venv\Scripts\activate $ pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu124 /////You can check for different CUDA here https://pytorch.org/get-started/locally/ $ python app.py (I was needed to $ pip install spaces and $ pip install protobuf But I don't know if it's the same for everybody, and btw you can access different llm on duck.ai to troubleshoot)

Oui

2024-09-27 19:10:12 +0000 UTC

100% related to your computer. this usually happens when your computer or your antivirus or your internet provider blocks remote library servers. if you are on runpod kill that machine get new one asap. on windows try with WARP VPN

Furkan Gözükara

2024-09-24 10:42:02 +0000 UTC

Hi I get this error ERROR: THESE PACKAGES DO NOT MATCH THE HASHES FROM THE REQUIREMENTS FILE. If you have updated the package versions, please update the hashes. Otherwise, examine the package contents carefully; someone may have tampered with them. torch==2.4.1 from https://download.pytorch.org/whl/cu124/torch-2.4.1%2Bcu124-cp310-cp310-win_amd64.whl#sha256=db873d7c9f4b959ea818780736ad55c3b120d0337b12ef84a0ad5e9a6fc6b147 (from -r requirements.txt (line 4)): Expected sha256 db873d7c9f4b959ea818780736ad55c3b120d0337b12ef84a0ad5e9a6fc6b147 Got 74ff1129e87e85bf9c6c47e8bbf5a02c22bc00c3589ab5ef3526c1397f79c413

Orpheus_Reup

2024-09-24 10:01:42 +0000 UTC

nice catch let me fix it

Furkan Gözükara

2024-09-22 11:38:40 +0000 UTC

The new version does not remove: "This image is"

楠 陈

2024-09-22 11:38:06 +0000 UTC

updated try and let me know please

Furkan Gözükara

2024-09-22 02:29:50 +0000 UTC

working on it right now

Furkan Gözükara

2024-09-22 00:52:02 +0000 UTC

Please add Alpha One release

楠 陈

2024-09-22 00:47:09 +0000 UTC

thank you so much

Furkan Gözükara

2024-09-21 16:30:38 +0000 UTC

legend among us people! Thank you! So glad i subscribed! A lot other patreon and you'tubers don't put out the quality i've seen so far from your tuts and instructions! Well done!

Myk

2024-09-21 15:30:42 +0000 UTC

for this app no, just extract and overwrite new zip file into same folder

Furkan Gözükara

2024-09-21 01:34:54 +0000 UTC

last question, do i git pull anything, or do i have to totally reinstall this everytime there is an update? AGAIN thank you soooo much for your tutorials and instructions! your vids are great!

Myk

2024-09-21 01:29:16 +0000 UTC

well i think i was freaking out for nothing, apologies....but i was honest about those issues. When loading it, i had to repeatedly hit the .bat to install it, (THEN also repeatedly hit the other load bat for the UI) as when it hit an error, usually saying huggingface wasn't there until i had to drag it from my User/python location over to the venv location inside the Joy-Cap 17 Lib... Then if you drag or place an image (was testing just one image) into the load area, it would COPY what you placed and place it in the windows TEMP folder under gradio/(large and long named other folder)/ which i think is not cool at all. dumping training images into an OPEN area is not ok with me at all. Just for safety sake, nothing crazy just concerned.

Myk

2024-09-21 01:28:19 +0000 UTC

Watch this video you will understand very helpful : https://youtu.be/rjXsJ24kQQg?si=opUFaaxkezkmCFNH

Furkan Gözükara

2024-09-21 00:28:55 +0000 UTC

i dont understand this>>> Why did it download 15gb of shards for this, also where did it download to?? example, model-00002-of-00004.safetensors and 4 others totaling 15gb, and didnt say where they went, as i cant see them in the directory

Myk

2024-09-21 00:17:36 +0000 UTC

It requires LLM model to run it is a expected

Furkan Gözükara

2024-09-21 00:09:54 +0000 UTC

wy is is downloading these large 5gb files?

Myk

2024-09-21 00:00:35 +0000 UTC

i wonder if it;s because i selected gradio share (option 3), i selected option 1 this time but it started the SHARD download again???? safetensor 0002 of 0004, LARGE FILES?

Myk

2024-09-20 23:59:22 +0000 UTC

when i select an image from my folders, it will place that image in my WINDOWS TEMP folder under gradio

Myk

2024-09-20 23:52:42 +0000 UTC

it is installed, but when i run the batch it starts to download shards>???

Myk

2024-09-20 23:51:41 +0000 UTC

you must be doing something wrong. first of all it saves images into your outputs folder inside locally installed folder. you can also decide outputs folder as well when doing batch. also it downloads shards into your hugging face default cache folder. and default settings works best you dont need to do anything

Furkan Gözükara

2024-09-20 23:49:22 +0000 UTC

this was supposed to be an easy solution to caption my dataset before i started training my flux model, but now i have to figure out WHY there isn't clear settings where i can CHOOSE where everything goes. There should be NO REASON this program DUMPS my training images into windows TEMP folder.

Myk

2024-09-20 23:42:10 +0000 UTC

it was downloading shards?? what? it is supposed to work after downloading the model, but now it wants to do this online, and also dumps the files in my windows TEMP folder, which is unsafe

Myk

2024-09-20 23:36:11 +0000 UTC

i got it working but i had to continuously press the install bat. NOW i huave an issue where it keeps trying to do this online. I have a local based system and DO NOT want to be online (limited bandwidth). So why cant i get this thing working offline?

Myk

2024-09-20 23:35:18 +0000 UTC

please try v18 and let me know. if still doesnt work that means you have an error related to your python installation

Furkan Gözükara

2024-09-20 22:25:00 +0000 UTC

i have been trying to install this so many times and always get errors when installing it: ModuleNotFoundError: No module named 'huggingface_hub'

Myk

2024-09-20 22:22:00 +0000 UTC

Thanks a lot. I didn't know if the first one would be too complex. I'll download and try it now. edit: Yes it's working okay thank you.

cool1

2024-09-19 14:21:40 +0000 UTC

both added let me know

Furkan Gözükara

2024-09-19 14:12:21 +0000 UTC

I've noticed that sometimes in JoyCaption, with the "max new tokens" set to about 300 or more, it can repeat the last sentence or if it's about 400 it can repeat the last 2 sentences multiple times (maybe to reach the "max new tokens" size when it doesn't know what else to say). I assume if the repeats were left in it might give too much importance/over-train those repeated sentences. Could the app detect that if possible please and remove any repeats or would it be too complex/too much work? Also the app's name in the Firefox tab name is "Gradio". Though if you have multiple gradio apps it might not be that clear. Maybe the app caption for the browser tabs could be changed to something about "JoyCaption".

cool1

2024-09-19 13:51:30 +0000 UTC

nice

Furkan Gözükara

2024-09-16 17:45:51 +0000 UTC

yea for that moment but it run with llama 3 and it would be better with mistral nemo

kama

2024-09-16 16:07:05 +0000 UTC

i think JoyCaption is the best atm

Furkan Gözükara

2024-09-16 15:07:10 +0000 UTC

First thank you very much for your software and your tuto that help me very well. I would like to know if it s possible to switch for an other llm like mistral nemo that would be more appropriate? thanks for your response

kama

2024-09-16 14:28:11 +0000 UTC

updated 2.4.1 ty

Furkan Gözükara

2024-09-15 15:46:43 +0000 UTC

Alright, will do. ;-)

Tobe2d

2024-09-15 13:26:51 +0000 UTC

Awesome

Furkan Gözükara

2024-09-15 12:56:23 +0000 UTC

Awesome

Furkan Gözükara

2024-09-15 12:55:59 +0000 UTC

This is not on a repo so you need to overwrite zip file:))

Furkan Gözükara

2024-09-15 12:55:50 +0000 UTC

Very good point I will update it in 1 hour hopefully

Furkan Gözükara

2024-09-15 12:55:23 +0000 UTC

Hi, PyTorch 2.4.1 Release, bug fix release is out almost 2 weeks and should prevent the need to download libomp140.x86_64.dll from some shady website. Maybe you should update your installer scripts? The latest Joy Caption V15 installer still points to PyTorch 2.4.0. Thanks!

Jason Dawn

2024-09-15 10:14:14 +0000 UTC

I feel so lazy as I am the only one looking for the one click update ;-)

Tobe2d

2024-09-15 09:37:43 +0000 UTC

Thanks a lot. They are working okay. I've tried testing the prefix and suffix and the new "don't save image" checkbox (and prefix with the batch option).

cool1

2024-09-15 09:12:16 +0000 UTC

Thanks for the update. I''ve tested the precaption and that works okay and test the "don't save processed image" and that seems working okay too, thanks.

cool1

2024-09-15 09:05:06 +0000 UTC

i checked and gradio still doesn't have folder selection. Opened an issue here : https://github.com/gradio-app/gradio/issues/9354 also the features you wanted added let me know if they are good

Furkan Gözükara

2024-09-15 01:58:53 +0000 UTC

ye i think that is extra added script huge work. but will checkout if newer gradio has that

Furkan Gözükara

2024-09-14 17:04:10 +0000 UTC

Thanks a lot. I've seen buttons for folder selection on the Kohya SS screen but maybe they did extra things and it wasn't a standard gradio thing.

cool1

2024-09-14 16:59:03 +0000 UTC

i think gradio doesnt have such folder picking itself will look into. but other previous 2 things i am adding. if you dont provide output folder it will save into input folder , or provide same for both should work

Furkan Gözükara

2024-09-14 16:55:04 +0000 UTC

Just a suggestion if it wasn't too much trouble to do. In the JoyCaption UI screen, where it says "Input Folder for Batch Processing" and "Output Folder for Batch Processing (Optional)". If they're long paths it would make it easier if you could click to select the folder paths within the UI (without entering them as text), and have an option to make the output folder the same as the input folder that you selected. Sorry if I've made too many suggestions though.

cool1

2024-09-14 16:53:31 +0000 UTC

ok adding that too

Furkan Gözükara

2024-09-14 12:14:16 +0000 UTC

Thanks a lot. Also when it generates the caption it also saves the image (and for single captions it saves it to the current drive with no set-up for where to put them if you wanted it changed). You might not always need it to save the image. Maybe a checkbox could be added for whether to save the image(s), as you might already have the images at a size you want to use for training.

cool1

2024-09-14 12:12:11 +0000 UTC

sure i will add suffix and prefix option now it is rather easy

Furkan Gözükara

2024-09-14 11:59:07 +0000 UTC

Okay thanks. I'll download that too. I assume I'd then create the batch of captions using the JoyCaption UI, then use that other UI to add the prefix to each one. That should do it. Though if the prefix option was also in the Joycaption UI it would save using two stages/apps for that (it could be done all in one go, a bit like BLIP caption option in Kohya except better, since with BLIP captions the captions aren't as good I think, and I only get about a sentence from that but Joycaption ones (from a demo I used) seem much more in-depth (even though they can be inaccurate). It's still downloading the shards for Joycaption UI so I haven't tested it locally properly yet.

cool1

2024-09-14 11:56:40 +0000 UTC

i have another app to do that works great check this out : https://www.patreon.com/posts/108992085

Furkan Gözükara

2024-09-14 11:47:40 +0000 UTC

In the video I didn't see a "caption prefix". BLIP captioning in Kohya has a caption prefix and suffix option, eg. if all the images in the folder are the same person you could put "a photo of [person name]" in the prefix. That will allow it to be more specific. If there's not that option could one be added please?

cool1

2024-09-14 10:11:58 +0000 UTC

i need more info. like your RAM VRAM python version CMD output , VRAM usage before trying it

Furkan Gözükara

2024-09-11 23:11:25 +0000 UTC

I attempted to make captions using JoyCaption v13 - but after the shards file is downloaded - my system just hangs?!

Torcello

2024-09-11 12:37:31 +0000 UTC

you are welcome

Furkan Gözükara

2024-09-10 22:08:41 +0000 UTC

Ok, thanks.

Koudkunstje

2024-09-10 13:52:27 +0000 UTC

i have 1 click solution for this here : https://www.patreon.com/posts/108992085

Furkan Gözükara

2024-09-09 21:53:30 +0000 UTC

You know what would be a nice feature? If you could replace certain words by 'your_secret_token'. Lets say you train on a hat, then you could replace 'hat', 'cap', 'head wear', into 'your_secret_token' in the generated caption.or place 'your_secret_token' in front or after the captioning text (if you train for styles or something like that). Yes i can do that with notepad++, but it would be awesome if it could be done in a one click solution.

Koudkunstje

2024-09-09 17:31:59 +0000 UTC

Any example of that? Because I couldn't find how to do

Furkan Gözükara

2024-09-06 18:44:09 +0000 UTC

Thank you very much for this tool. Could you please add a text input that allows you to customize the default captioning-prompt (Variable: VLM_PROMPT)?

Andre Bopp

2024-09-06 18:25:41 +0000 UTC

kohya doesn't care just read what you write and use it :) the model itself tokenizes caption

Furkan Gözükara

2024-09-05 16:39:43 +0000 UTC

I know you said you use this for training and use verbose tagging now. I might have missed it but how does koyha deal with periods Vs commas?

Steve

2024-09-05 16:35:46 +0000 UTC

thank you so much good explanation. I am going to put your answer into post

Furkan Gözükara

2024-09-02 10:37:49 +0000 UTC

Prompt padding basically adds empty tokens to the end of your prompt so if there is a discrepancy with the tokenizer you have a buffer and can absorb those additional tokens without cutting off your prompt. Truncation (I believe, I'm fairly sure this is equivalent to 'trim') is where if you run out of response tokens in the middle of a generation, the incomplete sentence is deleted from the response before it is delivered to you. No unfinished thoughts, basically. Special tokens are mostly for the llm itself and response debugging, in that they are instructive short hand for its regular operations like, 'begin your response' or 'stop responding'. There is zero need for any of these settings to be fiddled with in this captioning use-case.

Mark Fenlon

2024-09-02 09:48:23 +0000 UTC

good question but i also couldn't find any way of this yet. it is fine tuned and not taking custom token. however you can use caption editor tool i have explained in this video : https://youtu.be/nySGu12Y05k 23:54 Image caption editor for manual caption editing 24:53 Batch edit options in the caption editor

Furkan Gözükara

2024-08-29 17:40:10 +0000 UTC

Any idea on how to add a custom token into the caption? (ie - woman vs wife woman)

Ron Harris-White II

2024-08-29 17:31:19 +0000 UTC

true but there is no explanation of them so i also don't know exactly. i know only as much as LLMs explaining. those are expert settings :)

Furkan Gözükara

2024-08-29 03:55:45 +0000 UTC

can you explain in more details what you mean?

Furkan Gözükara

2024-08-29 03:55:10 +0000 UTC

You should create a readme with an explanation of what all the options do. Specifically "padding, truncation, and add special tokens", the rest are pretty self explanatory. Hover over tooltips would be even better.

juggzz143

2024-08-28 17:21:03 +0000 UTC

Is it possible to amend the LLM caption prompt?

Everett Sohn

2024-08-28 16:10:01 +0000 UTC

i really need to see example of this can you message me from discord and show example?

Furkan Gözükara

2024-08-28 11:19:40 +0000 UTC

ah sure you can send me modified file and i can update. so people who need can use

Furkan Gözükara

2024-08-28 11:01:03 +0000 UTC

I have added the arguments --host and --port. Talk me if you want it and I'll share to you

agustin perez

2024-08-28 08:50:22 +0000 UTC

hi! I'm trying to change the host with an argument in Windows_Start_App.bat. Do you know what's the correct argument?

agustin perez

2024-08-28 07:03:27 +0000 UTC

Hello, I will try to explain in more detail: When you upload the generated images to photostocks, you need to assign tags to them so that other users can easily find your work on the site. If you have a lot of generated images, typing tags manually may not be very convenient. The artificial intelligence built into photo stocks doesn't always suggest the right tags, so you have to edit them. I don't really want to use paid services One option is to write tags for each image in the CSV file and upload this file to the photo sheet. This saves you from having to add tags on different photo stocks every time. However, this approach makes sense if the tags in the CSV file were automatically generated. Each photo stock has its own templates for filling in CSV files, so it is advisable to be able to customize the file filling templates. Is it possible to set up an AI that writes a description for images so that it automatically generated tags and writes them to a CSV file using the specified template?

Dmitry

2024-08-28 06:07:47 +0000 UTC

i don't know at the moment but sounds to me doable. did you try? currently super busy

Furkan Gözükara

2024-08-27 21:09:21 +0000 UTC

Would it be possible to be able to load other LLMs? Like Mistral Nemo or other finetuned models?

Nikolaj Sørensen

2024-08-27 17:10:59 +0000 UTC

i understand you but there is no information about them. these how this is how open source models usually published. they dont document or care. those options werent even put into gradio :)

Furkan Gözükara

2024-08-27 15:44:14 +0000 UTC

Really? You're telling us to ask chatgpt for answers? How about a little tooltip next to the section heading?

Fossil Bluff

2024-08-27 14:53:47 +0000 UTC

i need more details i didn't understand your request

Furkan Gözükara

2024-08-27 10:06:49 +0000 UTC

Hello, could you add the ability to additionally get tags to photos based on the received promt or image with saving to a csv file according to a given template?

Dmitry

2024-08-27 06:07:16 +0000 UTC

when training a person dont use captions just use ohwx man or ohwx woman

Furkan Gözükara

2024-08-26 18:26:54 +0000 UTC

Ok, Is that necessary to train a person? Ohr more less and specific?

puk

2024-08-26 18:21:55 +0000 UTC

flux supports up to 512 by default. it is up to you. i think 300 is good detailed

Furkan Gözükara

2024-08-26 17:41:47 +0000 UTC

THX it works, but how many tokens i can use for training? More than 75? The default setting in your app is 300. And make it sens to insert the trigger word in the textfile

puk

2024-08-26 16:47:09 +0000 UTC

yes flux is different. i find detailed caption better

Furkan Gözükara

2024-08-26 12:22:13 +0000 UTC

Thanks for the app i will try it out, but i have a question: for a sdxllora training we have always done short captions with WD14 captioning. Is it different with Flux? Does WD14 captioning make no sense here, but rather a full description of the image for the training? I made a test Lora with Civit AI and used WD14 captioning there. I found the result good, will it be better with a detailed description?

puk

2024-08-26 11:54:13 +0000 UTC

this should be fixed now with v11

Furkan Gözükara

2024-08-26 03:10:16 +0000 UTC

added ty for support

Furkan Gözükara

2024-08-26 03:09:50 +0000 UTC

solution for this added to the post : Who has fbgemm.dll error on Windows 11 the solutions posted below topic https://github.com/Acly/krita-ai-diffusion/issues/965 Quick solution is as below (verified DLL) Download this dll and copy it to your /windows/system32 folder. https://www.dllme.com/dll/files/libomp140_x86_64/00637fe34a6043031c9ae4c6cf0a891d/download

Furkan Gözükara

2024-08-26 03:09:43 +0000 UTC

well max new tokens lets you get more output but it starts to hallucinate. for others ask chatgpt more info :D

Furkan Gözükara

2024-08-25 16:30:15 +0000 UTC

Traceback (most recent call last): File "E:\Joy_Caption_v9\app.py", line 3, in from torch import nn File "E:\Joy_Caption_v9\venv\lib\site-packages\torch\__init__. py", line 148, in raise err OSError: [WinError 126] The specified module cannot be found. Error loading "E:\Joy_Caption_v9\venv\lib\site-packages\torch\lib\fbgemm.dll" or one of its dependencies.

楠 陈

2024-08-25 14:50:12 +0000 UTC

Would be nice if the description fits the max token size and doesn't cut of half way the description.

Koudkunstje

2024-08-25 09:43:25 +0000 UTC

Thanks for quick update~ Can you explain the usage of "Max New Tokens, Do Sample, Top K, Temperature, Padding, Truncation, Add Special Tokens"?

Sugar Coat VFX Design

2024-08-25 08:37:07 +0000 UTC

it should work on windows too but your error doesnt indicate the error reason.

Furkan Gözükara

2024-08-23 14:34:28 +0000 UTC

It does work on runpod!

Thomas

2024-08-23 14:09:05 +0000 UTC

i used on runpod works perfect. runpod installer already included try it

Furkan Gözükara

2024-08-23 13:36:32 +0000 UTC

same. I'll wait for V3 or test on RunPod then

Thomas

2024-08-23 13:00:21 +0000 UTC

this looks like browser related error. try with google chrome, try in private window, try with restart computer

Furkan Gözükara

2024-08-23 12:48:40 +0000 UTC

please refresh page and download v2

Furkan Gözükara

2024-08-23 12:47:47 +0000 UTC

ERROR: Exception in ASGI application Traceback (most recent call last): File "C:\Users\thomas\Downloads\Joy_Caption_v2\venv\lib\site-packages\uvicorn\protocols\http\h11_impl.py", line 406, in run_asgi result = await app( # type: ignore[func-returns-value] File "C:\Users\thomas\Downloads\Joy_Caption_v2\venv\lib\site-packages\uvicorn\middleware\proxy_headers.py", line 70, in __call__ return await self.app(scope, receive, send) File "C:\Users\thomas\Downloads\Joy_Caption_v2\venv\lib\site-packages\fastapi\applications.py", line 1054, in __call__ await super().__call__(scope, receive, send) File "C:\Users\thomas\Downloads\Joy_Caption_v2\venv\lib\site-packages\starlette\applications.py", line 123, in __call__ await self.middleware_stack(scope, receive, send) File "C:\Users\thomas\Downloads\Joy_Caption_v2\venv\lib\site-packages\starlette\middleware\errors.py", line 186, in __call__ raise exc File "C:\Users\thomas\Downloads\Joy_Caption_v2\venv\lib\site-packages\starlette\middleware\errors.py", line 164, in __call__ await self.app(scope, receive, _send) File "C:\Users\thomas\Downloads\Joy_Caption_v2\venv\lib\site-packages\gradio\route_utils.py", line 760, in __call__ await self.app(scope, receive, send) File "C:\Users\thomas\Downloads\Joy_Caption_v2\venv\lib\site-packages\starlette\middleware\exceptions.py", line 65, in __call__ await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send) File "C:\Users\thomas\Downloads\Joy_Caption_v2\venv\lib\site-packages\starlette\_exception_handler.py", line 64, in wrapped_app raise exc File "C:\Users\thomas\Downloads\Joy_Caption_v2\venv\lib\site-packages\starlette\_exception_handler.py", line 53, in wrapped_app await app(scope, receive, sender) File "C:\Users\thomas\Downloads\Joy_Caption_v2\venv\lib\site-packages\starlette\routing.py", line 754, in __call__ await self.middleware_stack(scope, receive, send) File "C:\Users\thomas\Downloads\Joy_Caption_v2\venv\lib\site-packages\starlette\routing.py", line 774, in app await route.handle(scope, receive, send) File "C:\Users\thomas\Downloads\Joy_Caption_v2\venv\lib\site-packages\starlette\routing.py", line 295, in handle await self.app(scope, receive, send) File "C:\Users\thomas\Downloads\Joy_Caption_v2\venv\lib\site-packages\starlette\routing.py", line 77, in app await wrap_app_handling_exceptions(app, request)(scope, receive, send) File "C:\Users\thomas\Downloads\Joy_Caption_v2\venv\lib\site-packages\starlette\_exception_handler.py", line 64, in wrapped_app raise exc File "C:\Users\thomas\Downloads\Joy_Caption_v2\venv\lib\site-packages\starlette\_exception_handler.py", line 53, in wrapped_app await app(scope, receive, sender) File "C:\Users\thomas\Downloads\Joy_Caption_v2\venv\lib\site-packages\starlette\routing.py", line 75, in app await response(scope, receive, send) File "C:\Users\thomas\Downloads\Joy_Caption_v2\venv\lib\site-packages\starlette\responses.py", line 348, in __call__ await send( File "C:\Users\thomas\Downloads\Joy_Caption_v2\venv\lib\site-packages\starlette\_exception_handler.py", line 50, in sender await send(message) File "C:\Users\thomas\Downloads\Joy_Caption_v2\venv\lib\site-packages\starlette\_exception_handler.py", line 50, in sender await send(message) File "C:\Users\thomas\Downloads\Joy_Caption_v2\venv\lib\site-packages\starlette\middleware\errors.py", line 161, in _send await send(message) File "C:\Users\thomas\Downloads\Joy_Caption_v2\venv\lib\site-packages\uvicorn\protocols\http\h11_impl.py", line 510, in send output = self.conn.send(event=h11.EndOfMessage()) File "C:\Users\thomas\Downloads\Joy_Caption_v2\venv\lib\site-packages\h11\_connection.py", line 512, in send data_list = self.send_with_data_passthrough(event) File "C:\Users\thomas\Downloads\Joy_Caption_v2\venv\lib\site-packages\h11\_connection.py", line 545, in send_with_data_passthrough writer(event, data_list.append) File "C:\Users\thomas\Downloads\Joy_Caption_v2\venv\lib\site-packages\h11\_writers.py", line 67, in __call__ self.send_eom(event.headers, write) File "C:\Users\thomas\Downloads\Joy_Caption_v2\venv\lib\site-packages\h11\_writers.py", line 96, in send_eom raise LocalProtocolError("Too little data for declared Content-Length") h11._util.LocalProtocolError: Too little data for declared Content-Length

Thomas

2024-08-23 12:29:53 +0000 UTC

after completely deleting v1 and installing v2. No error during installing, but after starting if I load an image I get :

Thomas

2024-08-23 12:29:36 +0000 UTC

the Joy_Caption_v1.zip gives Attachment with id 20240035 was not found when trying to download

eyal giron

2024-08-23 12:24:41 +0000 UTC

what do you see on cmd? could be loading model. did you get any error while installing?

Furkan Gözükara

2024-08-23 12:20:39 +0000 UTC

Batch processing still doesn't work for me, even after reinstalling v2. When I click, nothing happens. And if I try to caption a single image I get "Tensor on device cuda:0 is not on the expected device meta!" although it worked fine on v1. I will try to delete completely the folder and models and reinstall.

Thomas

2024-08-23 12:18:53 +0000 UTC

updated v2 and batch processing error fixed. please overwrite previous app.py file

Furkan Gözükara

2024-08-23 11:27:10 +0000 UTC

ye i am about to fix it few minutes please

Furkan Gözükara

2024-08-23 11:15:34 +0000 UTC

I keep getting this error: raise ValueError("Unable to infer channel dimension format") ValueError: Unable to infer channel dimension format

Diggy Dre

2024-08-23 11:14:25 +0000 UTC

Related Creators

Dasteiza

Dasteiza

 patreon
larru

larru

 patreon
Goddess Cynthia

Goddess Cynthia

 patreon
ぺんたぱんだ

ぺんたぱんだ

 fanbox
Garvan

Garvan

 patreon
Sunset Rayline

Sunset Rayline

patreon
jexmo0np

jexmo0np

 fanbox
BeanShaped

BeanShaped

 patreon
いおばーど

いおばーど

 fanbox
panpanstuffedbelly

panpanstuffedbelly

 patreon
NelBayasi

NelBayasi

 fanbox
TheKTwins

TheKTwins

 patreon
Rougenine

Rougenine

 patreon
ZingSims

ZingSims

 patreon
Karolina Smi

Karolina Smi

 patreon
Ө𝔐Σ𝔊Λ's tracklab

Ө𝔐Σ𝔊Λ's tracklab

 gumroad
strangeredguy

strangeredguy

 patreon
criischan

criischan

 patreon
Madei

Madei

 fanbox
bedlamgames

bedlamgames

 patreon
chocoraptor

chocoraptor

 patreon
GoldenTar

GoldenTar

 patreon
Justin Oaksford

Justin Oaksford

 gumroad
Shady Deals

Shady Deals

 patreon
SquashedFlat

SquashedFlat

 patreon
Reddblush

Reddblush

 gumroad
ハチクマ

ハチクマ

 fanbox
markydaysaid

markydaysaid

 patreon
SnakeKing

SnakeKing

 patreon
骨突き肉

骨突き肉

 fanbox
cattower

cattower

 fanbox
YUNUKOPI

YUNUKOPI

 patreon
3:59

3:59

 fanbox
arrowthesparrow

arrowthesparrow

 patreon
tiramisoups

tiramisoups

 patreon
あら丸

あら丸

 fanbox
cruelpastry

cruelpastry

 patreon
drivewithsadaf

drivewithsadaf

 patreon
MrGencyExit64 .

MrGencyExit64 .

 patreon
alicedelish

alicedelish

 patreon
Yuna_K

Yuna_K

 patreon
mnpinny

mnpinny

 patreon
We'll See You In Hell

We'll See You In Hell

 patreon
vincent newman

vincent newman

 fanbox
Howxen

Howxen

 patreon
КОТ

КОТ

 boosty
onyx_uchiha

onyx_uchiha

 patreon
juribdoll

juribdoll

 patreon
おもちぼや

おもちぼや

 fanbox
Lui

Lui

 subscribestar