NokiMo
Aitrepreneur
Aitrepreneur

patreon


1-Click INSTALL LOCAL TEXT GEN WebUI!

Hey everyone! I've created a 1-click installer for the Oobabooga TextGen WebUI 2025 Update, the easiest way to run your favorite UNRESTRICTED open-source LLMs locally for FREE! This version is a massive improvement over the old one, with faster installs, full model compatibility, and a cleaner interface that makes it easier than ever to use.

You can check out the video right here: https://youtu.be/QSJS9YDqf9w

The installer of course automates the entire install process for the webui!

Links for the models:
CYDONIA 24B: bartowski/TheDrummer_Cydonia-24B-v4.1-GGUF · Hugging Face
GPT-OSS-120B: unsloth/gpt-oss-120b-GGUF · Hugging Face
GLM-4.5-355B: unsloth/GLM-4.5-GGUF · Hugging Face
GLM-4.5-Air-106B: unsloth/GLM-4.5-Air-GGUF · Hugging Face


LOCAL INSTALL

Download the TEXT-GEN_WEBUI_INSTALLER.bat

Run the bat file

It will then asks which GPU you got, most of you will choose A for Nvidia, since other GPUs are only really compatible on Linux (like AMD) press enter

Wait for the install to finish

The webui will launch, or hold ctrl then left click on the local url and there you go😎


IF YOU ARE USING RUNPOD :

Create an account if you haven't already: Runpod

Click on Pod (on the left side) then click deploy

Choose a GPU OR GPUs, depending on what you are looking for, chose the pytorch 2.8.0, then edit the template and choose min 300gb for both the container and volume disk, add the 7860 port and then deploy on demand

Go to my pods, wait for everything to finish and then click "connect", then "Connect to HTTP SERVICE port 8888" and drag and drop the TEXT-GEN_WEBUI_INSTALL-RUNPOD.sh file on the left side of the UI then click on the "Terminal" icon on the right side on the UI

Copy and paste these two lines then press enter:

chmod +x TEXT-GEN_WEBUI_INSTALL-RUNPOD.sh

./TEXT-GEN_WEBUI_INSTALL-RUNPOD.sh start

Choose if you want to put a username and password
Wait for everything to be installed

Go to the port 7860 and there you go 😎


IF YOU PAUSE THE POD THEN RESTART IT AND YOU WANT TO RESTART THE WEBUI:

click on the terminal icon and there type:

./start_linux.sh --listen --listen-host 0.0.0.0 --listen-port 7860 --gradio-auth user:pass

where user:pass is your username and password



IF YOU NEED TO DOWNLOAD A BIG MODEL

Go inside the text generation webui folder, drag and drop the MODEL_DOWNLOADER-RUNPOD.sh file on the left side of the UI then click on the "Terminal" icon on the right side on the UI

Copy and paste these two lines then press enter:

chmod +x MODEL_DOWNLOADER-RUNPOD.sh

./MODEL_DOWNLOADER-RUNPOD.sh

It will then ask you to paste the url of the model from huggingface and once you do, press enter and it will dl quickly all the model files.

As always, supporting me on Patreon allows me to keep creating helpful resources like this for the community. Thank you for your support - now go have some fun😉!
PS: Sorry again for the lack of communication, those who know, knows ❤️

1-Click INSTALL LOCAL TEXT GEN WebUI!

Comments

Got this error at the end: ******************************************************************* * You haven't downloaded any model yet. * Once the web UI launches, head over to the "Model" tab and download one. ******************************************************************* bash: -c: line 1: syntax error near unexpected token `)' bash: -c: line 1: `. "/workspace/text-generation-webui/installer_files/conda/etc/profile.d/conda.sh" && conda activate "/workspace/

William

The same thing happens to me. Did you find out how to fix it?

Colliebii

when i click the bat it opens then closes straight away

neil

When using one click installer I am getting this error: line 9, in import yaml ModuleNotFoundError: No module named 'yaml'

Lance Fanger

what updates are you talking about?

Aitrepreneur

I had that too, you can create a new conda env and then activate it sowhere in some folder. you can use these commands for example: conda create -n myenv conda activate myenv it should then give you the possibility to accept the tos, then you can relaunch the installer

Aitrepreneur

Will there be updates to this? If so will they be posted here or on Hugging Face?

Teresa Greasley

How does one accept the conta tos and eula when using the 1-click bat file?

Kodaijin Starfall

Anyone have suggestions on models to use? I'm trying the TheDrummer_Cydonia-24B-v4.1-Q6_K_L.gguf and it works well enough, but it seems *really* chatty. I'll ask a 3 word question and I get multiple paragraphs in response.

Hrothgar's Hoard

Thank you for the video.

J


Related Creators