1-Click INSTALL SillyTavern FOR PHONES - BEST MOBILE ROLEPLAY EXPERIENCE!

For me, the following error appears on Google collab. RuntimeError: Failed to import transformers.models.auto.processing_auto because of the following error (look up to see its traceback): module 'torch.library' has no attribute 'register_fake'

Kennedy Vieira Lopes

The commands aren't working in Terms. Getting 5108 aborted on the storage setup. And no such time of directory on the second line

James IV

Same

Ghostface428

I found the issue, if you have multiple devices on the same network and have the server address the same across the devices then you get the error. Could be wrong though...

Jorge E Ibarra

I keep getting the error "Uncaught exception: Error: listen EADDRINUSE: address already in use 127.0.0.1:8000" Then it stops the process

Jorge E Ibarra

In the google colab, I get this: ImportError: /usr/local/lib/python3.10/dist-packages/flash_attn_2_cuda.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZN3c104cuda9SetDeviceEi

Senjka Danhieux

I am also getting this. after some googling it has something to do with nodeJS version apparently??? but i am not finding a quick solution myself

philip holman

I know nothing about coding but I finally got it to connect with the help of gpt 4

AngwySquid

I've been trying to get the open ai url but this keep showing up In collab what should I do? "ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. google-colab 1.0.0 requires pandas==2.0.3, but you have pandas 2.2.2 which is incompatible. imageio 2.31.6 requires pillow<10.1.0,>=8.3.2, but you have pillow 10.3.0 which is incompatible. tensorflow 2.15.0 requires tensorboard<2.16,>=2.15, but you have tensorboard 2.16.2 which is incompatible. Successfully installed DataProperty-1.0.1 GitPython-3.1.43 Pillow-10.3.0 accelerate-0.27.2 aiofiles-23.2.1 aqlm-1.1.3 auto-gptq-0.6.0+cu121 autoawq-0.2.3 autoawq-kernels-0.0.6 bitsandbytes-0.43.1 colorama-0.4.6 coloredlogs-15.0.1 cramjam-2.8.3 datasets-2.19.0 dill-0.3.8 diskcache-5.6.3 docker-pycreds-0.4.0 einops-0.8.0 exllamav2-0.0.19+cu121 fastapi-0.110.3 fastparquet-2024.2.0 ffmpy-0.3.2 flash-attn-2.5.6 gekko-1.1.1 gitdb-4.0.11 gptq-for-llama-0.1.1+cu121 gradio-4.26.0 gradio-client-0.15.1 h11-0.14.0 hqq-0.1.5 httpcore-1.0.5 httpx-0.27.0 huggingface-hub-0.22.2 humanfriendly-10.0 jinja2-3.1.2 jsonlines-4.0.0 llama-cpp-python-0.2.64 llvmlite-0.42.0 lm_eval-0.3.0 mbstrdecoder-1.1.3 multiprocess-0.70.16 ninja-1.11.1.1 numba-0.59.1 numpy-1.26.4 nvidia-cublas-cu12-12.1.3.1 nvidia-cuda-cupti-cu12-12.1.105 nvidia-cuda-nvrtc-cu12-12.1.105 nvidia-cuda-runtime-cu12-12.1.105 nvidia-cudnn-cu12-8.9.2.26 nvidia-cufft-cu12-11.0.2.54 nvidia-curand-cu12-10.3.2.106 nvidia-cusolver-cu12-11.4.5.107 nvidia-cusparse-cu12-12.1.0.106 nvidia-nccl-cu12-2.19.3 nvidia-nvjitlink-cu12-12.4.127 nvidia-nvtx-cu12-12.1.105 openai-1.24.0 optimum-1.17.1 orjson-3.10.1 pandas-2.2.2 pathvalidate-3.2.0 peft-0.8.2 portalocker-2.8.2 psutil-5.9.8 pybind11-2.12.0 pycountry-23.12.11 pydub-0.25.1 pytablewriter-1.2.0 python-multipart-0.0.9 rouge-1.0.1 rouge-score-0.1.2 ruff-0.4.2 sacrebleu-1.5.0 scipy-1.13.0 semantic-version-2.10.0 sentencepiece-0.2.0 sentry-sdk-2.0.1 setproctitle-1.3.3 shellingham-1.5.4 smmap-5.0.1 sqlitedict-2.1.0 tabledata-1.3.3 tcolorpy-0.1.6 tensorboard-2.16.2 timm-0.9.16 tomlkit-0.12.0 tqdm-multiprocess-0.0.11 transformers-4.40.1 typepy-1.3.2 uvicorn-0.29.0 wandb-0.16.6 websockets-11.0.3 xxhash-3.4.1 zstandard-0.22.0 WARNING: The following packages were previously imported in this runtime: [PIL,psutil] You must restart the runtime in order to use newly installed versions."

AngwySquid

Could not get to work. Over and over, "could not extract reply in 5 attempts " on silly tavern

P

Hey Aitrepreneur, can you check the Google doc to see if it's still working? Wondering if they did another update, thanks as always!

Jon

How do I run the XTTS.bat file when I don't have a GPU? I have colab pro with me, is there a way to create and API link, can you guide??

Akshay

a100 but it won't matter unless you are using a super big model though

Aitrepreneur

If you pay for Google colab what's the best gpu for bigger models, T4, A100, or V100? Or should I just stick with the t4 suggestion from the video, also will enabling high ram help? thanks

Jon

yes, just go to the session tab, and enable openai and public url checkbox, apply the changes and it will then give you a long public url to connect it to sillytavern

Aitrepreneur

Instead of using a Google Colab, can I just set my home desktop's OOBABOOGA up to be accessible anywhere from my phone with an API? Do you have a tutorial on that?

Ryan Clancy

Anyone get the "could not extract reply in 5 attempts" error in ST? From what im seeing its a nodejs update issue, but that can't be updated within Termux until they rollout a package update.. thoughts? If it's currently running for anyone else then I'm doing something wrong

Jon

that's...a weird behaviour O_o but thanks for the info

Aitrepreneur

For those who also have problems running the termux-setup-storage command: I have run the CMD "apt update" as recommended. However, I got an error message that the source is not signed. Solution for me: When I try to access the website (specified in the code) where the updates should be pulled, I am redirected to a, for whatever reason, ring advertising page. Therefore no update can be pulled from the source. The solution is to select a mirror as recommended. For this: termux-change-repo //select any Mirror in the menu Then execute the commands again. Now it should be able to pull the updates and work. apt update apt upgrade pkg update pkg upgrade (Write Y for each request) You should not get any error messages now. After that: termux-setup-storage (No output = no error) cd ~/storage/shared/AI Now everything should work... at least for me now. Hope I could help you.

Yes can just activate the public url in the session tab in the text gen webui and use that url inside sillytavern on your phone

Aitrepreneur

is it somehow possible to use my pc as the server and use the sillytavern UI on my phone connected to the same network ?

Kubilay göze

I'm getting the following error when trying g to enter the first command after installing termux.: Report issues at https://termux.com/issues ~ $ termux-setup-storage /data/data/com.termux/files/usr/bin/termux-setup-storage: line 29: 29934 Aborted am broadcast --user 0 --es com.termux.app.reload_style storage -a com.termux.app.reload_style com.termux > /dev/null

Peter Bernaiche

fixed it by downloading the files on my pc, sending it to my phone

same issues. do not load, just errors on both

you can, all your chats should be saved in the backups folder

Aitrepreneur

Can i transfer my progress when i finally get gpu ?

Nabil Boulezaz

Both silly.sh and launchsilly.sh link to their filenames not their URLs.

BP

Errors are: failed to fetch and the repository is not signed

I figured it already out with the permission in Android 14 but still getting failures when trying following the steps. Got any ideas? It says the same for installing termux-am as for the silly tavern package... verification errors and because of it no installation is possible. I granted termux any rights and allowed unsafe installations. Nothing helped.

Both chrome and edge on a Samsung fold say "This site can’t be reachedCheck if there is a typo in launchsilly.sh. DNS_PROBE_FINISHED_NXDOMAIN" and fail.

Then try using chrome or edge

Aitrepreneur

I just tried downloading on my phone via Firefox browser and it said download failed. Tapped and long pressed, both failed

BP

not really, except either using a Google colab doc or running SD on a pc then connecting to the url with your phone.

Aitrepreneur

Can we use stable diffusion on Android?

Nabil Boulezaz

That's fair just thought it might make an interesting video. Or maybe not just RDP into the desktop. Wasn't sure if there was a good solution. Do you know if the characters/roleplays you have can be carried over/ported to your mobile device or would you have to start over or export/import your current roleplay?

Ma No

you can do that but it's not as interesting since first, you need a computer always running while this allows you to be anywhere you want and as long as you have internet connection, it will work as is

Aitrepreneur

Interesting Youtube comment advised setting the AI up on your computer and Remoting in to the desktop. Might be something worth of exploring for a video.

Ma No

What is the issue?

Aitrepreneur

These files should be downloaded without any issues, just tried it

Aitrepreneur

If you are on Android 14, you also need to go into the app permissions for Termux and give it full file access. After I did that, the pkg install line worked, which then allowed the storage command to run.

Zolon Farsane

fix: Run pkg install termux-am.

Zolon Farsane

termux-setup-storage - /data/data/com.termux/files/usr/bin/termux-setup-storage : line 24: 17694 Aborted

Zolon Farsane

Couldn't get this to work on Google Pixel 8 Pro android phone, doesn't seem to play nice with the linux terminal app

both launchsilly.sh and silly.sh sites can't be reached error?

If anyone has tried to manual install this using iPhone pls let me know