NokiMo
Innovate Futures @ Benji
Innovate Futures @ Benji

patreon


AudioX AI - This AI Model Generate Anything-to-Audio Locally And Free!

Video : https://youtu.be/u9p-NceZzmI

AudioX AI - Diffusion Transformer for Anything-to-Audio Generation

Unlock the power of AudioX by HKUST—the AI tool that generates ANY sound or music from text, video, or images! In this video, we dive into its text-to-audio, video-to-music, and cinematic sound effect features, comparing it to MM Audio and showcasing real demos. Learn how to create perfectly synced background music, engine roars, and ambient rain for your AI videos—all locally via GitHub or Hugging Face. Plus, see step-by-step setups for AI video integrations and pro tips for soundtrack customization!

Who Is This For?

Video creators needing custom soundtracks and effects for AI content.

Filmmakers and editors streamlining audio-video synchronization.

Tech enthusiasts exploring cutting-edge AI tools.

Musicians and sound designers experimenting with text-to-music generation.

Why It Matters:

AudioX eliminates the hassle of manual sound design, offering AI-driven precision for ads, films, and storytelling. Its ability to match audio to video context and generate from simple prompts makes it a must-have for creators.

Links:

https://zeyuet.github.io/AudioX/

https://github.com/ZeyueT/AudioX

https://huggingface.co/HKUSTAudio/AudioX/tree/main

https://www.anaconda.com/docs/getting-started/miniconda/main

Installation Command Prompts:

--------------------------------------------------------

- git clone https://github.com/ZeyueT/AudioX.git

- cd AudioX

- conda create -n AudioX python=3.8.20

- conda activate AudioX

- pip install --force-reinstall torch torchvision torchaudio xformers --extra-index-url https://download.pytorch.org/whl/cu124

- pip install git+https://github.com/ZeyueT/AudioX.git

- conda install -c conda-forge ffmpeg libsndfile

- python run_gradio.py --model-config model/config.json --share

--------------------------------------------------------

Comments

I would like a Workflow, that could create a music video of a MP3. But this is also nice.

Killy_Blame


Related Creators