Hello world
Added 2021-01-10 10:23:48 +0000 UTCHere goes for the first post.
If you are new to this page and you haven't yet seen the main showcase video, I'd recommend watching this video to get a quick overview of what I am working on:
https://www.youtube.com/watch?v=xqJ-ujWvu7s
In short, xVASynth is a freely available app making use of AI to generate realistic speech for voice acting, using existing voices from video games (currently Bethesda games only, though this may change in the future).
Though quality is a priority, another is the artistic control over the generated speech, as tone and emphasis is important for getting across the desired effect. xVASynth therefore has a pitch and duration editor, allowing creators to adjust these values on a per-letter basis, giving ultimate control over the generated audio.
Having worked on this since mid 2018 (including research/early experiments/data prep), the initial v1.0 release in 2021 comes with about 34 models covering about 50 voice sets across 6 games. I've set up this Patreon because training these models on my ~5y old hardware is very slow, and the limited VRAM capacity of my GPU means I can't reach the levels of quality I'd like for all models. By helping me out here, you can supplement my student budgeting in saving up for new hardware, which will mean more models, faster, and higher quality.
I will be posting more in-depth updates here on patreon, along with polls for people to vote on, for which voices I work on next.
Outside of Patreon, I have set up a Discord channel where you can chat with myself, other patrons and other people interested in this project: https://discord.gg/nv7c6E2TzV . You can also follow me on Twitter for more general posts at the following handle: @dan_ruta.
The tool and voice models can be downloaded at the following links:
Skyrim: https://www.nexusmods.com/skyrimspecialedition/mods/44184
Fallout 4: https://www.nexusmods.com/fallout4/mods/49340
Fallout 3: https://www.nexusmods.com/fallout3/mods/24502
Fallout NV: https://www.nexusmods.com/newvegas/mods/70815
Oblivion: https://www.nexusmods.com/oblivion/mods/50697
Morrowind: https://www.nexusmods.com/morrowind/mods/49210
