NokiMo
ValemVR
ValemVR

patreon


[EXCLUSIVE] How To Make Chat GPT NPC in Unity - PART 3 - Text to Speech and Lipsync

There it is guys, what we've been waiting for, the last part of the tutorial series on how to make a chat gpt npc in unity.

In this last part we are going to learn how to use Voice To Text, Text to speech and Lip sync to be able to talk to the avatar like we would in a real conversation.

Hope you guys will enjoy this video and down bellow you will find the result project but make sure to add your own Open AI credentials.

Also there is a second scene with VR enable for the VR lovers among you !

Download Result : https://drive.google.com/file/d/1B__ps9ftA9bCKTIXQuEyucU5syHGChk5/view?usp=sharing

Download OVR Lip Sync : https://developer.oculus.com/downloads/package/oculus-lipsync-unity/

Download Meta Voice SDK : https://developer.oculus.com/downloads/package/oculus-voice-sdk/

[EXCLUSIVE] How To Make Chat GPT NPC in Unity - PART 3 - Text to Speech and Lipsync

Comments

I ended up creating an auth.json file in my user directory on my Mac, in a .openai subfolder (per the instructions) and it's working now :)

When I run this project in Unity (after setting up a Wit configuration with server key, etc) I get "API Key is null and auth.json does not exist" error.

Thank you so much for the amazing tutorial! Your content has been such a joy and it is incredibly valuable, what an accomplishment. I was wondering if you could provide some insights on how to change the character without disrupting anything, as you have with your "Old Western" environment using the CC character. I am trying to bring mine in now but want to make sure I don't disrupt the scripts attached to the character exported with the project. Also, I'd like to build in a character selector with different characters options that maintain consistent personalities (so that the personality, voice, and setting descriptions may change when the character skin selected changes). For both of these reasons, I'd appreciate any help understanding of changing the character without disrupting the underlying scripts. Thank you so much again for your amazing content! :)


Related Creators