Solving CUDA and C++ Tools Compiling Errors Once and For All for Python AI Applications

If you are using AI applications and installed software like InsightFace, XPose which you need to compile on your PC, you know that accurate CUDA and C++ tools is a nightmare. This post will help you to understand the fundamental concepts and fix your issues.

========

Patreon exclusive posts index to find our scripts easily, Patreon scripts updates history to see which updates arrived to which scripts and amazing Patreon special generative scripts list that you can use in any of your task.

Join discord to get help, chat, discuss and also tell me your discord username to get your special rank : SECourses Discord

Please also Star, Watch and Fork our Stable Diffusion & Generative AI  GitHub repository and join our Reddit subreddit and follow me on LinkedIn (my real profile)

========

3 September 2025 Fully Updated and Migrated Into Torch 2.8 and CUDA 12.9

• Now we are moving to Torch 2.8 and CUDA 12.9.1 for all GPUs starting from RTX 1000 series

  • We won't use CUDA 11.8, 12.4 or 12.8 anymore

  • In most cases if you installed these or not won't matter since I will try to compile myself and add compiled versions to installers i made

  • But if you want to compile on your system such as InsightFace, XPose etc it will matter

  • Also for using DeepSpeed library proper installation is still mandatory

• Moreover, we will be moving to cuDNN 9.12.0 and TensorRT 10.13.2 GA

• Install Visual Studio Build Tools first then Visual Studio Community Edition and then CUDA and then Python

Visual Studio Build Tools

• We are moving to v14 latest

• Official Page :

  • https://learn.microsoft.com/en-us/visualstudio/releases/2022/release-history#fixed-version-bootstrappers

• The one we use 17.14.13 :

  • https://download.visualstudio.microsoft.com/download/pr/89ee1303-1ba2-4f66-b07c-5099983fd1e4/a5fcbc55bd633d6c79c9319317a8cb77c70227ce87b70948c27649f7384c2909/vs_BuildTools.exe

• You can uninstall all previous (Visual Studio Build Tools) and install this one if you are upgrading like me

Which checkboxes to check

Visual Studio Community Edition

This is needed as MSVC still some libraries requiring this

Visual Studio Community edition install link : https://visualstudio.microsoft.com/downloads/

Which checkboxes to check - Simply select all except Incredibuild - Build Acceleration

I am using Visual Studio 17.14.13

Next We will add this folder to our system and user path

• C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC

  • Find the latest folder named like 14.44.35207

  • And find this folder \bin\Hostx64\x64

• So full path on my PC

  • C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.44.35207\bin\Hostx64\x64

Here screenshot

• Then add that path to both Environment Variables into System Variables Path and User Variables Path

  • We duplicate everything both in system and user path don't forget

• After click ok and close open a powershell (not cmd) and type below and see if working

• cl

Screenshot of cl result

CUDA Installation

• If you want to uninstall older versions here how

• CUDA 12.9.1 download link for Windows 10 and Windows 11 :

  • https://developer.download.nvidia.com/compute/cuda/12.9.1/local_installers/cuda_12.9.1_576.57_windows.exe

• Alternative Link on Hugging Face

  • https://huggingface.co/MonsterMMORPG/Wan_GGUF/resolve/main/cuda_12.9.1_576.57_windows.exe

• Install selection as below

After installation restart PC

Then open a cmd and type nvcc --version and make sure you see as below

Installing cuDNN

• We are moving to cuDNN 9.12.0

• There is 1 extra path you need to add here don't forget that

• To download it use here https://developer.nvidia.com/cudnn-archive

• Here direct backup on Hugging Face : https://huggingface.co/MonsterMMORPG/Wan_GGUF/resolve/main/cudnn_9.12_cuda_12.9.zip

• We install as default

  • It is installed into here by default : C:\Program Files\NVIDIA\CUDNN

  • Therefore you have to manually add it into both Environment Variables into System Variables Path and User Variables Path

• The folder you need to add to the paths is \bin\12.9 and main folder

  • e.g. C:\Program Files\NVIDIA\CUDNN\v9.12\bin\12.9

  • and C:\Program Files\NVIDIA\CUDNN\v9.12

Extra Path you have to add is CUDNN_PATH

Add it into System Variables directly like below

e.g. : Variable name : CUDNN_PATH

Value : C:\Program Files\NVIDIA\CUDNN\v9.12\bin\12.9

Python 3.10, 3.11, 3.12 and 3.13 Download Links

We are still using Python 3.10.11 as a default since this is the most widely supported and best working version

However, we will install other versions too because if necessary, my automatic installers will generate a VENV (virtual enviroment) with that specific Python version and use it automatically

Don't forget to install as in tutorial video directly into C drive with Python Launcher and don't forget to make Python 3.10.11 added to Environment Variables into System Variables Path and User Variables Path and set as top - check path variables screenshots at the very bottom of the post

• 3.10.11: https://www.python.org/downloads/release/python-31011/

  • https://www.python.org/ftp/python/3.10.11/python-3.10.11-amd64.exe

• 3.11.9 : https://www.python.org/downloads/release/python-3119/

  • https://www.python.org/ftp/python/3.11.9/python-3.11.9-amd64.exe

• 3.12.10 : https://www.python.org/downloads/release/python-31210/

  • https://www.python.org/ftp/python/3.12.10/python-3.12.10-amd64.exe

• 3.13.17 (this is the worst one right now least supported) : https://www.python.org/downloads/release/python-3137/

  • https://www.python.org/ftp/python/3.13.7/python-3.13.7-amd64.exe

FFmpeg Installation

• https://github.com/BtbN/FFmpeg-Builds/releases

  • Use this specific version for now to not have any issues :

    • Windows : https://huggingface.co/MonsterMMORPG/Wan_GGUF/resolve/main/ffmpeg-N-121105-ga0936b9769-win64-gpl.zip

    • Linux : https://huggingface.co/MonsterMMORPG/Wan_GGUF/resolve/main/ffmpeg-N-121105-ga0936b9769-linux64-gpl.tar.xz

• Extract exe files into C:\ffmpeg_latest

• Add C:\ffmpeg_latest into your both Environment Variables into System Variables Path and User Variables Path

• Then open a CMD and type ffmpeg and see like below

Git Installation

• Download link : https://git-scm.com/downloads

• Download and install just with next next next

• After installing add these 2 folder into your both Environment Variables into System Variables Path and User Variables Path

• C:\Program Files\Git\cmd

• C:\Program Files\Git\bin

Virtual RAM Setup

• You must setup at least 100 GB virtual RAM on your fastest drive

• Tutorial Windows 10 : https://www.windowscentral.com/how-change-virtual-memory-size-windows-10

• Tutorial Windows 11 : https://www.windowscentral.com/software-apps/windows-11/how-to-manage-virtual-memory-on-windows-11

• This is super important since when loading an AI model initially, virtual RAM may be used

TensorRT Installation

• In some cases TensorRT is necessary therefore we will also download and install it

• Download link : https://developer.nvidia.com/tensorrt/download

• It requires a free NVIDIA account

• We are using TensorRT 10.13.2 GA

• Direct link : https://developer.nvidia.com/downloads/compute/machine-learning/tensorrt/10.13.2/zip/TensorRT-10.13.2.6.Windows.win10.cuda-12.9.zip

• Alternative link on Hugging Face : https://huggingface.co/MonsterMMORPG/Wan_GGUF/resolve/main/TensorRT-10.13.2.6.Windows.win10.cuda-12.9.zip?download=true

• Extract the zip file into C drive like C:\TensorRT_10_13_2_6 and enter inside \lib

• You must see nvinfer_10.dll and such files

• Now add this path C:\TensorRT_10_13_2_6\lib and this path C:\TensorRT_10_13_2_6 into your both Environment Variables into System Variables Path and User Variables Path

Enable Windows Long Paths

• Full article here : https://learn.microsoft.com/en-us/windows/win32/fileio/maximum-file-path-limitation?tabs=registry#enable-long-paths-in-windows-10-version-1607-and-later

• Reg file just download and run : Enable_Windows_Long_Paths.reg

NodeJS Installation

• Also install NodeJS 22.20 since some apps need it like Ostris

• When installing install all as default / next no changes

• Download link : https://nodejs.org/en/download

• Direct link : https://nodejs.org/dist/v22.20.0/node-v22.20.0-x64.msi

Fixing Triton Related Errors

• If you get Triton related errors we need to delete the Triton cache folder

  • e.g. C:\Users\Furkan\.triton

• So we clear whatever inside C:\Users\Furkan\.triton

• I made a bat file for this so use this zip file, extract anywhere and double click and execute the bat file - don't run any of my bat files as administrators

• Download clear cache zip file : Clear_Triton_Cache.zip

Environment Variables Screenshots - Rememer Top To Bottom Order Matters

Updated 3 September 2025

Main Screen

User Variables

System Variables