Please refer to the official NVIDIA installation guide
The instructions below worked for us, but different versions may be required for your system
Install GCC compiler & other tools:
sudo apt update
sudo apt install build-essential
sudo apt-get install software-properties-commonAdd the following two package sources to /etc/apt/sources.list and then update apt:
deb http://deb.debian.org/debian/ bullseye main contrib non-free
deb-src http://deb.debian.org/debian/ bullseye main contrib non-free
sudo apt-get update
sudo apt updateInstall nvidia toolkit:
sudo apt-get install linux-headers-$(uname -r)
sudo apt-key del 7fa2af80
wget https://developer.download.nvidia.com/compute/cuda/repos/debian12/x86_64/cuda-keyring_1.1-1_all.deb
sudo dpkg -i cuda-keyring_1.1-1_all.deb
sudo apt-get update
sudo apt-get install cuda-toolkit
sudo rebootAfter system reboots, install nvidia driver:
export PATH=/usr/local/cuda-12.6/bin${PATH:+:${PATH}}
export LD_LIBRARY_PATH=/usr/local/cuda-12.6/lib64${LD_LIBRARY_PATH:+:${LD_LIBRARY_PATH}}
sudo apt-get install nvidia-openTo check that everything installed properly, run this command to see the smi interface:
nvidia-smi