Ollama: Difference between revisions
link Michael Chiang to his bio page on ATO 2024 |
No edit summary |
||
| Line 476: | Line 476: | ||
Failed to initialize NVML: Driver/library version mismatch | Failed to initialize NVML: Driver/library version mismatch | ||
NVML library version: 550.144 | NVML library version: 550.144 | ||
So, apparently I'm supposed to install the CUDA Toolkit and the Driver{{References}} | So, apparently I'm supposed to install the CUDA Toolkit? and the Driver?<ref>https://developer.nvidia.com/cuda-downloads?target_os=Linux&target_arch=x86_64&Distribution=Ubuntu&target_version=24.04&target_type=deb_network</ref> | ||
But, simply installing the toolkit and rebooting managed to resolve my driver issue. | |||
<pre> | |||
wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2404/x86_64/cuda-keyring_1.1-1_all.deb | |||
sudo dpkg -i cuda-keyring_1.1-1_all.deb | |||
sudo apt-get update | |||
sudo apt-get install -y cuda-toolkit-12-9 | |||
sudo shutdown -r now | |||
ollama -v | |||
nvidia-smi | |||
journalctl -e -u ollama | |||
</pre> | |||
{{References}} | |||
[[Category:Artificial Intelligence]] | [[Category:Artificial Intelligence]] | ||