Ollama/install: Difference between revisions

Line 79:

Clearly, the full ollama setup is supposed to be run as 'root'. It is not designed to be run as a regular user who has ''docker'' or ''sudo'' / ''adm'' group membership.

~~== Docs ==~~

~~The [https://github.com/ollama/ollama/blob/main/docs/linux.md docs] tell you how you can customize and update or uninstall the environment.~~

~~Looking at the logs with <code>journalctl -e -u ollama</code>told me what my new generated public key is, but also that it could not load a compatible GPU~~

=== Problems with GPU ===

The docs tell you to check with

Just like in the Docker-based attempt to get up and running, I ran into challenges getting the right software for my [[PC Build 2024#Video Card (GPU)|GeForce RTX 4060]] video card by NVidia. The docs tell you to check with

<code>nvidia-smi</code>

Line 93:

Line 88:

So, apparently I'm supposed to install the CUDA Toolkit? and the Driver?<ref>https://developer.nvidia.com/cuda-downloads?target_os=Linux&target_arch=x86_64&Distribution=Ubuntu&target_version=24.04&target_type=deb_network</ref>

~~But, simply~~ installing the toolkit and rebooting managed to resolve my driver issue. '''Temporarily'''

Simply installing the toolkit and rebooting managed to resolve my driver issue. '''Temporarily'''

<pre>

Line 176:

Line 171:

</pre>

== Resources ==

No animals were harmed during the creation of this web page. But my eyes bugged out from staring at countless web resources including the following:

* https://docs.nvidia.com/cuda/cuda-installation-guide-linux/#meta-packages

* https://documentation.ubuntu.com/server/how-to/graphics/install-nvidia-drivers/

* https://askubuntu.com/questions/1516250/installing-nvidia-drivers-on-24-04-is-an-impossible-task

* https://wiki.ubuntu.com/Kernel/MainlineBuilds

* https://github.com/oddmario/NVIDIA-Ubuntu-Driver-Guide

* https://launchpad.net/~graphics-drivers/+archive/ubuntu/ppa

* https://forums.developer.nvidia.com/t/error-installing-nvidia-drivers-on-ubuntu/231193/6

* https://forums.developer.nvidia.com/t/nvidia-smi-has-failed-because-it-couldnt-communicate-with-the-nvidia-driver-make-sure-that-the-latest-nvidia-driver-is-installed-and-running/197141/5

* https://forums.developer.nvidia.com/t/errors-were-encountered-while-processing-dkms/236521

[[Category:Artificial Intelligence]]

@@ Line 79: / Line 79: @@
 Clearly, the full ollama setup is supposed to be run as 'root'. It is not designed to be run as a regular user who has ''docker'' or ''sudo'' / ''adm'' group membership.
-== Docs ==
-The [https://github.com/ollama/ollama/blob/main/docs/linux.md docs] tell you how you can customize and update or uninstall the environment.
-Looking at the logs with <code>journalctl -e -u ollama</code>told me what my new generated public key is, but also that it could not load a compatible GPU
 === Problems with GPU ===
-The docs tell you to check with
+Just like in the Docker-based attempt to get up and running, I ran into challenges getting the right software for my [[PC Build 2024#Video Card (GPU)|GeForce RTX 4060]] video card by NVidia. The docs tell you to check with
 <code>nvidia-smi</code>
@@ Line 93: / Line 88: @@
 So, apparently I'm supposed to install the CUDA Toolkit? and the Driver?<ref>https://developer.nvidia.com/cuda-downloads?target_os=Linux&target_arch=x86_64&Distribution=Ubuntu&target_version=24.04&target_type=deb_network</ref>
-But, simply installing the toolkit and rebooting managed to resolve my driver issue. '''Temporarily'''
+Simply installing the toolkit and rebooting managed to resolve my driver issue. '''Temporarily'''
 <pre>
@@ Line 176: / Line 171: @@
 </pre>
+== Resources ==
+No animals were harmed during the creation of this web page. But my eyes bugged out from staring at countless web resources including the following:
+* https://docs.nvidia.com/cuda/cuda-installation-guide-linux/#meta-packages
+* https://documentation.ubuntu.com/server/how-to/graphics/install-nvidia-drivers/
+* https://askubuntu.com/questions/1516250/installing-nvidia-drivers-on-24-04-is-an-impossible-task
+* https://wiki.ubuntu.com/Kernel/MainlineBuilds
+* https://github.com/oddmario/NVIDIA-Ubuntu-Driver-Guide
+* https://launchpad.net/~graphics-drivers/+archive/ubuntu/ppa
+* https://forums.developer.nvidia.com/t/error-installing-nvidia-drivers-on-ubuntu/231193/6
+* https://forums.developer.nvidia.com/t/nvidia-smi-has-failed-because-it-couldnt-communicate-with-the-nvidia-driver-make-sure-that-the-latest-nvidia-driver-is-installed-and-running/197141/5
+* https://forums.developer.nvidia.com/t/errors-were-encountered-while-processing-dkms/236521
 {{References}}
 [[Category:Artificial Intelligence]]