Ollama/install: Difference between revisions

(3 intermediate revisions by 2 users not shown)

Line 79:

Clearly, the full ollama setup is supposed to be run as 'root'. It is not designed to be run as a regular user who has ''docker'' or ''sudo'' / ''adm'' group membership.

~~== Docs ==~~

~~The [https://github.com/ollama/ollama/blob/main/docs/linux.md docs] tell you how you can customize and update or uninstall the environment.~~

~~Looking at the logs with <code>journalctl -e -u ollama</code>told me what my new generated public key is, but also that it could not load a compatible GPU~~

=== Problems with GPU ===

The docs tell you to check with

Just like in the Docker-based attempt to get up and running, I ran into challenges getting the right software for my [[PC Build 2024#Video Card (GPU)|GeForce RTX 4060]] video card by NVidia. The docs tell you to check with

<code>nvidia-smi</code>

Line 93:

Line 88:

So, apparently I'm supposed to install the CUDA Toolkit? and the Driver?<ref>https://developer.nvidia.com/cuda-downloads?target_os=Linux&target_arch=x86_64&Distribution=Ubuntu&target_version=24.04&target_type=deb_network</ref>

~~But, simply~~ installing the toolkit and rebooting managed to resolve my driver issue. '''Temporarily'''

Simply installing the toolkit and rebooting managed to resolve my driver issue. '''Temporarily'''

<pre>

Line 106:

Line 101:

</pre>

I say 'temporarily' because things shortly went badly and I spent hours installing, removing, re-installing various NVidia drivers. The Internet is full of problem reports trying to get NVidia drivers working properly on Ubuntu.

I say 'temporarily' because things shortly went badly and I spent hours installing, removing, re-installing various NVidia drivers. The Internet is full of problem reports trying to [[Nvidia on Ubuntu|get NVidia drivers working properly on Ubuntu]].

== Errors installing NVidia driver ==

Line 175:

Line 170:

+-----------------------------------------------------------------------------------------+

</pre>

== Resources ==

No animals were harmed during the creation of this web page. But my eyes bugged out from staring at countless web resources including the following:

* https://docs.nvidia.com/cuda/cuda-installation-guide-linux/#meta-packages

* https://documentation.ubuntu.com/server/how-to/graphics/install-nvidia-drivers/

* https://askubuntu.com/questions/1516250/installing-nvidia-drivers-on-24-04-is-an-impossible-task

* https://wiki.ubuntu.com/Kernel/MainlineBuilds

* https://github.com/oddmario/NVIDIA-Ubuntu-Driver-Guide

* https://launchpad.net/~graphics-drivers/+archive/ubuntu/ppa

* https://forums.developer.nvidia.com/t/error-installing-nvidia-drivers-on-ubuntu/231193/6

* https://forums.developer.nvidia.com/t/nvidia-smi-has-failed-because-it-couldnt-communicate-with-the-nvidia-driver-make-sure-that-the-latest-nvidia-driver-is-installed-and-running/197141/5

* https://forums.developer.nvidia.com/t/errors-were-encountered-while-processing-dkms/236521

* [https://bugs.launchpad.net/ubuntu/+source/nvidia-graphics-drivers-570/+bug/2115002 My bug report (2115002) on Launchpad]

* [https://bugs.launchpad.net/ubuntu/+source/dkms/+bug/2115018 My duplicate bug report 2115018] comes from a different process with a lot more system logs - but probably useless.

@@ Line 79: / Line 79: @@
 Clearly, the full ollama setup is supposed to be run as 'root'. It is not designed to be run as a regular user who has ''docker'' or ''sudo'' / ''adm'' group membership.
-== Docs ==
-The [https://github.com/ollama/ollama/blob/main/docs/linux.md docs] tell you how you can customize and update or uninstall the environment.
-Looking at the logs with <code>journalctl -e -u ollama</code>told me what my new generated public key is, but also that it could not load a compatible GPU
 === Problems with GPU ===
-The docs tell you to check with
+Just like in the Docker-based attempt to get up and running, I ran into challenges getting the right software for my [[PC Build 2024#Video Card (GPU)|GeForce RTX 4060]] video card by NVidia. The docs tell you to check with
 <code>nvidia-smi</code>
@@ Line 93: / Line 88: @@
 So, apparently I'm supposed to install the CUDA Toolkit? and the Driver?<ref>https://developer.nvidia.com/cuda-downloads?target_os=Linux&target_arch=x86_64&Distribution=Ubuntu&target_version=24.04&target_type=deb_network</ref>
-But, simply installing the toolkit and rebooting managed to resolve my driver issue. '''Temporarily'''
+Simply installing the toolkit and rebooting managed to resolve my driver issue. '''Temporarily'''
 <pre>
@@ Line 106: / Line 101: @@
 </pre>
-I say 'temporarily' because things shortly went badly and I spent hours installing, removing, re-installing various NVidia drivers. The Internet is full of problem reports trying to get NVidia drivers working properly on Ubuntu.
+I say 'temporarily' because things shortly went badly and I spent hours installing, removing, re-installing various NVidia drivers. The Internet is full of problem reports trying to [[Nvidia on Ubuntu|get NVidia drivers working properly on Ubuntu]].
 == Errors installing NVidia driver ==
@@ Line 175: / Line 170: @@
 +-----------------------------------------------------------------------------------------+
 </pre>
+== Resources ==
+No animals were harmed during the creation of this web page. But my eyes bugged out from staring at countless web resources including the following:
+* https://docs.nvidia.com/cuda/cuda-installation-guide-linux/#meta-packages
+* https://documentation.ubuntu.com/server/how-to/graphics/install-nvidia-drivers/
+* https://askubuntu.com/questions/1516250/installing-nvidia-drivers-on-24-04-is-an-impossible-task
+* https://wiki.ubuntu.com/Kernel/MainlineBuilds
+* https://github.com/oddmario/NVIDIA-Ubuntu-Driver-Guide
+* https://launchpad.net/~graphics-drivers/+archive/ubuntu/ppa
+* https://forums.developer.nvidia.com/t/error-installing-nvidia-drivers-on-ubuntu/231193/6
+* https://forums.developer.nvidia.com/t/nvidia-smi-has-failed-because-it-couldnt-communicate-with-the-nvidia-driver-make-sure-that-the-latest-nvidia-driver-is-installed-and-running/197141/5
+* https://forums.developer.nvidia.com/t/errors-were-encountered-while-processing-dkms/236521
+* [https://bugs.launchpad.net/ubuntu/+source/nvidia-graphics-drivers-570/+bug/2115002 My bug report (2115002) on Launchpad]
+* [https://bugs.launchpad.net/ubuntu/+source/dkms/+bug/2115018 My duplicate bug report 2115018] comes from a different process with a lot more system logs - but probably useless.