Ollama: Difference between revisions

Line 478:

So, apparently I'm supposed to install the CUDA Toolkit? and the Driver?<ref>https://developer.nvidia.com/cuda-downloads?target_os=Linux&target_arch=x86_64&Distribution=Ubuntu&target_version=24.04&target_type=deb_network</ref>

But, simply installing the toolkit and rebooting managed to resolve my driver issue.

But, simply installing the toolkit and rebooting managed to resolve my driver issue. '''Temporarily'''

<pre>

Line 491:

</pre>

I say 'temporarily' because things shortly went badly and I spent hours installing, removing, re-installing various NVidia drivers. The Internet is full of problem reports trying to get NVidia drivers working properly on Ubuntu.

== Errors installing NVidia driver ==

Line 517:

Line 518:

E: Sub-process /usr/bin/dpkg returned an error code (1)

</pre>

Eventually, after totally purging everything NVidia-related, and starting over, I seem to have a working system that survives reboots. (I saved a transcript of the misery in email under 'NVidia driver F*ckup'.) Supposedly, there is a newer driver available as 'production' but I didn't want to try upgrading.

<pre>

$ nvidia-smi

Thu Jun 19 08:50:34 2025

+-----------------------------------------------------------------------------------------+

| NVIDIA-SMI 550.144.03 Driver Version: 550.144.03 CUDA Version: 12.4 |

|-----------------------------------------+------------------------+----------------------+

| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |

| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |

| | | MIG M. |

|=========================================+========================+======================|

| 0 NVIDIA GeForce RTX 4060 Off | 00000000:01:00.0 On | N/A |

| 0% 49C P5 N/A / 115W | 1567MiB / 8188MiB | 22% Default |

| | | N/A |

+-----------------------------------------+------------------------+----------------------+

+-----------------------------------------------------------------------------------------+

| Processes: |

| GPU GI CI PID Type Process name GPU Memory |

| ID ID Usage |

|=========================================================================================|

| 0 N/A N/A 2579 G /usr/lib/xorg/Xorg 912MiB |

| 0 N/A N/A 3625 G /usr/bin/kwalletd5 2MiB |

| 0 N/A N/A 3821 G ...-gnu/libexec/xdg-desktop-portal-kde 2MiB |

| 0 N/A N/A 3939 G /usr/bin/ksmserver 2MiB |

| 0 N/A N/A 3941 G /usr/bin/kded5 2MiB |

| 0 N/A N/A 3942 G /usr/bin/kwin_x11 167MiB |

| 0 N/A N/A 3992 G /usr/bin/plasmashell 170MiB |

| 0 N/A N/A 4039 G ...c/polkit-kde-authentication-agent-1 2MiB |

| 0 N/A N/A 4152 G ...86_64-linux-gnu/libexec/kdeconnectd 2MiB |

| 0 N/A N/A 4191 G /usr/bin/kaccess 2MiB |

| 0 N/A N/A 4203 G ...-linux-gnu/libexec/DiscoverNotifier 2MiB |

| 0 N/A N/A 4974 G /opt/google/chrome/chrome 2MiB |

| 0 N/A N/A 5080 G ...seed-version=20250618-050053.671000 181MiB |

| 0 N/A N/A 5154 G ...bin/plasma-browser-integration-host 2MiB |

| 0 N/A N/A 9507 G ..._64-linux-gnu/libexec/kf5/klauncher 2MiB |

| 0 N/A N/A 12144 G /usr/bin/konsole 2MiB |

| 0 N/A N/A 12337 G ...irefox/6316/usr/lib/firefox/firefox 59MiB |

+-----------------------------------------------------------------------------------------+

</pre>

[[Category:Artificial Intelligence]]

@@ Line 478: / Line 478: @@
 So, apparently I'm supposed to install the CUDA Toolkit? and the Driver?<ref>https://developer.nvidia.com/cuda-downloads?target_os=Linux&target_arch=x86_64&Distribution=Ubuntu&target_version=24.04&target_type=deb_network</ref>
-But, simply installing the toolkit and rebooting managed to resolve my driver issue.
+But, simply installing the toolkit and rebooting managed to resolve my driver issue. '''Temporarily'''
 <pre>
@@ Line 491: / Line 491: @@
 </pre>
+I say 'temporarily' because things shortly went badly and I spent hours installing, removing, re-installing various NVidia drivers. The Internet is full of problem reports trying to get NVidia drivers working properly on Ubuntu.
 == Errors installing NVidia driver ==
@@ Line 517: / Line 518: @@
 E: Sub-process /usr/bin/dpkg returned an error code (1)
 </pre>
+Eventually, after totally purging everything NVidia-related, and starting over, I seem to have a working system that survives reboots. (I saved a transcript of the misery in email under 'NVidia driver F*ckup'.) Supposedly, there is a newer driver available as 'production' but I didn't want to try upgrading.
+<pre>
+$ nvidia-smi
+Thu Jun 19 08:50:34 2025
++-----------------------------------------------------------------------------------------+
+| NVIDIA-SMI 550.144.03             Driver Version: 550.144.03     CUDA Version: 12.4     |
+|-----------------------------------------+------------------------+----------------------+
+| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
+| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
+|                                         |                        |               MIG M. |
+|=========================================+========================+======================|
+|   0  NVIDIA GeForce RTX 4060        Off |   00000000:01:00.0  On |                  N/A |
+|  0%   49C    P5             N/A /  115W |    1567MiB /   8188MiB |     22%      Default |
+|                                         |                        |                  N/A |
++-----------------------------------------+------------------------+----------------------+
++-----------------------------------------------------------------------------------------+
+| Processes:                                                                              |
+|  GPU   GI   CI        PID   Type   Process name                              GPU Memory |
+|        ID   ID                                                               Usage      |
+|=========================================================================================|
+|    0   N/A  N/A      2579      G   /usr/lib/xorg/Xorg                            912MiB |
+|    0   N/A  N/A      3625      G   /usr/bin/kwalletd5                              2MiB |
+|    0   N/A  N/A      3821      G   ...-gnu/libexec/xdg-desktop-portal-kde          2MiB |
+|    0   N/A  N/A      3939      G   /usr/bin/ksmserver                              2MiB |
+|    0   N/A  N/A      3941      G   /usr/bin/kded5                                  2MiB |
+|    0   N/A  N/A      3942      G   /usr/bin/kwin_x11                             167MiB |
+|    0   N/A  N/A      3992      G   /usr/bin/plasmashell                          170MiB |
+|    0   N/A  N/A      4039      G   ...c/polkit-kde-authentication-agent-1          2MiB |
+|    0   N/A  N/A      4152      G   ...86_64-linux-gnu/libexec/kdeconnectd          2MiB |
+|    0   N/A  N/A      4191      G   /usr/bin/kaccess                                2MiB |
+|    0   N/A  N/A      4203      G   ...-linux-gnu/libexec/DiscoverNotifier          2MiB |
+|    0   N/A  N/A      4974      G   /opt/google/chrome/chrome                       2MiB |
+|    0   N/A  N/A      5080      G   ...seed-version=20250618-050053.671000        181MiB |
+|    0   N/A  N/A      5154      G   ...bin/plasma-browser-integration-host          2MiB |
+|    0   N/A  N/A      9507      G   ..._64-linux-gnu/libexec/kf5/klauncher          2MiB |
+|    0   N/A  N/A     12144      G   /usr/bin/konsole                                2MiB |
+|    0   N/A  N/A     12337      G   ...irefox/6316/usr/lib/firefox/firefox         59MiB |
++-----------------------------------------------------------------------------------------+
+</pre>
 {{References}}
 [[Category:Artificial Intelligence]]