Need to unset "HSA_OVERRIDE_GFX_VERSION=10.3.0" in systemd unit
In the systemd unit, the environment variable HSA_OVERRIDE_GFX_VERSION=10.3.0
is causing the loading of a model (llama3) to fail
$ ollama run llama3
Error: llama runner process no longer running: -1
By unsetting it (e.g., systemctl edit ollama.service
and then using Environment=
before resetting the other variables) fixes it, and the llama3 model loads and runs splendidly. (Though I think the CPU is bottlenecking... will report separately when I figure that one out.)
Versions:
$ pacman -Q clblast cmake git go rocm-hip-sdk rocm-opencl-sdk ollama-rocm
clblast 1.6.2-1
cmake 3.29.2-1
git 2.45.0-1
go 2:1.22.2-1
rocm-hip-sdk 6.0.2-1
rocm-opencl-sdk 6.0.2-1
ollama-rocm 0.1.32-1
My GPU is identified as gfx1102
. Oh, and I'm actually on Gardua linux; I hope that's OK.
Thanks!
Edited by Henry Gebhardt