Skip to content

fix for release mode and missing cuda library

Samuel Fischer requested to merge sammyf/ollama-cuda:main into main

The package was compiled as Debug by default (about 10 t/s difference running mistral on a RTX3090) and linked against '/opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so*' which isn't on the correct version and led to errors on start (verified by other users on the ollama discord server). Compiling with LTO on resulted in compiling errors and was therefore turned off.

Merge request reports