Iolaum / ollama

Get up and running with Llama 2, Mistral, Gemma, and other large language models.
https://ollama.com
MIT License
0 stars 0 forks source link

Add Fedora Silverblue support #1

Open Iolaum opened 3 months ago

Iolaum commented 3 months ago

Use silverblue branch:

$ cd scripts/
$ ls -la
...
$ sudo sh install.sh 
Please touch the device.
>>> Downloading ollama...
### 100.0%
>>> Installing ollama to /opt...
>>> Creating ollama user...
>>> Adding ollama user to render group...
>>> Adding ollama user to video group...
>>> Adding current user to ollama group...
>>> Creating ollama systemd service...
>>> Enabling and starting ollama service...
Created symlink /etc/systemd/system/default.target.wants/ollama.service → /etc/systemd/system/ollama.service.
>>> The Ollama API is now available at 127.0.0.1:11434.
>>> Install complete. Run "ollama" from the command line.
$ ls -la /var/opt/
total 290148
drwxr-xr-x. 1 root root        28 Apr  1 17:10 .
drwxr-xr-x. 1 root root       276 Apr  1 13:32 ..
-rwxr-xr-x. 1 root root 297108760 Apr  1 17:10 ollama

AMD/NVIDIA installation paths not changed as appropriate. Need further review.

Iolaum commented 3 months ago

PATH update is also needed:

# temporary update:
$ export PATH="$PATH:/var/opt/"
$ which ollama 
/var/opt/ollama
Iolaum commented 3 months ago

systemd integration does not work because

Apr 01 17:35:27 $USER ollama[22140]: Couldn't find '/usr/share/ollama/.ollama/id_ed25519'. Generating new private key.
Apr 01 17:35:27 $USER ollama[22140]: Error: could not create directory mkdir /usr/share/ollama: read-only file system

ollama has to be started manually by the user through:

$ ollama serve
...