Seeed-Projects / jetson-examples

The jetson-examples repository by Seeed Studio offers a seamless, one-line command deployment to run vision AI and Generative AI models on the NVIDIA Jetson platform.
https://github.com/seeed-projects/jetson-examples
MIT License
60 stars 11 forks source link

Updating ollama #9

Closed GobbleSlop closed 4 weeks ago

GobbleSlop commented 1 month ago

To update ollama, do we need to wait for the dustynv jetsoncontainers to update the version? Or it can be updated otherwise?

yuyoujiang commented 1 month ago

Hi @GobbleSlop, can also update directly in jetsonexamples. 😀

GobbleSlop commented 1 month ago

Has anyone gotten this to work? The docs tell to run curl -fsSL https://ollama.com/install.sh | sh

I try this inside the docker container on the jetson, but ollama --version still lists the old 0.1.43 version, not newer 0.3.4, even after reboot

GobbleSlop commented 1 month ago

I reached out to the original author of the docker image (I think?) and they said:

The original dockerfile I used to build the container that I think is still hosted on dustynv’s repo had built the ollama binary itself, it didn’t use the install shell script. That shell script probably won’t work as it’s geared to full installs with systemd running, not a container.

If you clone the Jetson-containers repo and build the container with a new tag, that container should build to the latest Ollama version.

Alternatively, you can clone the Ollama repo and follow their build instructions, their scripts should properly detect Jetson settings.

yuyoujiang commented 1 month ago

Yes, your idea is correct. If the Ollama version needs to be updated, a new Docker container must be compiled, and the environment within the container needs to be recompiled according to Ollama's requirements.

GobbleSlop commented 4 weeks ago

seeing https://github.com/dusty-nv/jetson-containers/issues/585