This Dockerfile was designed to be used with L4T 35.4.1 (Jetpack 5). If you want to use it on the new Jetpack 6, make sure you pass the build argument.
docker build -t l4t_ollama_new:0.1.0 --build-arg L4T_VERSION=r36.2.0 .
git clone https://github.com/remy415/ollama-l4t-docker.git
cd ollama-l4t-docker/docker
docker build -t l4t_ollama_new:0.1.0 .
docker run -d --gpus=all -v ollama:/root/.ollama -p 11434:11434 --name ollama l4t_ollama_new:0.1.0
Note: this assumes you have Ollama installed outside of Docker.
ollama run mistral