Aider-AI / aider

aider is AI pair programming in your terminal
https://aider.chat/
Apache License 2.0
21.17k stars 1.97k forks source link

Benchmarking Ollama models #2208

Open chemcoder-2020 opened 1 day ago

chemcoder-2020 commented 1 day ago

Issue

When benchmarking ollama models in docker, I find I could not use the regular ollama api base url as in the documentation. What I needed was to use "http://host.docker.internal:11434" (MacOS). I thought it would be nice to update this in the benchmark documentation.

Version and model info

No response

paul-gauthier commented 9 hours ago

Thanks for trying aider and filing this issue.

Unfortunately people may wish to poke different network holes to their docker images. It wouldn't be possible to document all the ways people might wish to do that.

chemcoder-2020 commented 2 hours ago

Well. Something to start with would be nice. I didn't expect to use a different URL for Ollama than what was in the documentation.