search

paul-gauthier / aider

aider is AI pair programming in your terminal
https://aider.chat/
Apache License 2.0
19.48k stars 1.79k forks source link

chore: add ollama/qwen2.5-coder:7b-instruct-q6_K test results #1746

Closed vertis closed 2 days ago

vertis commented 3 days ago

I'm planning to go through everything that I can run on my M2 Max 96GB macbook and provide stats at various quants, because those are what mac users are likely to be able to run locally with varying size macbooks. This is my first one.

Happy to take suggestions as well.

And of course, thank you for building this.

paul-gauthier commented 2 days ago

I'm not sure it makes sense to include many different quants for local models. There's just such an unbounded number of ways people package up local models.

vertis commented 2 days ago

Fair enough. I thought it was potentially interesting to compare the quants provided by ollama. I agree that it's potentially too messy, so I'll just close this and post it on my blog or something.

Thank you so much again for building aider.