Do not start the ollama server if not needed

symflower / eval-dev-quality

DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.

https://symflower.com/en/company/blog/2024/dev-quality-eval-v0.4.0-is-llama-3-better-than-gpt-4-for-generating-tests/

MIT License

128 stars 5 forks source link

Do not start the ollama server if not needed #225

Closed Munsio closed 2 months ago

Munsio commented 3 months ago

During my many runs for the docker version it always came across that we are starting the ollama server as soon as we run evaluate which is kinda annoying as I am using symflower/symbolic-execution or other models and those do not need the ollama server running in the background.