symflower / eval-dev-quality

DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.
https://symflower.com/en/company/blog/2024/dev-quality-eval-v0.4.0-is-llama-3-better-than-gpt-4-for-generating-tests/
MIT License
57 stars 3 forks source link

Roadmap issue template and README section about releases #196

Open bauersimon opened 1 week ago

bauersimon commented 1 week ago

Should we also add our habits of testing new features manually and on our server instance? And with like... Openrouter, Ollama and i.e. fireworks? @zimmski