symflower / eval-dev-quality

DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.
https://symflower.com/en/company/blog/2024/dev-quality-eval-v0.4.0-is-llama-3-better-than-gpt-4-for-generating-tests/
MIT License
85 stars 5 forks source link

Dump the assessments in the CSV files once they happen and not in the end of all executions #237

Open ruiAzevedo19 opened 2 weeks ago

ruiAzevedo19 commented 2 weeks ago

TODO

1st iteration

2nd iteration

Follow-ups

bauersimon commented 2 weeks ago