search

symflower / eval-dev-quality

DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.
https://symflower.com/en/company/blog/2024/dev-quality-eval-v0.4.0-is-llama-3-better-than-gpt-4-for-generating-tests/
MIT License
128 stars 5 forks source link

More Java task cases for test generation #134

Closed zimmski closed 4 months ago

zimmski commented 4 months ago

@bauersimon this is basically an FYI that i early merge this. Will add even more cases, but using these cases now to change your #129 PR to not require changing repositories.