symflower / eval-dev-quality

DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.
https://symflower.com/en/company/blog/2024/dev-quality-eval-v0.4.0-is-llama-3-better-than-gpt-4-for-generating-tests/
MIT License
57 stars 3 forks source link

Follow-Up from using Git to reset the temporary directory #141

Closed Munsio closed 2 weeks ago

Munsio commented 1 month ago

@zimmski The regex to check for the temporary test directory does not work on Windows right now but I didn't want to further postpone the PR because of it.

Would be great If you could take a look as you are definitely better with regex than me.