search

symflower / eval-dev-quality

DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.
https://symflower.com/en/company/blog/2024/dev-quality-eval-v0.4.0-is-llama-3-better-than-gpt-4-for-generating-tests/
MIT License
128 stars 5 forks source link

Kubernetes runtime #231

Closed Munsio closed 3 months ago

Munsio commented 3 months ago

@bauersimon please review.

Also testing this one is currently out of scope as we are unable to spin-up a kubernetes test cluster inside the github actions workflow.

@zimmski can you please test that everything is working as expected with the updated README for using the kubernetes runtime. Note: The static-volume + namespace is already created on our cluster so they do not need to be created/changed.

bauersimon commented 3 months ago

@Munsio LGTM... again no way to verify for me that it works...