symflower / eval-dev-quality

DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.
https://symflower.com/en/company/blog/2024/dev-quality-eval-v0.4.0-is-llama-3-better-than-gpt-4-for-generating-tests/
MIT License
137 stars 5 forks source link

Move Dependency installation of Docker into multistage builds #319

Open Munsio opened 3 months ago

Munsio commented 3 months ago

Currently we are downloading and "installing" the dependencies for running various languages in the same step as the container. What we should do is moving them into multistage builds and only copying the results into the "runtime" container.

With that approach the dependency installation can be made in "parallel" which would decrease build time + caching.

At the same time we should check if it is possible to cache the compiling of the ruby binary.

Tasks: