bigcode-project / bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.
Apache License 2.0
825 stars 219 forks source link

Dockerfile-multiple no longer fetches pip dependencies needlessly #157

Open RemcoSchrijver opened 1 year ago

RemcoSchrijver commented 1 year ago

Whilst developing a custom task using the Dockerfile-multiple rebuilding the Dockerfile while editing the python code also forced pip to install all dependencies again. So instead of copying the complete code path we first copy the requirements and install them using pip.

This now gives us the benefit that Docker will cache this intermediate image and only when we change the requirements.txt a rebuild is triggered. So development speed that relies on the Dockerfile-multiple is increased dramatically.