bigcode-project / bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.
Apache License 2.0
702 stars 180 forks source link

Dockerfile-multiple no longer fetches pip dependencies needlessly #157

Open RemcoSchrijver opened 8 months ago

RemcoSchrijver commented 8 months ago

Whilst developing a custom task using the Dockerfile-multiple rebuilding the Dockerfile while editing the python code also forced pip to install all dependencies again. So instead of copying the complete code path we first copy the requirements and install them using pip.

This now gives us the benefit that Docker will cache this intermediate image and only when we change the requirements.txt a rebuild is triggered. So development speed that relies on the Dockerfile-multiple is increased dramatically.