No space left on device for deep learning and inference optimization containers in CI

intel / ai-containers

This repository contains Dockerfiles, scripts, yaml files, Helm charts, etc. used to scale out AI containers with versions of TensorFlow and PyTorch that have been optimized for Intel platforms. Scaling is done with python, Docker, kubernetes, kubeflow, cnvrg.io, Helm, and other container orchestration frameworks for use in the cloud and on-premise

https://intel.github.io/ai-containers/

Apache License 2.0

19 stars 14 forks source link

No space left on device for deep learning and inference optimization containers in CI #190

Open tylertitsworth opened 1 week ago

tylertitsworth commented 1 week ago

As @ma-pineda pointed out, sometimes CI will fail to build these groups because GitHub can only guarantee 14GB of storage, but these images are more like 20-25 before compression.

As a workaround:

sudo rm -rf /usr/share/dotnet
sudo rm -rf /opt/ghc
sudo rm -rf "/usr/local/share/boost"
sudo rm -rf "$AGENT_TOOLSDIRECTORY"

Or switch to a larger runner.

tylertitsworth commented 1 week ago

https://github.com/marketplace/actions/free-disk-space-ubuntu