coreweave / ml-containers

MIT License

19 stars 3 forks source link

feat(torch): Ubuntu 22.04, Python 3.10, and PyTorch 2.2.0 #56

Closed Eta0 closed 6 months ago

Eta0 commented 6 months ago

`torch` Updates — Ubuntu 22.04, Python 3.10, and PyTorch 2.2.0

This change updates multiple components of the torch base images, including the OS distribution, Python, PyTorch, and extension modules.

Ubuntu 22.04 / Python 3.10

Most ml-containers/torch images now have a variant built on Ubuntu 22.04 as well as a variant built on Ubuntu 20.04.

CUDA 11.8.0 is an exception, and is only available on Ubuntu 20.04.
Ubuntu 22.04 images use Python 3.10.
Ubuntu 20.04 images use Python 3.8.
The base distribution is indicated in the container image tag.
- E.g. ml-containers/torch:a1b2c3d-base-cuda12.0.1-ubuntu22.04-...

This repository's README has been updated to explain the available options.

PyTorch 2.2.0

This change updates:

torch to v2.2.0
torchvision to v0.17.0
torchaudio to v2.2.0

Extension Modules

This also updates the following torch-extras extension modules:

xformers to v0.0.23.post1
flash-attn to v2.4.2
deepspeed to v0.12.6

Eta0 commented 6 months ago

Note — the most recent commit had scattered build failures due to an unrelated server outage (not ours) that was causing apt installations to fail. Outside of that, this builds without issue.

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7789290618 Image: ghcr.io/coreweave/ml-containers/nightly-torch-extras:es-22.04-fe28457-nccl-2024.02.05.18-cuda12.1.1-ubuntu20.04-nccl2.18.3-1-torch2.3.0a0-vision0.18.0a0-audio2.2.0a0-flash_attn2.4.2

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7789290618 Image: ghcr.io/coreweave/ml-containers/nightly-torch-extras:es-22.04-fe28457-nccl-2024.02.05.18-cuda11.8.0-ubuntu20.04-nccl2.16.5-1-torch2.3.0a0-vision0.18.0a0-audio2.2.0a0-flash_attn2.4.2

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7789290618 Image: ghcr.io/coreweave/ml-containers/nightly-torch-extras:es-22.04-fe28457-nccl-2024.02.05.18-cuda12.2.2-ubuntu20.04-nccl2.19.3-1-torch2.3.0a0-vision0.18.0a0-audio2.2.0a0-flash_attn2.4.2

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7789290620 Image: ghcr.io/coreweave/ml-containers/torch:es-22.04-fe28457-base-cuda12.0.1-ubuntu20.04-torch2.2.0-vision0.17.0-audio2.2.0

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7789290620 Image: ghcr.io/coreweave/ml-containers/torch:es-22.04-fe28457-base-cuda12.0.1-ubuntu22.04-torch2.2.0-vision0.17.0-audio2.2.0

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7789290620 Image: ghcr.io/coreweave/ml-containers/torch:es-22.04-fe28457-base-cuda12.2.2-ubuntu20.04-torch2.2.0-vision0.17.0-audio2.2.0

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7789290620 Image: ghcr.io/coreweave/ml-containers/torch:es-22.04-fe28457-base-cuda11.8.0-ubuntu20.04-torch2.2.0-vision0.17.0-audio2.2.0

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7789290620 Image: ghcr.io/coreweave/ml-containers/torch:es-22.04-fe28457-base-cuda12.1.1-ubuntu20.04-torch2.2.0-vision0.17.0-audio2.2.0

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7789290620 Image: ghcr.io/coreweave/ml-containers/torch:es-22.04-fe28457-base-cuda12.2.2-ubuntu22.04-torch2.2.0-vision0.17.0-audio2.2.0

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7789290620 Image: ghcr.io/coreweave/ml-containers/torch:es-22.04-fe28457-base-cuda12.1.1-ubuntu22.04-torch2.2.0-vision0.17.0-audio2.2.0

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7789290620 Image: ghcr.io/coreweave/ml-containers/torch-extras:es-22.04-fe28457-base-cuda12.0.1-ubuntu20.04-torch2.2.0-vision0.17.0-audio2.2.0-flash_attn2.4.2

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7789290620 Image: ghcr.io/coreweave/ml-containers/torch-extras:es-22.04-fe28457-base-cuda12.0.1-ubuntu22.04-torch2.2.0-vision0.17.0-audio2.2.0-flash_attn2.4.2

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7789290620 Image: ghcr.io/coreweave/ml-containers/torch-extras:es-22.04-fe28457-base-cuda12.2.2-ubuntu20.04-torch2.2.0-vision0.17.0-audio2.2.0-flash_attn2.4.2

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7789290620 Image: ghcr.io/coreweave/ml-containers/torch-extras:es-22.04-fe28457-base-cuda11.8.0-ubuntu20.04-torch2.2.0-vision0.17.0-audio2.2.0-flash_attn2.4.2

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7789290620 Image: ghcr.io/coreweave/ml-containers/torch-extras:es-22.04-fe28457-base-cuda12.1.1-ubuntu20.04-torch2.2.0-vision0.17.0-audio2.2.0-flash_attn2.4.2

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7789290620 Image: ghcr.io/coreweave/ml-containers/torch-extras:es-22.04-fe28457-base-cuda12.2.2-ubuntu22.04-torch2.2.0-vision0.17.0-audio2.2.0-flash_attn2.4.2

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7789290620 Image: ghcr.io/coreweave/ml-containers/torch-extras:es-22.04-fe28457-base-cuda12.1.1-ubuntu22.04-torch2.2.0-vision0.17.0-audio2.2.0-flash_attn2.4.2

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7795727150 Image: ghcr.io/coreweave/ml-containers/torch:es-22.04-5982eb2-nccl-cuda12.0.1-ubuntu22.04-nccl2.18.5-1-torch2.2.0-vision0.17.0-audio2.2.0

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7795727150 Image: ghcr.io/coreweave/ml-containers/torch:es-22.04-5982eb2-nccl-cuda12.0.1-ubuntu20.04-nccl2.19.3-1-torch2.2.0-vision0.17.0-audio2.2.0

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7795727150 Image: ghcr.io/coreweave/ml-containers/torch:es-22.04-5982eb2-nccl-cuda11.8.0-ubuntu20.04-nccl2.16.5-1-torch2.2.0-vision0.17.0-audio2.2.0

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7795727153 Image: ghcr.io/coreweave/ml-containers/torch:es-22.04-5982eb2-base-cuda12.0.1-ubuntu22.04-torch2.2.0-vision0.17.0-audio2.2.0

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7795727153 Image: ghcr.io/coreweave/ml-containers/torch:es-22.04-5982eb2-base-cuda12.0.1-ubuntu20.04-torch2.2.0-vision0.17.0-audio2.2.0

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7795727153 Image: ghcr.io/coreweave/ml-containers/torch:es-22.04-5982eb2-base-cuda11.8.0-ubuntu20.04-torch2.2.0-vision0.17.0-audio2.2.0

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7795727153 Image: ghcr.io/coreweave/ml-containers/torch:es-22.04-5982eb2-base-cuda12.1.1-ubuntu22.04-torch2.2.0-vision0.17.0-audio2.2.0

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7795727153 Image: ghcr.io/coreweave/ml-containers/torch:es-22.04-5982eb2-base-cuda12.1.1-ubuntu20.04-torch2.2.0-vision0.17.0-audio2.2.0

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7795727153 Image: ghcr.io/coreweave/ml-containers/torch:es-22.04-5982eb2-base-cuda12.2.2-ubuntu20.04-torch2.2.0-vision0.17.0-audio2.2.0

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7795727153 Image: ghcr.io/coreweave/ml-containers/torch:es-22.04-5982eb2-base-cuda12.2.2-ubuntu22.04-torch2.2.0-vision0.17.0-audio2.2.0

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7795727149 Image: ghcr.io/coreweave/ml-containers/nightly-torch:es-22.04-5982eb2-base-2024.02.06.07-cuda12.0.1-ubuntu20.04-torch2.3.0a0-vision0.18.0a0-audio2.2.0a0

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7795727149 Image: ghcr.io/coreweave/ml-containers/nightly-torch:es-22.04-5982eb2-base-2024.02.06.07-cuda11.8.0-ubuntu20.04-torch2.3.0a0-vision0.18.0a0-audio2.2.0a0

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7795727149 Image: ghcr.io/coreweave/ml-containers/nightly-torch:es-22.04-5982eb2-base-2024.02.06.07-cuda12.1.1-ubuntu20.04-torch2.3.0a0-vision0.18.0a0-audio2.2.0a0

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7795727149 Image: ghcr.io/coreweave/ml-containers/nightly-torch:es-22.04-5982eb2-base-2024.02.06.07-cuda12.1.1-ubuntu22.04-torch2.3.0a0-vision0.18.0a0-audio2.2.0a0

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7795727149 Image: ghcr.io/coreweave/ml-containers/nightly-torch:es-22.04-5982eb2-base-2024.02.06.07-cuda12.2.2-ubuntu22.04-torch2.3.0a0-vision0.18.0a0-audio2.2.0a0

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7795727149 Image: ghcr.io/coreweave/ml-containers/nightly-torch:es-22.04-5982eb2-nccl-2024.02.06.07-cuda12.0.1-ubuntu22.04-nccl2.18.5-1-torch2.3.0a0-vision0.18.0a0-audio2.2.0a0

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7795727149 Image: ghcr.io/coreweave/ml-containers/nightly-torch:es-22.04-5982eb2-nccl-2024.02.06.07-cuda12.0.1-ubuntu20.04-nccl2.19.3-1-torch2.3.0a0-vision0.18.0a0-audio2.2.0a0

github-actions[bot] commented 6 months ago

@Eta0 Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7795727149 Image: ghcr.io/coreweave/ml-containers/nightly-torch:es-22.04-5982eb2-nccl-2024.02.06.07-cuda12.1.1-ubuntu20.04-nccl2.18.3-1-torch2.3.0a0-vision0.18.0a0-audio2.2.0a0

ad8e commented 6 months ago

Python 3.10, awesome!

github-actions[bot] commented 6 months ago

@wbrown Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7795727153 Image: ghcr.io/coreweave/ml-containers/torch-extras:es-22.04-5982eb2-base-cuda11.8.0-ubuntu20.04-torch2.2.0-vision0.17.0-audio2.2.0-flash_attn2.4.2

github-actions[bot] commented 6 months ago

@wbrown Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7795727153 Image: ghcr.io/coreweave/ml-containers/torch-extras:es-22.04-5982eb2-base-cuda12.0.1-ubuntu22.04-torch2.2.0-vision0.17.0-audio2.2.0-flash_attn2.4.2

github-actions[bot] commented 6 months ago

@wbrown Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7795727153 Image: ghcr.io/coreweave/ml-containers/torch-extras:es-22.04-5982eb2-base-cuda12.0.1-ubuntu20.04-torch2.2.0-vision0.17.0-audio2.2.0-flash_attn2.4.2

github-actions[bot] commented 6 months ago

@wbrown Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7795727153 Image: ghcr.io/coreweave/ml-containers/torch-extras:es-22.04-5982eb2-base-cuda12.1.1-ubuntu20.04-torch2.2.0-vision0.17.0-audio2.2.0-flash_attn2.4.2

github-actions[bot] commented 6 months ago

@wbrown Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7795727153 Image: ghcr.io/coreweave/ml-containers/torch-extras:es-22.04-5982eb2-base-cuda12.1.1-ubuntu22.04-torch2.2.0-vision0.17.0-audio2.2.0-flash_attn2.4.2

github-actions[bot] commented 6 months ago

@wbrown Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7795727153 Image: ghcr.io/coreweave/ml-containers/torch-extras:es-22.04-5982eb2-base-cuda12.2.2-ubuntu22.04-torch2.2.0-vision0.17.0-audio2.2.0-flash_attn2.4.2

github-actions[bot] commented 6 months ago

@wbrown Build complete, success: https://github.com/coreweave/ml-containers/actions/runs/7795727153 Image: ghcr.io/coreweave/ml-containers/torch-extras:es-22.04-5982eb2-base-cuda12.2.2-ubuntu20.04-torch2.2.0-vision0.17.0-audio2.2.0-flash_attn2.4.2