coreweave / ml-containers

MIT License
19 stars 3 forks source link

feat(torch-extras): Add NVIDIA Apex #28

Closed Eta0 closed 1 year ago

Eta0 commented 1 year ago

NVIDIA Apex for torch-extras

This change adds a build of NVIDIA/apex compiled with all possible optional extensions to the torch-extras container builds (#26). It also adds a POSIX sh script, effective_cpu_count.sh, that assists in limiting concurrent compilation jobs based on cgroups resource limits to potentially reduce compile times. This script could likely be reused for other builds as well, such as the torch container build.