search

ludwig-ai / ludwig

Low-code framework for building custom LLMs, neural networks, and other AI models
http://ludwig.ai
Apache License 2.0
10.97k stars 1.18k forks source link

Improve docker build times for `ludwig-ray` and `ludwig-ray-gpu` #3962

Open arnavgarg1 opened 3 months ago

arnavgarg1 commented 3 months ago

Old docker build times: https://github.com/ludwig-ai/ludwig/commit/a707840b62cffe430bc517d00aafc2b5d69a4b0b (https://github.com/ludwig-ai/ludwig/actions/runs/8104368079/job/22150838886) New docker build times: https://github.com/ludwig-ai/ludwig/commit/e0f112ca837f11c42d0c3cf2473d14f1d999d599 (https://github.com/ludwig-ai/ludwig/actions/runs/8191677680/job/22401422091)

Seems like ludwig-ray and ludwig-ray-gpu build times have increased by nearly 4x - 6x (1.5 hours as opposed to 15-20 min). We should figure out how to speed it back up.

Seems like it might just need us to do some pinning of packages like accelerate.