daanelson
commented
10 months ago - slim torch
- 11.8 wheels for xformers, vllm, and torch
- slim base image
- remove tensorizer
- tweak downloads
- remove unnecessary async
Closed daanelson closed 10 months ago
daanelson
commented
10 months ago 
technillogue
commented
10 months ago alright, tested with mlc, training, and vllm and everything works, should be good to review/merge
I guess should still be tested with 70b