huggingface / optimum-tpu

Google TPU optimizations for transformers models
Apache License 2.0
66 stars 17 forks source link

🧹 Cleanup and fixes for TGI #96

Closed tengomucho closed 5 days ago

tengomucho commented 1 week ago

What does this PR do?

Many changes to prepare a proper TGI image compatible with Jetstream Pytorch. In particular: