huggingface / optimum-tpu

Google TPU optimizations for transformers models
Apache License 2.0
75 stars 19 forks source link

🧹 Cleanup and fixes for TGI #96

Closed tengomucho closed 2 months ago

tengomucho commented 2 months ago

What does this PR do?

Many changes to prepare a proper TGI image compatible with Jetstream Pytorch. In particular: