huggingface / tgi-gaudi

Large Language Model Text Generation Inference on Habana Gaudi
http://hf.co/docs/text-generation-inference
Apache License 2.0
27 stars 47 forks source link

Upgrade to Optimum Habana v1.13.2 #222

Closed regisss closed 2 months ago

regisss commented 2 months ago

What does this PR do?

Upgrade the Optimum Habana dependency (to v1.13.2), which is needed for multi-card Llava.

Before submitting

Who can review?

Anyone in the community is free to review the PR once the tests have passed. Feel free to tag members/contributors who may be interested in your PR.