huggingface / tgi-gaudi

Large Language Model Text Generation Inference on Habana Gaudi
http://hf.co/docs/text-generation-inference
Apache License 2.0
28 stars 47 forks source link

Upgrade SynapseAI version to 1.18.0 #240

Closed tthaddey closed 1 month ago

tthaddey commented 1 month ago

What does this PR do?

Upgrade the SynapseAI to 1.18, Optimum Habana to 1.14.0 and DeepSpeed to 1.18

Fixes # (issue)

Before submitting

Who can review?

Anyone in the community is free to review the PR once the tests have passed. Feel free to tag members/contributors who may be interested in your PR.

mandy-li commented 1 month ago

@tthaddey , why this PR? what is difference from https://github.com/huggingface/tgi-gaudi/pull/227?

mandy-li commented 1 month ago

close due to duplicate to an existing PR