huggingface / tgi-gaudi

Large Language Model Text Generation Inference on Habana Gaudi
http://hf.co/docs/text-generation-inference
Apache License 2.0
28 stars 47 forks source link

Upgrade Synapse and DS to 1.18 #230

Closed schoi-habana closed 1 month ago

schoi-habana commented 1 month ago

Just upgrade Synapse and DeepSpeed keeping the dependencies for debug

Before submitting

Who can review?

Anyone in the community is free to review the PR once the tests have passed. Feel free to tag members/contributors who may be interested in your PR.