huggingface / tgi-gaudi

Large Language Model Text Generation Inference on Habana Gaudi
http://hf.co/docs/text-generation-inference
Apache License 2.0
27 stars 47 forks source link

Remove all references to habana_quantization_toolkit for 1.18 #229

Closed tthakkal closed 1 month ago

tthakkal commented 1 month ago

What does this PR do?

Removing all references to habana_quantization_toolkit as it is removed in latest 1.18 release

Fixes # (issue)

Before submitting

Who can review?

Anyone in the community is free to review the PR once the tests have passed. Feel free to tag members/contributors who may be interested in your PR.

mandy-li commented 1 month ago

@regisss , pls review and merge if ok for you