huggingface / tgi-gaudi

Large Language Model Text Generation Inference on Habana Gaudi
http://hf.co/docs/text-generation-inference
Apache License 2.0
28 stars 47 forks source link

Update health.rs #243

Closed srajabos closed 3 weeks ago

srajabos commented 4 weeks ago

Changes to assert PAD_SEQUENCE_TO_MULTIPLE_OF cannot be higher than max_input_length

What does this PR do?

This PR asserts PAD_SEQUENCE_TO_MULTIPLE_OF cannot be higher than max_input_length for health message.

Fixes # (issue)

Before submitting

Who can review?

Anyone in the community is free to review the PR once the tests have passed. Feel free to tag members/contributors who may be interested in your PR.

@mandy-li @tthakkal @skavulya