get_max_sequence_length() warning if user MAX_SEQUENCE_LENGTH > model MAX_SEQUENCE_LENGTH

IBM / text-generation-inference

IBM development fork of https://github.com/huggingface/text-generation-inference

Apache License 2.0

52 stars 30 forks source link

Closed fialhocoelho closed 2 months ago

fialhocoelho commented 2 months ago

Modify get_max_sequence_length() to warn if USER-DEFINED MAX_SEQUENCE_LENGTH is greater than model's config value
Consolidated multiple return statements into a single return at the end of the function
Combined logging into a single info!() call
Introduced variable result_max_sequence_length to hold the final value
Added concise docstring for function documentation