search

opendatahub-io / caikit-nlp-client

A grpc and http client library for caikit-nlp
Apache License 2.0
3 stars 6 forks source link

Remove default max_new_tokens and min_new_tokens from http client #75

Closed bdattoma closed 11 months ago

bdattoma commented 11 months ago

the http client is setting the max_tokens and min_tokens to some fixed values. I think we should remove those

https://github.com/opendatahub-io/caikit-nlp-client/blob/main/src/caikit_nlp_client/http_client.py#L292