IBM-Generative-AI is a Python library built on IBM's large language model REST interface to seamlessly integrate and extend this service in Python programs.
Currently generated Pydantic model has max_new_tokens set to 4096.
This value is not valid anymore and has been recently removed from the OpenAPI schema. We want to regenerate the schema and remove such limitations.
Workaround
from genai.schema import TextGenerationParameters
TextGenerationParameters(max_new_tokens=8000) # ❌
TextGenerationParameters.model_construct(max_new_tokens=8000) # ✅
Currently generated Pydantic model has
max_new_tokens
set to 4096. This value is not valid anymore and has been recently removed from the OpenAPI schema. We want to regenerate the schema and remove such limitations.Workaround