Add support for ReturnOptions, GeneratedTokens and InputTokens
As part of caikit there are some parameters that are hard-coded to default values in code.
In the TGIS implementation, users can set these options and get the appropriate response.
The parameters in questions are part of the ResponseOptions proto found here.
This PR updates the data-model so that the return from inference server can be part of the result if the appropriate parameter is set in caikit FastAPI endpoint.
Add support for ReturnOptions, GeneratedTokens and InputTokens
As part of caikit there are some parameters that are hard-coded to default values in code. In the TGIS implementation, users can set these options and get the appropriate response. The parameters in questions are part of the ResponseOptions proto found here.
This PR updates the data-model so that the return from inference server can be part of the result if the appropriate parameter is set in caikit FastAPI endpoint.