Closed evaline-ju closed 6 months ago
The tokenize API of TGIS returns token counts that could be useful to users already using a particular TGIS model for generation. We want to be able to expose this functionality.
Interface/data model updates are expected in https://github.com/caikit/caikit/tree/main/caikit/interfaces where applicable.
Expecting the caikit-nlp PR to be merged to close this
Is your feature request related to a problem? Please describe.
The tokenize API of TGIS returns token counts that could be useful to users already using a particular TGIS model for generation. We want to be able to expose this functionality.
Describe the solution you'd like
Interface/data model updates are expected in https://github.com/caikit/caikit/tree/main/caikit/interfaces where applicable.