search

caikit / caikit-nlp

Apache License 2.0
12 stars 45 forks source link

Expose token count through TGIS #326

Closed evaline-ju closed 6 months ago

evaline-ju commented 6 months ago

Is your feature request related to a problem? Please describe.

The tokenize API of TGIS returns token counts that could be useful to users already using a particular TGIS model for generation. We want to be able to expose this functionality.

Describe the solution you'd like

Interface/data model updates are expected in https://github.com/caikit/caikit/tree/main/caikit/interfaces where applicable.

evaline-ju commented 6 months ago

Expecting the caikit-nlp PR to be merged to close this