caikit / caikit-nlp

Apache License 2.0
12 stars 45 forks source link

Wrapped sentence transformer #328

Closed markstur closed 6 months ago

markstur commented 6 months ago

Wrapped sentence transformer to allow access to customized encode() and intercepting tokenizer() details.

In order to keep the requested truncation error message, however, there is a re-tokenize just to get the correct error message. This only happens on errors instead of impacting every request.

markstur commented 6 months ago

There's a bug in the new config handling. I'll use the DRAFT flag while I fix that.