search

cpcdoy / rust-sbert

Rust port of sentence-transformers (https://github.com/UKPLab/sentence-transformers)
Apache License 2.0
106 stars 12 forks source link

Adds missing TruncationDirection for hf_tokenizers #20

Closed Luxbit closed 1 year ago

Luxbit commented 2 years ago

Missing field was caused by missing field in TruncationParams in hf_tokenizers and has since been fixed.

Related hf_tokenizers issue: https://github.com/huggingface/tokenizers/commit/4122a33f095e7da48217e19bf9184fefd0506a8e

Luxbit commented 2 years ago

@cpcdoy could you merge this please, so 0.4.0 compiles again

cpcdoy commented 1 year ago

@Luxbit Sorry for the very late reply! And thanks for the fix, looks good to me!