guillaume-be / rust-bert

Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)
https://docs.rs/crate/rust-bert
Apache License 2.0
2.67k stars 216 forks source link

Fix QA pipelines for tokenizers not providing segment ids #428

Closed guillaume-be closed 1 year ago

guillaume-be commented 1 year ago