Add bfloat16 tensor loading support

guillaume-be / rust-bert

Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

https://docs.rs/crate/rust-bert

Apache License 2.0

2.67k stars 216 forks source link

Closed guillaume-be closed 1 year ago

guillaume-be commented 1 year ago

handling of bfloat16 tensors loaded from torch using manual bitwise conversion/casting