search

triton-inference-server / fastertransformer_backend

BSD 3-Clause "New" or "Revised" License
411 stars 134 forks source link

does it also support general transformer encoders like bert? #18

Closed zhanghaoie closed 2 years ago

byshiue commented 2 years ago

This backend still not support encoder model.

byshiue commented 2 years ago

BERT is supported in latest release. Please refer https://github.com/triton-inference-server/fastertransformer_backend/blob/main/docs/bert_guide.md.

byshiue commented 2 years ago

Close this bug because it is inactivated. Feel free to re-open this issue if you still have any problem.