search

OpenNMT / CTranslate2

Fast inference engine for Transformer models
https://opennmt.net/CTranslate2
MIT License
3.22k stars 283 forks source link

Support for DeBERTa Models #1452

Open sharhabeel opened 1 year ago

sharhabeel commented 1 year ago

Hi,

Is there anyway to convert DeBERTa models to Ctranslate2 since the architecture is close somehow to BERT?

Currently the conversion command ct2-transformers-converter produce this error: No conversion is registered for the model configuration DebertaV2Config.

Thanks

guillaumekln commented 1 year ago

Hi,

DeBERTa models use "Disentangled Attention" which is not implemented in CTranslate2 at this time.