[TensorRT] usage of unsigned integers makes Deberta incompatible with TensorRT

microsoft / DeBERTa

The implementation of DeBERTa

MIT License

1.97k stars 224 forks source link

[TensorRT] usage of unsigned integers makes Deberta incompatible with TensorRT #83

Open pommedeterresautee opened 2 years ago

pommedeterresautee commented 2 years ago

Nvidia TensorRT doesn't support unsigned integers but supports signed integers. Is there a reason why Xsoftmax symbolic function (for ONNX conversion) is implemented with unsigned integers?

Linked to https://github.com/huggingface/transformers/pull/14013