Open hlkong323 opened 1 year ago
Hi @pommedeterresautee, I have the same problem trying to optimize DeBERTa.
Do you think it's possible to fix this with a reasonable amount of effort? In my experience DeBERTa is the best encoder-style model right now so this would be super useful to have.
Currently it s not on our todo
Here's command and error message. Please advise and help fix it. Thanks!
sudo docker run -it --rm --gpus all -v $PWD:/project ghcr.io/els-rd/transformer-deploy:latest bash -c "cd /project && \ convert_model -m \"microsoft/deberta-v3-small\" \ --backend tensorrt onnx \ --seq-len 16 128 128 \ --task classification"