microsoft / onnxruntime-training-examples

Examples for using ONNX Runtime for model training.
MIT License
311 stars 62 forks source link

Commenting out RoBERTa & DeBERTa to prevent models from being run until issues are resolved #84

Closed carzh closed 2 years ago

carzh commented 2 years ago

changes made

Commented out a line so that trying to run RoBERTa or DeBERTa causes an error -- tried to comment out as few lines as possible so that adding roBERTa + deBERTa support back in is easier in the future.

Not sure if this should also be mentioned in the README.

background / explanation

RoBERTa currently requires ORT >= 1.12.0 according to this issue (#11268) which was resolved in ORT 1.12.0. However, running with ORT 1.12.0 with the PTCA Docker container and on the specified machine for benchmarking causes this issue (#12312).

DeBERTa has the following unresolved issues when using Optimum's ORTTrainer: #15 and #305

carzh commented 2 years ago

Thanks Ashwini for taking a look at the PR!

Summary of changes made:

Other changes bundled into this PR:

carzh commented 2 years ago

Dockerfile not viable