microsoft / DeBERTa

The implementation of DeBERTa
MIT License
1.91k stars 215 forks source link

effectiveness of RTD #126

Open martin-reczko opened 1 year ago

martin-reczko commented 1 year ago

In the analysis of the state of the art in the DeBERTa-v3 paper, the list showing the effectiveness of RTD could be extended by our combination of ELECTRA and ALBERT called:

ELECTROLBERT: Combining Replaced Token Detection and Sentence Order Prediction, M. Reczko, Proc. of CLEF 2022: Conference and Labs of the Evaluation Forum, September 5–8, 2022, Bologna, Italy online http://ceur-ws.org/Vol-3180/paper-24.pdf, urn:nbn:de:0074-3180-7