ELECTRA discriminative BERT models retrained from scratch on PubMed + PMC OAI full paper data are available since mid 2020 (biorxiv) introduced in the Proceedings of the First Workshop on Scholarly Document Processing and further developed and used for autonomous nervous system connectivity relation extraction in Proceedings of the Second Workshop on Scholarly Document Processing. The code base and models are available in Github and Zenodo. The models are heavily used in BioASQ 9 and 10 competitions. I don't see any mention of the existence of previous approaches to Biomedical domain adaptation of ELECTRA in your paper.
ELECTRA discriminative BERT models retrained from scratch on PubMed + PMC OAI full paper data are available since mid 2020 (biorxiv) introduced in the Proceedings of the First Workshop on Scholarly Document Processing and further developed and used for autonomous nervous system connectivity relation extraction in Proceedings of the Second Workshop on Scholarly Document Processing. The code base and models are available in Github and Zenodo. The models are heavily used in BioASQ 9 and 10 competitions. I don't see any mention of the existence of previous approaches to Biomedical domain adaptation of ELECTRA in your paper.