search

kyzhouhzau / NLPGNN

1. Use BERT, ALBERT and GPT2 as tensorflow2.0's layer. 2. Implement GCN, GAN, GIN and GraphSAGE based on message passing.
MIT License
331 stars 65 forks source link

ELECTRA Support #4

Open salrowili opened 4 years ago

salrowili commented 4 years ago

Hi Folks, Please add ELECTRA to the list of the supported models. ELECTRA is an efficient model that could match ALBERT's performance using less resources.