search

dmlc / gluon-nlp

NLP made easy
https://nlp.gluon.ai/
Apache License 2.0
2.56k stars 538 forks source link

albert model requested! #1221

Closed timespaceuniverse closed 4 years ago

timespaceuniverse commented 4 years ago

Description

albert model size is pretty small and interesting. A mxnet based pretraining implementation should be helpful to alot of people!

References

eric-haibin-lin commented 4 years ago

@sxjscience is working on it

sxjscience commented 4 years ago

@lilongyue You may try with the new version that is initiated in https://github.com/dmlc/gluon-nlp/pull/1225 . We are implementing the pretraining part and will PR once ready.