szha commented 3 years ago

Description

Add script for converting ElectraForPretrain params to backbone

Checklist

Essentials

[x] PR's title starts with a category (e.g. [BUGFIX], [MODEL], [TUTORIAL], [FEATURE], [DOC], etc)
[x] Changes are complete (i.e. I finished coding on this PR)
[ ] All changes have test coverage
[ ] Code is well-documented

Changes

[x] Add script for converting ElectraForPretrain params to backbone

Comments

If this change is a backward incompatible change, why must this change be made.
Interesting edge cases to note here

cc @dmlc/gluon-nlp-team

github-actions[bot] commented 3 years ago

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1527/a399698a608c3d709a516f9eb4b620f1c4e1e3b7/index.html

codecov[bot] commented 3 years ago

Codecov Report

Merging #1527 (cb7fc6a) into master (0211c65) will decrease coverage by 0.05%. The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #1527      +/-   ##
==========================================
- Coverage   86.27%   86.22%   -0.06%     
==========================================
  Files          55       55              
  Lines        7513     7396     -117     
==========================================
- Hits         6482     6377     -105     
+ Misses       1031     1019      -12

Impacted Files	Coverage Δ
src/gluonnlp/data/tokenizers/yttm.py	`81.73% <0.00%> (-1.02%)`	:arrow_down:
src/gluonnlp/data/tokenizers/spacy.py	`65.33% <0.00%> (-0.91%)`	:arrow_down:
src/gluonnlp/data/tokenizers/huggingface.py	`71.06% <0.00%> (-0.78%)`	:arrow_down:
conftest.py	`85.52% <0.00%> (-0.73%)`	:arrow_down:
src/gluonnlp/utils/misc.py	`55.90% <0.00%> (-0.46%)`	:arrow_down:
src/gluonnlp/data/tokenizers/jieba.py	`73.13% <0.00%> (-0.40%)`	:arrow_down:
src/gluonnlp/models/transformer_xl.py	`80.48% <0.00%> (-0.39%)`	:arrow_down:
src/gluonnlp/models/xlmr.py	`87.87% <0.00%> (-0.36%)`	:arrow_down:
src/gluonnlp/models/electra.py	`76.50% <0.00%> (-0.34%)`	:arrow_down:
src/gluonnlp/models/t5.py	`93.40% <0.00%> (-0.28%)`	:arrow_down:
... and 16 more

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update 0211c65...cb7fc6a. Read the comment docs.