dmlc / gluon-nlp

NLP made easy
https://nlp.gluon.ai/
Apache License 2.0
2.55k stars 538 forks source link

[Improvement] Use masked_softmax + masked_logsoftmax + remove adamw #1457

Closed sxjscience closed 3 years ago

sxjscience commented 3 years ago

Description

Checklist

Essentials

cc @dmlc/gluon-nlp-team

codecov[bot] commented 3 years ago

Codecov Report

Merging #1457 (828303a) into master (d4a1d5d) will increase coverage by 0.49%. The diff coverage is 72.22%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #1457      +/-   ##
==========================================
+ Coverage   85.30%   85.79%   +0.49%     
==========================================
  Files          53       52       -1     
  Lines        6987     6855     -132     
==========================================
- Hits         5960     5881      -79     
+ Misses       1027      974      -53     
Impacted Files Coverage Δ
src/gluonnlp/__init__.py 100.00% <ø> (ø)
src/gluonnlp/attention_cell.py 86.91% <72.22%> (+6.52%) :arrow_up:
src/gluonnlp/data/filtering.py 78.26% <0.00%> (-4.35%) :arrow_down:
src/gluonnlp/data/tokenizers/yttm.py 81.89% <0.00%> (-0.87%) :arrow_down:
src/gluonnlp/data/tokenizers/subword_nmt.py 79.43% <0.00%> (+0.93%) :arrow_up:
src/gluonnlp/data/loading.py 83.39% <0.00%> (+7.54%) :arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update d4a1d5d...828303a. Read the comment docs.

github-actions[bot] commented 3 years ago

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1457/masked_softmax/index.html

github-actions[bot] commented 3 years ago

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1457/masked_softmax/index.html

github-actions[bot] commented 3 years ago

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1457/masked_softmax/index.html

github-actions[bot] commented 3 years ago

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1457/masked_softmax/index.html

github-actions[bot] commented 3 years ago

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1457/masked_softmax/index.html

github-actions[bot] commented 3 years ago

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1457/masked_softmax/index.html

github-actions[bot] commented 3 years ago

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1457/masked_softmax/index.html

github-actions[bot] commented 3 years ago

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1457/masked_softmax/index.html

github-actions[bot] commented 3 years ago

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1457/masked_softmax/index.html