Lightning-Universe / lightning-transformers

Flexible components pairing 🤗 Transformers with :zap: Pytorch Lightning
https://lightning-transformers.readthedocs.io
Apache License 2.0
610 stars 77 forks source link

Implement Masked Language Modeling (#77) #173

Closed bzantium closed 3 years ago

bzantium commented 3 years ago
codecov[bot] commented 3 years ago

Codecov Report

Merging #173 (b35f154) into master (02c064c) will decrease coverage by 15.42%. The diff coverage is 82.85%.

Impacted file tree graph

@@             Coverage Diff             @@
##           master     #173       +/-   ##
===========================================
- Coverage   84.60%   69.18%   -15.43%     
===========================================
  Files          66       70        +4     
  Lines        1397     1467       +70     
===========================================
- Hits         1182     1015      -167     
- Misses        215      452      +237     
Flag Coverage Δ
unittests 69.18% <82.85%> (-15.43%) :arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
...sformers/task/nlp/masked_language_modeling/data.py 72.97% <72.97%> (ø)
...formers/task/nlp/masked_language_modeling/model.py 91.66% <91.66%> (ø)
...mers/task/nlp/masked_language_modeling/__init__.py 100.00% <100.00%> (ø)
...ormers/task/nlp/masked_language_modeling/config.py 100.00% <100.00%> (ø)
...ning_transformers/task/nlp/summarization/metric.py 27.58% <0.00%> (-72.42%) :arrow_down:
...transformers/task/nlp/token_classification/data.py 33.87% <0.00%> (-58.07%) :arrow_down:
...ing_transformers/task/nlp/multiple_choice/model.py 42.42% <0.00%> (-51.52%) :arrow_down:
...ransformers/task/nlp/token_classification/model.py 51.16% <0.00%> (-48.84%) :arrow_down:
...ing_transformers/task/nlp/multiple_choice/utils.py 52.38% <0.00%> (-47.62%) :arrow_down:
...ransformers/task/nlp/translation/datasets/wmt16.py 54.54% <0.00%> (-45.46%) :arrow_down:
... and 18 more

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update 02c064c...b35f154. Read the comment docs.

SeanNaren commented 3 years ago

Failing test is unrelated, should be fixed separately, so will merge!

bzantium commented 3 years ago

Thank you so much! It's an honour to contribute to this great project :)