Lightning-Universe / lightning-transformers

Flexible components pairing 🤗 Transformers with :zap: Pytorch Lightning
https://lightning-transformers.readthedocs.io
Apache License 2.0
610 stars 77 forks source link

Adds configurations to use logger easily #177

Closed taeminlee closed 3 years ago

taeminlee commented 3 years ago

Some configurations have been added to use the loggers of pytorch-lighting.

There are three loggers: tensorboard, wandb, and testtube, and examples of use for each are as follows:

tensorboard logging

python train.py \
    task=nlp/language_modeling \
    dataset=nlp/language_modeling/wikitext \
    log=True \
    +trainer/logger=tensorboard

wandb logging

python train.py \
    task=nlp/language_modeling \
    dataset=nlp/language_modeling/wikitext \
    log=True \
    +trainer/logger=wandb \
    trainer.logger.project=PROJECT_NAME \
    +trainer.logger.name=RUN_NAME

testtube logging

python train.py \
    task=nlp/language_modeling \
    dataset=nlp/language_modeling/wikitext \
    log=True \
    +trainer/logger=testtube
codecov[bot] commented 3 years ago

Codecov Report

Merging #177 (4f90c55) into master (fac1e28) will decrease coverage by 0.36%. The diff coverage is n/a.

Impacted file tree graph

@@            Coverage Diff             @@
##           master     #177      +/-   ##
==========================================
- Coverage   67.62%   67.25%   -0.37%     
==========================================
  Files          71       71              
  Lines        1535     1518      -17     
==========================================
- Hits         1038     1021      -17     
  Misses        497      497              
Flag Coverage Δ
unittests 67.25% <ø> (-0.37%) :arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
...ers/task/nlp/multiple_choice/datasets/race/data.py 42.50% <0.00%> (-5.23%) :arrow_down:
...task/nlp/question_answering/datasets/squad/data.py 71.42% <0.00%> (-3.58%) :arrow_down:
...ing_transformers/task/nlp/multiple_choice/utils.py 50.00% <0.00%> (-2.39%) :arrow_down:
...ing_transformers/task/nlp/multiple_choice/model.py 40.62% <0.00%> (-1.80%) :arrow_down:
...ning_transformers/task/nlp/multiple_choice/data.py 75.00% <0.00%> (-1.48%) :arrow_down:
lightning_transformers/core/config.py 100.00% <0.00%> (ø)
lightning_transformers/core/nlp/config.py 100.00% <0.00%> (ø)
lightning_transformers/core/nlp/seq2seq/config.py 100.00% <0.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update fac1e28...4f90c55. Read the comment docs.

SeanNaren commented 3 years ago

Thanks so much! This is awesome :)