search

Lightning-Universe / lightning-transformers

Flexible components pairing 🤗 Transformers with :zap: Pytorch Lightning
https://lightning-transformers.readthedocs.io
Apache License 2.0
610 stars 77 forks source link

training language model on custom data fails #158

Closed enpassanty closed 3 years ago

enpassanty commented 3 years ago

my dataset trains with no issues on huggingface trainer. I have no experience with hydra. I have a feeling I'm missing something basic.

! python train.py \ task=nlp/language_modeling dataset.cfg.train_file = "/content/gdrive/MyDrive/nlp-chart/train charts.csv" \ dataset.cfg.validation_file = "/content/gdrive/MyDrive/nlp-chart/test charts.csv"

traceback 2021-04-24 11:44:44.333439: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0 Traceback (most recent call last): File "train.py", line 88, in <module> hydra_entry() File "/usr/local/lib/python3.7/dist-packages/hydra/main.py", line 33, in decorated_main config_name=config_name, File "/usr/local/lib/python3.7/dist-packages/hydra/_internal/utils.py", line 370, in _run_hydra lambda: hydra.run( File "/usr/local/lib/python3.7/dist-packages/hydra/_internal/utils.py", line 214, in run_and_report raise ex File "/usr/local/lib/python3.7/dist-packages/hydra/_internal/utils.py", line 211, in run_and_report return func() File "/usr/local/lib/python3.7/dist-packages/hydra/_internal/utils.py", line 373, in <lambda> overrides=args.overrides, File "/usr/local/lib/python3.7/dist-packages/hydra/_internal/hydra.py", line 90, in run run_mode=RunMode.RUN, File "/usr/local/lib/python3.7/dist-packages/hydra/_internal/hydra.py", line 524, in compose_config from_shell=from_shell, File "/usr/local/lib/python3.7/dist-packages/hydra/_internal/config_loader_impl.py", line 149, in load_configuration from_shell=from_shell, File "/usr/local/lib/python3.7/dist-packages/hydra/_internal/config_loader_impl.py", line 223, in _load_configuration_impl parsed_overrides = parser.parse_overrides(overrides=overrides) File "/usr/local/lib/python3.7/dist-packages/hydra/core/override_parser/overrides_parser.py", line 100, in parse_overrides ) from e.__cause__ hydra.errors.OverrideParseException: Error parsing override 'dataset.cfg.train_file' missing EQUAL at '<EOF>' See https://hydra.cc/docs/next/advanced/override_grammar/basic for details

SeanNaren commented 3 years ago

Hi @enpassanty! Thanks for checking out the repo, make sure there are no spaces on either side of the equals sign

! python train.py \ task=nlp/language_modeling dataset.cfg.train_file="/content/gdrive/MyDrive/nlp-chart/train charts.csv" \ dataset.cfg.validation_file="/content/gdrive/MyDrive/nlp-chart/test charts.csv"

Could you try this and let me know if it works?

enpassanty commented 3 years ago

that fixed the problem. thanks!