search

google-research / text-to-text-transfer-transformer

Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"
https://arxiv.org/abs/1910.10683
Apache License 2.0
6.16k stars 756 forks source link

Missing some operative_config.gin #645

Closed sarapapi closed 3 years ago

sarapapi commented 3 years ago

Hi all, I've noticed that some gin files in your google cloud folder are missing, like in mT5/large-xl-xxl or t5.1.1.large while in small and base are present. Why? Thanks

craffel commented 3 years ago

I'm not sure what you mean - the operative configs are there for all models, e.g. https://console.cloud.google.com/storage/browser/_details/t5-data/pretrained_models/t5.1.1.large/operative_config.gin https://console.cloud.google.com/storage/browser/_details/t5-data/pretrained_models/mt5/large/operative_config.gin etc.

sarapapi commented 3 years ago

Sorry, my explanation was terrible, I mean that using mT5 for example I get this error message: ERROR:root:Path not found: gs://t5-data/pretrained_models/mt5/large/operative_config.gin but effectively if I verify with gsutil the file is present in your storage, of course.

craffel commented 3 years ago

I assume this means that the machine that your Python job is running on does not have the Python Cloud API set up/installed correctly.

ruiqi-zhong commented 3 years ago

I also had the same issue, and it's also present in this colab tutorial: https://tiny.cc/t5-colab . Would you mind giving hints on how to fix this? Thanks!

sarapapi commented 3 years ago

I also had the same issue, and it's also present in this colab tutorial: https://tiny.cc/t5-colab . Would you mind giving hints on how to fix this? Thanks!

It worked for me downgrading gin to 0.4.0

alirezasalemi7 commented 3 years ago

I also had the same issue, and it's also present in this colab tutorial: https://tiny.cc/t5-colab . Would you mind giving hints on how to fix this? Thanks!

It worked for me downgrading gin to 0.4.0

any solution for this issue? I get this error when I try to fine-tune this model on colab. as suggested I should downgrade gin to 0.4.0 but how should I do that?

INFO:root:system_path_file_exists:gs://t5-data/pretrained_models/mt5/base/operative_config.gin ERROR:root:Path not found: gs://t5-data/pretrained_models/mt5/base/operative_config.gin

ValueError Traceback (most recent call last)

in () 5 pretrained_model_dir=PRETRAINED_DIR, 6 finetune_steps=FINETUNE_STEPS, ----> 7 split="train" 8 ) 9 frames /usr/local/lib/python3.7/dist-packages/t5/seqio/dataset_providers.py in get(cls, name) 143 """Returns provider from the registry.""" 144 if name not in cls._REGISTRY: --> 145 raise ValueError("Provider name not registered: %s" % name) 146 return cls._REGISTRY[name] 147 ValueError: Provider name not registered: glue_cola_v002
adarob commented 3 years ago

That error message is a red herring. This should be fixed by https://github.com/google-research/text-to-text-transfer-transformer/pull/768