2021-03-09 17:40:36.000492: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
Traceback (most recent call last):
File "ru-gpts/pretrain_transformers.py", line 33, in <module>
from transformers import (
File "/usr/local/lib/python3.7/dist-packages/transformers/__init__.py", line 626, in <module>
from .trainer import Trainer
File "/usr/local/lib/python3.7/dist-packages/transformers/trainer.py", line 69, in <module>
from .trainer_pt_utils import (
File "/usr/local/lib/python3.7/dist-packages/transformers/trainer_pt_utils.py", line 40, in <module>
from torch.optim.lr_scheduler import SAVE_STATE_WARNING
ImportError: cannot import name 'SAVE_STATE_WARNING' from 'torch.optim.lr_scheduler' (/usr/local/lib/python3.7/dist-packages/torch/optim/lr_scheduler.py)
Перестал работать ноутбук для файнтюнинга на колабе: https://colab.research.google.com/github/sberbank-ai/ru-gpts/blob/master/examples/Finetune_RuGPTs_with_HF.ipynb
При выполнении ячейки
Train
ошибка: