utterworks / fast-bert

Super easy library for BERT based NLP models
Apache License 2.0
1.86k stars 341 forks source link

lr_find() taking so much time when running readme.md example #302

Open CastHash532 opened 2 years ago

CastHash532 commented 2 years ago

I tried to run the example from Readme.md to fine tune Bert for multi-label Text Classification task on a subset of the News dataset from Kaggle from: https://www.kaggle.com/rmisra/news-category-dataset

I'm running on Colab gpu and even with freeze_transformer_layers set to True, running lr_find() shows 4h on estimated time

is it normal or am I missing something?

notebook https://github.com/CastHash532/kaggle-automl/blob/main/Kaggle_news_NLP_Transformers_BERT.ipynb