search

utterworks / fast-bert

Super easy library for BERT based NLP models
Apache License 2.0
1.86k stars 341 forks source link

Can not fine tuning lanague model using Colab #289

Open Kowsher opened 3 years ago

Kowsher commented 3 years ago

When I'm going to train to fine-tune LM in colab it says Please install apex to use fp16 training cannot import name 'UnencryptedCookieSessionFactoryConfig' from 'pyramid.session' (unknown location) During handling of the above exception

Elzic6 commented 3 years ago

Hi Kowsher, I had the same issue, then after a while..., I found a solution that works for me : Problem : when you install apex in colab, you get multiple versions of cuda installed, and you have to indicate the good version to use : I found the solution here (look at the comment : artitw commented on 5 Apr 2020) : https://github.com/NVIDIA/apex/issues/754

to sumup : 1- open your colab notebook, 2- connect your google drive (from google.colab import drive), 3- install apex with the following code export CUDA_HOME=/usr/local/cuda-10.1 pip install -v --no-cache-dir --global-option="--cpp_ext" --global-option="--cuda_ext" pytorch-extension

hope this will works for you too :)