Closed abasirat closed 2 years ago
@abasirat It might because of the the version version of transformers.
I use transformers v3.0.2 and the pre-trained BERT model provided by hugging face. I have also tried other versions of transformers but it stops exactly at the same line.
@abasirat It is wired. Could you show me the error messages?
There is no error message. It halts at line 473 where it starts enumerating over training data loader and I need to break the running with Ctrl+C.
Did you try the code from line 253 to 269? If it halts again, you can try to remove num_workers = 6
when initiating the data loaders.
It works after removing num_workers = 6
. Thank you.
Hi,
The train.py scrip stops working at line 473 when enumerating over dataloader. I have traced it back and found that the train_dataloader stops after loading the pre-trained BERT model in Line 278. In fact, when I print the iter(train_dataloader) after Line 278, the program dies and needed to be stopped manually (Ctrl+C). I wonder if you have any thoughts on what might be the reason for this faulire.
Thank you in advance, A.