Open nicolasbolzan opened 4 years ago
Same problem here!!do you finded some solution?
Nope, still crashing on Google colab.
I've experienced a similar problem with the fastai Text Data API
, and also tried reducing batch size, with no success. I thought at first that it's a problem with the Windows 10 64-bit Operating System
, but perhaps it happens in Linux
too? Can you please determine if you are working on a Linux
or Windows
machine in colab
?
I discovered that this error is stochastic -- that is, sometimes it doesn't occur! My brute force solution (admittedly sub-optimal) is to run a try
loop that repeatedly executes the line until completes successfully. Sometimes this takes hours.
This is a problem with the fastai library
that ultimately needs to be addressed by the developers. Unfortunately, although there have been a number of Fastai Forum posts about this problem, AFAIK there has been zero response by developers.
Perhaps it is no longer a problem in Fastai v2
? I wouldn't know, as I have not yet migrated to v2
yet.
Getting the same error in paperspace free GPU: Quadro M4000 . Both in jupiter-notebook mode and terminal mode, getting the same error! PS: I am using fastai-v1 @sgugger Any thoughts on this?
Hi! I have been training a Language Model from Wikipedia in order to create a text classifier in FastAi. I have been using Google colab for it. But after a few minutes of training, the process stops with the following error:
get_wiki(path,lang) dest = split_wiki(path,lang)
bs=64 data = (TextList.from_folder(dest) .split_by_rand_pct(0.1, seed=42) .label_for_lm() .databunch(bs=bs, num_workers=1)) data.save('tmp_lm')
BrokenProcessPool Traceback (most recent call last)