utterworks / fast-bert

Super easy library for BERT based NLP models
Apache License 2.0
1.86k stars 341 forks source link

Could you kindly add samples for LM Fine-tuning? #173

Open dkfjdkfjdkfj opened 4 years ago

dkfjdkfjdkfj commented 4 years ago

I failed in LM fine-tuning with such an error: RuntimeError: CUDA error: device-side assert triggered I don't know how to solve it even though I made many attempts.

It is appreciated if the sample for fine-tuning could be provided.

aubreycondor commented 4 years ago

I'm having the same issue and can't seem to resolve.

jkhalsa-arabesque commented 4 years ago

any updates?

dkfjdkfjdkfj commented 4 years ago

I used transformers language model training to do this. this page

Shane-Neeley commented 4 years ago

I used transformers language model training to do this.

How does this help?

jkhalsa-arabesque commented 4 years ago

So this issue has actually been resolved elsewhere https://github.com/kaushaltrivedi/fast-bert/issues/179

It is to do with the version of the transformers library being used. If you downgrade to 2.3.0 it works fine.