stevezheng23 / xlnet_extension_tf

XLNet Extension in TensorFlow
Apache License 2.0
131 stars 26 forks source link

Is there a pre-trained model trained on coQA available #79

Open abhishek-jha13 opened 4 years ago

abhishek-jha13 commented 4 years ago

I want to use pre-trained question answering model trained on coQA like hugging face. Do we have something available?

stevezheng23 commented 4 years ago

Sorry, I haven't released trained CoQA model to public yet

abhishek-jha13 commented 4 years ago

No Worries, I was able to train the model using your code

stevezheng23 commented 4 years ago

Great!

imagine3D-ai commented 4 years ago

No Worries, I was able to train the model using your code

what accuracy were you able to achieve?

imagine3D-ai commented 4 years ago

Sorry, I haven't released trained CoQA model to public yet

Hi! I’m wondering if you’vr released trained CoQa model by now?

abhishek-jha13 commented 4 years ago

No Worries, I was able to train the model using your code

what accuracy were you able to achieve?

I was able to achieve an F1 score of 87. If you need my help, email me at abhishekjha13@gmail.com

imagine3D-ai commented 4 years ago

Sorry, I haven't released trained CoQA model to public yet

I'm trying to train XLNET on COQA using your 'run_coqa' script, but my Google Colab notebooks keep crashing. I tried using both CPU and GPU notebook instances and changing batch_size to 1, but they still keep crashing and showing the:

'Allocation of 16777216 exceeds 10% of system memory.' error.

Did you face any similar memory usage errors and did you manage to fix them?

abhishek-jha13 commented 4 years ago

There is bug in the code which causes an infinite loop which causes crashing. Try to fix that.

imagine3D-ai commented 4 years ago

Hmm, do you mean in my code or in the xlnet library?

On Wed, 9 Sep 2020 at 05:29, abhishek-jha13 notifications@github.com wrote:

There is bug in the code which causes an infinite loop which causes crashing. Try to fix that.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/stevezheng23/xlnet_extension_tf/issues/79#issuecomment-689277315, or unsubscribe https://github.com/notifications/unsubscribe-auth/AQQZJ3FDV3P3AFNBQMD6TW3SE3ZA3ANCNFSM4KNBDRXQ .

abhishek-jha13 commented 4 years ago

There is a bug in the run_coqa.py

imagine3D-ai commented 4 years ago

I’m really struggling to find it. Could you make a pull-request on this repo, so that this can be patched?

On Wed, 9 Sep 2020 at 08:28, abhishek-jha13 notifications@github.com wrote:

There is a bug in the run_coqa.py

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/stevezheng23/xlnet_extension_tf/issues/79#issuecomment-689336396, or unsubscribe https://github.com/notifications/unsubscribe-auth/AQQZJ3HHEGKURBSLUVYJF7DSE4OCLANCNFSM4KNBDRXQ .

stevezheng23 commented 4 years ago

There is a bug in the run_coqa.py

Please feel free to send out a PR for fixing the bug, thanks!