graykode / xlnet-Pytorch

Simple XLNet implementation with Pytorch Wrapper
https://arxiv.org/pdf/1906.08237.pdf
Apache License 2.0
577 stars 107 forks source link

Re-implementation Performance #1

Open lukemelas opened 5 years ago

lukemelas commented 5 years ago

Hello authors,

Thank you for your re-implementation. I look forward to using it. I just wanted to confirm your reimplementation results because I did not see any in the README/Colab.

Have you reproduced the XLNet results (any of Squad/IMDB/GLUE/etc.) by finetuning with PyTorch?

graykode commented 5 years ago

@lukemelas Hello Thank you for your interest in my project. I hope finetuning with PyTorch but it can't not now because we convert tensorflow checkpoint(original github XLNet) to pytorch model weight before...