search

graykode / xlnet-Pytorch

Simple XLNet implementation with Pytorch Wrapper
https://arxiv.org/pdf/1906.08237.pdf
Apache License 2.0
577 stars 107 forks source link

Low accuracy on sample task #2

Open ndalton12 opened 5 years ago

ndalton12 commented 5 years ago

Hi author,

Any idea why the performance accuracy is so low on the sample task you provide?

I added the following lines to test accuracy: output = logits.transpose(1, 2) predicts = F.softmax(output, dim=1).argmax(dim=1) print((predicts == target).sum().item() / len(target))

The accuracy for the task is ~0.01% after 100 epochs.

graykode commented 5 years ago

I think it is not important accuracy in this domain