statsu1990 / kaggle_tweet_sentiment_extraction

kaggle tweet sentiment extraction
0 stars 0 forks source link

Dynamic padding #10

Closed statsu1990 closed 4 years ago

statsu1990 commented 4 years ago

https://www.kaggle.com/seesee/faster-2x-tf-roberta

statsu1990 commented 4 years ago

training time become about 2/3.

Model_v1_4_0 score 0.54476 (only posi and nega), implement remove_excessive_padding train only positive and negative label smoothing 0.05 lr 1e-5 different learning rate (x30)