statsu1990 / kaggle_tweet_sentiment_extraction

kaggle tweet sentiment extraction
0 stars 0 forks source link

Add CNN layer to head #5

Closed statsu1990 closed 4 years ago

statsu1990 commented 4 years ago

To consider the impact of the surrounding.

statsu1990 commented 4 years ago

https://www.kaggle.com/khoongweihao/tse2020-roberta-cnn-random-seed-distribution

statsu1990 commented 4 years ago

Model_v1_5_0 (linear head) : cv 0.54651 (only posi and nega)

other condition dropout=0.1 implement consideration of text_areas implement remove_excessive_padding train only positive and negative label smoothing 0.05 lr 1e-5 different learning rate (x30)