Implement discriminative fine-tuning

TimKoornstra / FinTwitBERT

FinTwitBERT: Specialized BERT Model for Financial Twitter Analysis. Trained on vast financial tweets, it's ideal for sentiment analysis, trend prediction, and financial NLP tasks.

MIT License

5 stars 1 forks source link

Implement discriminative fine-tuning #13

Closed StephanAkkerman closed 8 months ago

StephanAkkerman commented 8 months ago

See FinBERT paper and code for details. Different LR per layer

StephanAkkerman commented 8 months ago

0.85 discrimination rate