Experiment with RoBERTa

TimKoornstra / FinTwitBERT

FinTwitBERT: Specialized BERT Model for Financial Twitter Analysis. Trained on vast financial tweets, it's ideal for sentiment analysis, trend prediction, and financial NLP tasks.

MIT License

5 stars 1 forks source link

Experiment with RoBERTa #5

Open StephanAkkerman opened 9 months ago

StephanAkkerman commented 9 months ago

https://huggingface.co/distilroberta-base https://huggingface.co/roberta-base Both are cased

StephanAkkerman commented 9 months ago

Models that are finetuned on financial data: https://huggingface.co/nickmuchi/distilroberta-finetuned-financial-text-classification <- Distilled and finetuned https://huggingface.co/abhilash1910/financial_roberta https://huggingface.co/soleimanian/financial-roberta-large-sentiment <- Large and finetuned

StephanAkkerman commented 9 months ago

Example sentences to test with:

Bangladesh seeks IMF loan as rising import bills hit South Asia
- Bearish
European gas price rise accelerates as Russia cuts flows
- Bearish
Italian companies braced for more political uncertainty
- Bearish

StephanAkkerman commented 8 months ago

https://www.researchgate.net/publication/358284785_FinancialBERT_-_A_Pretrained_Language_Model_for_Financial_Text_Mining -> https://huggingface.co/ahmedrachid/FinancialBERT

StephanAkkerman commented 8 months ago

https://huggingface.co/cardiffnlp/twitter-roberta-base-sentiment-latest