Test language models - Githubissues

Imortalco / AITradingBot

0 stars 0 forks source link

Test language models #4

Open Imortalco opened 3 months ago

Imortalco commented 3 months ago

Research and find a suitable base language model.

Examples:

FinBert
Roberta
Llama 3.1
Phi

Resources to check: https://ollama.com/blog

Imortalco commented 3 months ago

Found two new models that are based on BERT (kk08/CryptoBERT and ElKulako/cryptobert) and are used for sentinetn analysis. Need to comapre and evalueate these 4 models:

ProsusAI/finbert
FacebookAI/roberta-base(might need training for sentinent analysis or just use cardiffnlp/twitter-roberta-base-sentiment-latest)
kk08/CryptoBERT (based on FinBERT)
ElKulako/cryptobert (based on BERTtweet, which is based on RoBERTa)