Add wikipedia loss during eval

TimKoornstra / FinTwitBERT

FinTwitBERT: Specialized BERT Model for Financial Twitter Analysis. Trained on vast financial tweets, it's ideal for sentiment analysis, trend prediction, and financial NLP tasks.

MIT License

5 stars 1 forks source link

Add wikipedia loss during eval #20

Open TimKoornstra opened 7 months ago

TimKoornstra commented 7 months ago

To monitor catastrophic forgetting, we should also evaluate on some "normal" dataset. We can take a random subset of English wikipedia pages from here: https://huggingface.co/datasets/wikimedia/wikipedia/viewer/20231101.en