Remove duplicate tweets

TimKoornstra / FinTwitBERT

FinTwitBERT: Specialized BERT Model for Financial Twitter Analysis. Trained on vast financial tweets, it's ideal for sentiment analysis, trend prediction, and financial NLP tasks.

MIT License

5 stars 1 forks source link

Remove duplicate tweets #2

Closed StephanAkkerman closed 9 months ago

StephanAkkerman commented 9 months ago

There are a few tweets that are exactly the same, we should remove them