check for duplicate article entry in duckdb

Shubxam / Nifty-500-Live-Sentiment-Analysis

Live Sentiment Analysis dashboard of NIFTY 500 universe of stocks using plotly and streamlit

https://nifty-sad.streamlit.app/

11 stars 4 forks source link

Open Shubxam opened 2 weeks ago

Shubxam commented 2 weeks ago

check if article headline and ticker already exist, if not then add the article to db.

Shubxam commented 2 weeks ago

check for duplication, and add articles to db right after fetching articles and before sentiment analysis
then pull all articles without sentiment analysis score and compute sentiment analysis for them