search

market-sentiment-analyzer-tool / msat

A Market Sentiment Analyzer Tool (Sheep Indicator) with the mission of offering valuable insight to investors aiming to decode the market sentiments efficiently.
1 stars 1 forks source link

Add data from workflow to the db #8

Open Jayden-uottawa opened 4 days ago

Jayden-uottawa commented 4 days ago

The data from the workflow is currently being only outputed in the workflow. We need to be able to add this data to the db.

Jayden-uottawa commented 4 days ago

The idea is to have a JSON file for the news_data. The workflow will add the data to the JSON file and the it will commit changes and push to main branch. We will than have a script that will take the data from the JSON and add it to the db. The script will check for lines that are already there and will clean the JSON file as it adds them to the db to keep the JSON as small as possible.