Create ETL pipeline - Githubissues

qzyu999 / finance_tracker_app

App to track personal finances

Apache License 2.0

1 stars 0 forks source link

Create ETL pipeline #4

Open qzyu999 opened 4 months ago

qzyu999 commented 4 months ago

This is to create an issue for tracking a more organized ETL pipeline. This can be a script or a notebook, but as long as we organize it so that we have the ability to update all sources at once in a single location it would be great.

qzyu999 commented 4 months ago

Worth noting that the net_worth (as mentioned in #3) table currently doesn't seem to be correct. A new pipeline for it needs to be created, where we are including those initial values for EWB checking and CC.

qzyu999 commented 4 months ago

July data ingest:

Just downloaded 2 new months for EWB banking
Downloaded 1 month of EWB CC
Downloaded 2 months of Marcus
Downloaded 2024 YTD of Discover CC (need to make upsert pipeline)