How will this work?

[mhfowler]

I imagine writing web scrapers to pull from these websites and enter data into a local database

maybe could just use sqlite on your laptop to make it easily portable

Harvest and Bank Of America would be systems I'd be interested in auditing

for harvest, just logging hours worked every week. But exporting these numbers every week or so to look for changes in the numbers over time.

For boa I imagine logging account balance and transaction history over time to confirm that it doesn't change unexpectedly

[mhfowler]

could imagine each auditing system as a "tool for exporting the data on a regular basis" and a set of tests for each system to run on the exported data to raise a warning if it doesn't add up

[r1b]

I think Airflow and Luigi are good potential candidates for managing the exports of data.

[r1b]

:+1: on sqlite

[r1b]

Scrapy could be good for the actual data retrieval