add final behavior - Githubissues

KaylaCrush / advocacy-maps

The good governance project (GGP) is a non-partisan democracy reform group.

https://mapletestimony.org

MIT License

0 stars 1 forks source link

Closed KaylaCrush closed 1 year ago

KaylaCrush commented 1 year ago

So. Looks like most of the issues are gone. Now it's time to start thinking about how to deploy this thing.

[x] if no database is present, take all the stored urls and process them
[x] grab the lobbyist urls for the current year
[x] grab the correct disclosure report for the current year (first one if there's only one, second one if there are two)
[x] append the disclosure reports to our big url list and save 'em
[x] scrape the data in the page factory and save it to database

KaylaCrush commented 1 year ago

partially done with the addition of a get_latest_disclosures method

KaylaCrush commented 1 year ago

done along with args parsing