Closed KaylaCrush closed 1 year ago
Things are kinda a mess in terms of command line arguments right now. I really need to figure out what I want.
To run at startup: scrape and save all disclosure urls from all years pull and save all disclosures
To run periodically: scrape and save new disclosure urls from last two years pull and save the new disclosures
testing/debug commands: generate test data process saved urls
Done
Things are kinda a mess in terms of command line arguments right now. I really need to figure out what I want.
To run at startup: scrape and save all disclosure urls from all years pull and save all disclosures
To run periodically: scrape and save new disclosure urls from last two years pull and save the new disclosures
testing/debug commands: generate test data process saved urls