Can the scrapers save cached versions of the pages in the repo and only GET when a HEAD request shows the files are newer?

palewire / django-calaccess-campaign-browser

A Django app to refine, review and republish campaign finance data drawn from the California Secretary of State’s CAL-ACCESS database

MIT License

17 stars 12 forks source link

Open palewire opened 9 years ago

palewire commented 9 years ago

This could greatly increase the speed this thing runs, if it works.