search

edgi-govdata-archiving / web-monitoring-ui

UI to enable analysts to quickly assess changes to monitored government websites
GNU General Public License v3.0
37 stars 38 forks source link

abandon PageFreezer Diff API for now? #20

Closed titaniumbones closed 7 years ago

titaniumbones commented 7 years ago

Given the limitations (10k hits/day, 5s/response, no batch processing) should we stop trying to use the PF diffapi for the time being, and maybe revisit this question later on? We can still use their api''s JSON format for our own outputs if we want, or we can add the additional diff streams that @lh00000000 has been talked about. Then if we decide to go back to their format later on, we can drop their differ in as a replacement for ours.

danielballan commented 7 years ago

I think a rag-tag team of volunteers will have trouble beating their performance when all things are considered, particularly given this comment. But it definitely doesn't hurt to design this in a way that's pluggable.

dcwalk commented 7 years ago

This issue was moved to edgi-govdata-archiving/web-monitoring#11