1) add functionality to screenshot error sites. This helps diagnose the error beyond the error classification
2) updating how urlClassification is stored. Now, it is stored based on the last committed url
3) updating how USPS/GPP data is processed for the case of the api responding but returning null
I've already tested this extensively because it was used for the crawl.
Changes: (issue #54)
1) add functionality to screenshot error sites. This helps diagnose the error beyond the error classification 2) updating how urlClassification is stored. Now, it is stored based on the last committed url 3) updating how USPS/GPP data is processed for the case of the api responding but returning null
I've already tested this extensively because it was used for the crawl.