search

IATI / refresher

A Python application which has the responsibility of tracking IATI data from around the Web and refreshing the core IATI software's data stores
GNU Affero General Public License v3.0
2 stars 0 forks source link

don't re-try files with caught lakify errors #168

Closed nosvalds closed 2 years ago

nosvalds commented 2 years ago

Trello

nosvalds commented 2 years ago

@akmiller01 it would stay errored in perpetuity (until the document was updated by the publisher and the row set to re-download). I figured this made sense for lakify since it's not dependent on an external API. If it errors, running it through the same code isn't going to change anything. Unlike the components that are dependent on external APIs (validator, flattener) that could be erroring because the service is down or overloaded. Then it makes sense to re-try these.