/latest/run/{source}.zip URLs don't work for all sources

openaddresses / machine

Scripts for running OpenAddresses on a complete data set and publishing the results.

http://results.openaddresses.io/

ISC License

97 stars 36 forks source link

/latest/run/{source}.zip URLs don't work for all sources #723

Open arne-cl opened 5 years ago

arne-cl commented 5 years ago

According to issue #706, the latest_run_processed_url URI template (http://results.openaddresses.io/latest/run/{source}.zip) should always give me the latest version of that source file.

When testing sources from http://results.openaddresses.io/state.txt, I found that a lot of them return a 404 error, e.g. https://results.openaddresses.io/latest/run/ch/schwyz.zip .

(I stumbled upon this when trying to add custom sources to the pelias openaddresses importer pelias/openaddresses#425).

migurski commented 5 years ago

In this case, the source is set to skip=true which means the latest version is unavailable intentionally. Are others that you’re finding similar?

Here’s the full history of ch/schwyz: http://results.openaddresses.io/sources/ch/schwyz

arne-cl commented 5 years ago

Hi @migurski,

out of 300 files I checked (Europe plus surrounding countries), 46 returned an error.

From my perspective, it would be great if /latest/run would point to the latest successful run instead of the latest run.