Failed to download openaddresses data for Belgium, Luxembourg & The Netherlands

[narzero]

Describe the bug When running pelias download oa I get the following error

pelias download oa
info: [openaddresses-download] Attempting to download selected data files: nl/countrywide.csv,be/bru/bosa-region-brussels-nl.csv,be/bru/bosa-region-brussels-fr.csv,be/vlg/bosa-region-flanders-nl.csv,be/wal/bosa-region-wallonia-fr.csv,lu/countrywide.csv
info: [openaddresses-download] Downloading nl/countrywide.csv
debug: [openaddresses-download] downloading https://results.openaddresses.io/latest/run/nl/countrywide.zip
warn: [openaddresses-download] failed to download https://results.openaddresses.io/latest/run/nl/countrywide.zip: Error: cURL request failed, HTTP status: 301, exit code: 47
info: [openaddresses-download] Downloading be/bru/bosa-region-brussels-nl.csv
debug: [openaddresses-download] downloading https://results.openaddresses.io/latest/run/be/bru/bosa-region-brussels-nl.zip
warn: [openaddresses-download] failed to download https://results.openaddresses.io/latest/run/be/bru/bosa-region-brussels-nl.zip: Error: cURL request failed, HTTP status: 301, exit code: 47
info: [openaddresses-download] Downloading be/bru/bosa-region-brussels-fr.csv
debug: [openaddresses-download] downloading https://results.openaddresses.io/latest/run/be/bru/bosa-region-brussels-fr.zip
warn: [openaddresses-download] failed to download https://results.openaddresses.io/latest/run/be/bru/bosa-region-brussels-fr.zip: Error: cURL request failed, HTTP status: 301, exit code: 47
info: [openaddresses-download] Downloading be/vlg/bosa-region-flanders-nl.csv
debug: [openaddresses-download] downloading https://results.openaddresses.io/latest/run/be/vlg/bosa-region-flanders-nl.zip
warn: [openaddresses-download] failed to download https://results.openaddresses.io/latest/run/be/vlg/bosa-region-flanders-nl.zip: Error: cURL request failed, HTTP status: 301, exit code: 47
info: [openaddresses-download] Downloading be/wal/bosa-region-wallonia-fr.csv
debug: [openaddresses-download] downloading https://results.openaddresses.io/latest/run/be/wal/bosa-region-wallonia-fr.zip
warn: [openaddresses-download] failed to download https://results.openaddresses.io/latest/run/be/wal/bosa-region-wallonia-fr.zip: Error: cURL request failed, HTTP status: 301, exit code: 47
info: [openaddresses-download] Downloading lu/countrywide.csv
debug: [openaddresses-download] downloading https://results.openaddresses.io/latest/run/lu/countrywide.zip
warn: [openaddresses-download] failed to download https://results.openaddresses.io/latest/run/lu/countrywide.zip: Error: cURL request failed, HTTP status: 301, exit code: 47
info: [openaddresses-download] All done!

Steps to Reproduce

1. Set the following data for openaddress in pelias.json:

"openaddresses":{
   "datapath":"/data/openaddresses",
   "files":[
      "nl/countrywide.csv",
      "be/bru/bosa-region-brussels-nl.csv",
      "be/bru/bosa-region-brussels-fr.csv",
      "be/vlg/bosa-region-flanders-nl.csv",
      "be/wal/bosa-region-wallonia-fr.csv",
      "lu/countrywide.csv"
   ]
}

2. Run pelias download oa

Expected behavior I expect the needed data to be downloaded from openadresses.

Environment (please complete the following information):

• OS: Ubuntu 18.04 LTS
• Docker versions: Docker version 19.03.13, build 4484c46d9d, docker-compose version 1.17.1

[missinglink]

There is a big red header here https://results.openaddresses.io which makes me think the time to migrate from results.openaddresses.io -> batch.openaddresses.io has come.

[missinglink]

I believe that the older files are still available, it might be that their server had connectivity issues 🤷

[narzero]

I believe that the older files are still available, it might be that their server had connectivity issues 🤷

It’s been like this since yesterday. And the endpoint is still giving the same error. Maybe it really is time to switch to the new endpoints?

[narzero]

Accidentally closed with the comment, reopening...

[missinglink]

FYI this is being handled in https://github.com/pelias/openaddresses/pull/513