Pelias North America build, download fails some openaddresses files.

pelias / docker

Run the Pelias geocoder in docker containers, including example projects.

MIT License

330 stars 223 forks source link

Pelias North America build, download fails some openaddresses files. #268

Closed imran-5 closed 3 years ago

imran-5 commented 3 years ago

Hello everybody, As mentioned in the title, I am facing an issue of download fail for Openaddresses files.

Capture

https://results.openaddresses.io/latest/run/us/tx/city_of_university_park.zip

When I try that URL in the browser there is no file. Let me know if it is related to a bug or Openaddresses changed the URL for US cities?

missinglink commented 3 years ago

We had a similar report in https://github.com/pelias/docker/issues/267 and https://github.com/pelias/openaddresses/pull/488 was merged yesterday.

Upgrading to the latest version of the pelias/openaddresses docker image should improve the error reporting but I suspect there is an issue with the openaddresses CDN returning 502 errors which is the ultimate cause of this issue.

missinglink commented 3 years ago

You must include a referer header when requesting manually from their servers or you'll get an error, see https://github.com/pelias/openaddresses/pull/488#issuecomment-921144446

cromulus commented 3 years ago

Perhaps logging which files received 502 errors so that you can do a run again? something like pelias download missing which goes through the missing files for all downloaders and tries again?