how to know sources ?

[mkandulavm]

Hi

I am looking to generate normal tiles only.

1) How to know which countries are covered with the sources used in the config.example.yaml ? How to search for sources for other countries ? 2) If the source cannot be downloaded will the process terminate or continue ? 3) There is a "tries" field for only type : gmted. Does this mean it will re-trying download only for this source or for any other source ? 4) If I am looking to generate only normal tiles, which sources I can remove ? or will joerd by default be not downloading them ?

Thanks for the help !

[zerebubuth]

Hi! Thanks for getting in touch. I've tried to answer your questions below, but I also wanted to preface that with a warning that we don't really use joerd any more. I'd recommend taking a look at https://github.com/mojodna/marblecutter-tilezen/ which (I think) is what we're using at the moment. Joerd might still work... but it also might not!

How to know which countries are covered with the sources used in the config.example.yaml ? How to search for sources for other countries ?

Coverage is worldwide. We start with ETOPO1 and layer GMTED and SRTM on top - all three of which are "global" datasets, although with some limitations and missing patches (for example, SRTM isn't available at high latitudes).

The NED and Great Lakes data is USA-only, so feel free to omit them if you're not interested in the USA.

Some data for other countries has been suggested by people in issues they've filed. Otherwise, searching for the country name and "DEM" or "elevation data" is often a good place to start. Sadly, many countries' data providers do not not provide this openly, or in an easily downloadable manner.

If the source cannot be downloaded will the process terminate or continue ?

I think it should terminate.

There is a "tries" field for only type : gmted. Does this mean it will re-trying download only for this source or for any other source ?

The tries field is optional, with a default of 1 (i.e: try once). However, I think it can be provided for any source type, so you should be able to add it to the configuration of other types if you find you need it. It looks like the reason tries is configured for gmted is that we must have had issues with downloading the complete file from the server.

If I am looking to generate only normal tiles, which sources I can remove ? or will joerd by default be not downloading them ?

Normal tiles need the same data as skadi, geotiff and terrarium - all the outputs need the same height data. If you don't need data for the USA, you can remove the Great Lakes and all the different types of NED data.

[nvkelso]

This documentation is still good:

• https://github.com/tilezen/joerd/blob/master/docs/data-sources.md

It also documents how to look at the file headers per tile to determine per tile sources.

[mkandulavm]

Thanks for the information @zerebubuth and @nvkelso I got this error yesterday. joerd.download.DownloadFailedError: File downloaded from 'https://www.ngdc.noaa.gov/mgg/global/relief/ETOPO1/data/bedrock/grid_registered/georeferenced_tiff/ETOPO1_Bed_g_geotiff.zip' failed verification

When I checked the source, its redirecting to here https://governmentshutdown.noaa.gov/ Is there any alternative ?

@zerebubuth If I want to run render_pyramid_to_mbtiles.py, can you tell me what is the simplest way/steps to do it on my machine ? [I apologize, I am seeing Up, Apex, etc for the first time in readme] I am only intested in generating the mbtiles for offline usage.

Thanks for the help !!

[zerebubuth]

When I checked the source, its redirecting to here https://governmentshutdown.noaa.gov/ Is there any alternative ?

I'm afraid I have no idea, sorry :slightly_frowning_face:

One of the problems with these datasets is that they're inconsistently archived and HTTP links to them are often broken. Therefore, projects such as joerd which aren't being actively used tend to bit-rot, even when the US government isn't shut down. :man_shrugging:

If I want to run render_pyramid_to_mbtiles.py, can you tell me what is the simplest way/steps to do it on my machine ?

Again, apologies, I have to say I don't know. I haven't used marblecutter myself, so I don't know how to run it without using the AWS environment.

[nvkelso]

I strongly recommend marble cutter for this. It also has some source caching to s3.

On Thu, Jan 17, 2019 at 01:48 Matt Amos notifications@github.com wrote:

When I checked the source, its redirecting to here https://governmentshutdown.noaa.gov/ https://urldefense.proofpoint.com/v2/url?u=https-3A__governmentshutdown.noaa.gov_&d=DwMFaQ&c=ncDTmphkJTvjIDPh0hpF_w&r=d__e7RyVjCBMVyq0q3TP4Q&m=hac4hj28HGGWB73wcvKvjfdDhzdoMG83vgEDg91c-_k&s=vB9qCqobS-mGVLDehDaiF9cWA6HiOY6d8dHwzsJUGhk&e= Is there any alternative ?

I'm afraid I have no idea, sorry 🙁

One of the problems with these datasets is that they're inconsistently archived and HTTP links to them are often broken. Therefore, projects such as joerd which aren't being actively used tend to bit-rot, even when the US government isn't shut down. 🤷‍♂️

If I want to run render_pyramid_to_mbtiles.py, can you tell me what is the simplest way/steps to do it on my machine ?

Again, apologies, I have to say I don't know. I haven't used marblecutter myself, so I don't know how to run it without using the AWS environment.

— You are receiving this because you were mentioned.

Reply to this email directly, view it on GitHub https://github.com/tilezen/joerd/issues/182#issuecomment-455105224, or mute the thread https://github.com/notifications/unsubscribe-auth/AA0EOygoDRM8jqHOPE-qLmX8t2YopuQjks5vEEQggaJpZM4aCyUx .

[mojodna]

If I want to run render_pyramid_to_mbtiles.py, can you tell me what is the simplest way/steps to do it on my machine ? [I apologize, I am seeing Up, Apex, etc for the first time in readme]

For this, you can ignore Up, Apex, etc (those are for on-demand tiling of sources).

For render_pyramid_to_mbtiles.py, you'll want to build the Docker image and run it within that. docker-compose run marblecutter will do both.