tilezen / joerd

Joerd can be used to download, merge and generate tiles from digital elevation data
MIT License
323 stars 49 forks source link

Mexico 5 meter DEM #136

Open nvkelso opened 7 years ago

nvkelso commented 7 years ago
iandees commented 7 years ago

I've spent a couple hours trying to find the CRS for this data and haven't found anything that seems to work. Based on the "DATUM" attribute on an entry like this one, I've been looking for information on ITRF08. There's entries like this one in epsg.io, but they don't produce an image in the right place on earth. I'm still looking for the right projection.

Once I do find the right projection, there are a couple changes I need to do to make the transcode step work:

iandees commented 7 years ago

Did a bunch of pre-processing (similar to the UK data) documented in this new repo: https://github.com/iandees/mx-lidar

Transcode files

aws s3 ls s3://elevation-sources-prod/mx_lidar/ --recursive | \
grep .tif$ | \
awk '{print $4}' | \
while read filename; do \
    bn=$(basename ${filename%.*}); \
    make submit-job job=aws/transcode-job.json.hbs input=s3://elevation-sources-prod/${filename} output=s3://elevation-sources-transcoded/$(dirname $filename)/${bn} name=${bn:0:50}
done
iandees commented 7 years ago

The transcoding finished and we ended up with 2,516 footprints in the database. This doesn't come close to covering Mexico, though:

image

This regex filter in the URL listing step cut out most of the ~50k images from the portal. I think the rest of the images are "surface" (i.e. with buildings) images?

The data that did make it in looks pretty nice, though:

image

iandees commented 7 years ago

I've poked around a bit on other pieces of the data at INEGI this morning and there's more to pull in, but almost none of it has valid projection information in a machine-readable format. I'm going to call it quits for now, as the next step (digging through 50,000 URLs to find a pattern in projection information) is vastly more time-consuming.

nvkelso commented 7 years ago

@iandees I am seeing Mexico data in the dev tiles (which looks good). Can you confirm this issue was completed in the v1.1 milestone, please?

Eg around here: http://localhost:8000/#13/22.7620/-102.5455

This area south of Mexico City also looks much better with the new Mexico data:

iandees commented 7 years ago

Yep, there are 2,503 footprints in the database for mx_lidar (this issue), but as mentioned in the comment above it covers a very small part of Mexico.