tilezen / joerd

Joerd can be used to download, merge and generate tiles from digital elevation data
MIT License
324 stars 50 forks source link

Clusterise #37

Closed zerebubuth closed 8 years ago

zerebubuth commented 8 years ago

Regions are now bounding boxes with a zoom range, so this doesn't need to be configured in the output. The reason here is to avoid re-doing the (expensive) zoom 0-8 tiles on each machine. We can do them once and everything else is lower.

Jobs are 2x2 degree squares and are inserted into a job queue as JSON objects. Based on the test instance, each job should take between 2-3 hours to complete.

This also abstracts the file store and gives two implementations: file for the normal filesystem and s3 for uploading to S3.

Connects to #11.

@rmarianski could you review, please?

rmarianski commented 8 years ago

:+1: