mapbox / preprocessorcerer

Perform preprocessorcery and pick parts on particularly persnickity uploads
ISC License
12 stars 8 forks source link

gribdoctor #8

Open ian29 opened 9 years ago

ian29 commented 9 years ago

@rclark @dnomadb i wonder if down the line it makes sense to incorporate our colleague Dr. Grib for easy weather uploads.

rclark commented 9 years ago

@ian29 we chatted about this but I don't quite remember the outcome. Would the idea be that you'd upload a grib and then we would make tiles from it? That would mean the preprocessorcery would be conversion to TIFF?

ian29 commented 9 years ago

Would the idea be that you'd upload a grib and then we would make tiles from it? That would mean the preprocessorcery would be conversion to TIFF?

yes and yes, assuming this is generally how preprocessorcerer works?

rclark commented 9 years ago

Yeah my confusion comes from looking briefly at https://github.com/mapbox/grib-doctor -- it sounds like its about aggregating a set of gribs into a tiff, while our upload pipeline deals with one file at a time.

If this is a one-at-a-time kind of operation you're thinking of, then yeah -- we could do this.

ian29 commented 9 years ago

@rclark oh yeah. to clarify, gribdoctor can combine (aka smoosh) many gribs into 1 tif, but also supports 1:1 grib->tif transformation.