Extend Carto importer to process tiling of GeoTIFFs

jjmata commented 7 years ago

Same as https://github.com/splashblot/dronedb/issues/3 but starting with a pre-stitched GeoTIFF (basically do everything we do for unstitched images but skip to the step after stitching has been completed by ODM for people who submit a well-referenced TIFF.)

Extra credit: Possibly store assets in S3 per organization if possible! Parallelize at some point as well, see https://github.com/GitHubRGI/geopackage-python/wiki/Usage-Instructions-for-gdal2tiles_parallel.py

Make sure error conditions are well handled/reported:

[ ] File too big (facilitate avoiding the max_import_file_size limit restriction)
[ ] Lack of gdal2tiles.py in path (fix the same for other gdal* binaries, please!)
[ ] Non-georeferenced TIFFs get loaded but not tiled / they don't error out (and maybe get presented on a non-referenced canvas in the future?)

Test to make sure that orthomosaics generated by the major vendors work:

[ ] Pix4D
[ ] Agisoft Photoscan
[ ] MapsMadeEasy
[ ] Others?

jjmata commented 7 years ago

Yes, this means we create a default viz. as with #3 as well. Everything that we do in #3 that makes sense here, we should also do it with GeoTIFFs that people upload as well.

jjmata commented 7 years ago

What is not terribly clear is that we should actually continue uploading the damn TIFFs to PostGIS, but for the time being let's leave it that way.

/cc @javisantana so he doesn't get rid of TIFF imports quite yet or without letting us know first :trollface:

jjmata commented 7 years ago

Moving to next milestone.

jjmata commented 7 years ago

Once we have #1 working, could we use some of the logic there to help here @apercas? What I envision is that we import the GeoTIFF into PostGIS and then create a default visualization just like the ones we've been putting on codepen - that one only works on Safari due to HTTPS cross-domain requests.

That way we save ourselves having to wait for the tiling (except we do wait for the import/overlays to be created!)

jjmata commented 7 years ago

I've started on at least part of this, so taking over for now ...

jjmata commented 7 years ago

This is WIP here: https://github.com/splashblot/dronedb/tree/tileo-feature/tiff-tiler

jjmata commented 7 years ago

Not critical for April, so moving to next milestone.

jjmata commented 7 years ago

Another milestone, another delay.

ivanprado commented 6 years ago

I'll close the ticket now that rasters can be imported directly to Postgres without the need external use of tiling

splashblot / dronedb

Extend Carto importer to process tiling of GeoTIFFs #7