saalfeldlab / n5-spark

Spark-driven processing utilities for N5 datasets.
BSD 2-Clause "Simplified" License
3 stars 7 forks source link

Support saving TIFF files to an abstract backend (potentially cloud) #19

Closed igorpisarev closed 4 years ago

igorpisarev commented 4 years ago

The caller code can now create its own implementation of TiffWriter to enable saving TIFF files to a different backend, for example, cloud storage.

TiffReader is not quite complete yet, and to make use of it in SliceTIFFToN5 we would need to add extend its functionality with file listing, walking a subdirectory recursively, etc. Some of this functionality is already implemented in stitching-spark (DataProvider class hierarchy), so it could be moved here in the future.