Closed manzt closed 4 years ago
We will need to change the s3 urls obviously, but all the converters are in place.
We don't need to convert to OME to then convert back to zarr...
What I remember from last summer was that we wanted to think of OME-TIFF as our central format: We think we'll have a lot of formats coming in, and we may want to generate a range of output formats as well, and we don't want m*n scripts.
This assumptions might no longer be true, but I'd like to be more clear about the roadmap. Perhaps loop in Nils?
Sorry not to raise this concern earlier.
I am working on making converters for many types of images, but specifically OME-TIFF with Heath in https://github.com/hubmapconsortium/img2zarr. I figured for the purposes of vitessce, and @ngehlenborg demo on wednesday, this should suffice because its the format the data are provided in.
We should talk tomorrow, but the schema in this PR and the Vanderbilt one should match. I can show you what it should look like and you can also give me feedback since one is Zarr and one is not.
@mccalluc I updated s3_target.txt
--> cloud_target.txt
and all instances of $S3_TARGET
--> $CLOUD_TARGET
We don't need to convert to OME to then convert back to zarr...
I added scripts to convert directly to zarr and then tile the chunked full resolution array into lower resolutions. Since we haven't determined our standard yet for pyramids (see https://github.com/hubmapconsortium/vitessce-image-viewer/issues/91), these scripts generate tiles in the format current supported for zarr in Viv:
The
linnarsson.images.json
should be very similar to the config in viv now, where keys here are "channels" and have the same url since it's one zarr array:The only thing missing in Viv logic is
minZoom
. I guess I could add that here to thelinnarsson.images.json
. In the future we shouldn't be exporting alinnarsson.images.json
and instead should have this contained in the.zattrs
of the base zarr. But this is what viv supports now and we want to update our demo. It would be good to iron out the zarr schema sooner rather than later..