Update new datasets to Zenodo

fractal-analytics-platform / fractal-tasks-core

Main tasks for the Fractal analytics platform

https://fractal-analytics-platform.github.io/fractal-tasks-core/

BSD 3-Clause "New" or "Revised" License

14 stars 6 forks source link

Update new datasets to Zenodo #526

Closed tcompa closed 9 months ago

tcompa commented 11 months ago

As soon as #524 is merged (ref #339), the existing zarr datasets on Zenodo will be "wrong", in that they still have ROI tables with non-zero origins.

Through f2bb44f4ceabe0c15c4e4449c522bb33c900c370, we are fixing this issue with a workaround in the CI: after downloading from Zenodo, we load the FOV/well ROI tables and shift them by hand.

To do:

[x] Update Zarr datasets
[x] Remove workaround from pytest fixture

jluethi commented 9 months ago

I've updated the tiny Zenodo dataset, see: https://zenodo.org/records/10257149

The example 02 dataset will follow soon.

[x] We should also update the links on the Fractal splash page to point to this new Zenodo dataset now

Do we link to them from anywhere else?

jluethi commented 9 months ago

And the example 02 dataset (the 2x2 FOV example) is now available here: https://zenodo.org/records/10257532

tcompa commented 9 months ago

Thanks!

We should also update the links on the Fractal splash page to point to this new Zenodo dataset now

Done.

Do we link to them from anywhere else?

Not that I'm aware of.

I'm closing this issue with #623, that removes the original workaround related to ROI-origin-shift.

Note that it'd be good to update datasets once again, after #613 is merged and released. Even if the current one were generated with v0.14.0a0, they probably still lack some metadata: