Closed jluethi closed 4 months ago
The relevant log here seems to be
2023-09-22 13:23:53,976; INFO; [glob_with_multiple_patterns] patterns=['*_B02_*.tif']
2023-09-22 13:23:53,978; INFO; [glob_with_multiple_patterns] Found 0 items
Maybe the B02 glob pattern is only valid for one of the three image folders, and not for the others?
Apart from the specific example, there are for sure some homogeneity constraints. A common issue is that channels may be different across folders, which is not supported (I just tested it again, by using two image folders with a different channel each). In general I would expect these issues to appear during the create-ome-zarr task, rather than yokogawa-to-zarr, but I cannot be sure.
I will try to review these constraints and make them explicit, so that we can take a decision on how to proceed.
Let's keep in mind that as part of #457 we may be moving towards not supporting multiple plates (the issue is not yet well-defined, but I think the main blocker was related to copy-ome-zarr, and not to the image parsing). That's of course for a different case (the case where images for different plates are all in the same folder, rather than in multiple image folders), but somewhat related to this one.
Currently, the
Create OME-Zarr
task can run for datasets with many resources. It creates an OME-Zarr folder for each.This is not well tested in downstream processing though: For example, this is a user-reported bug for running with 3 resources for the
Convert Yokogawa to OME-Zarr
task.Could have been user error with one of the paths, but would not be surprised if the setup doesn't work well and there are e.g. assumptions on the metadata being consistent in there.
We should test whether this is working reasonably for simple cases (e.g. run the multiplexing dataset of example 03, but with the normal create-ome-zarr task). Depending on the outcome, we can consider using the multiple plates as an additional potential filter option in our refactor of the parallelization levels / components approach. Or disable multi-resource inputs.