Improvement Description
Typically we use hidden actions for the inner part of a parallel pipeline loop, e.g.
def some_parallel_pipeline():
...
collection = partition_data()
for key, val in collection.items():
result[key] = _hidden_method(val)
viz = collate_data(result)
...
where partition_data, _hidden_method, and collate_data are all qiime2 actions.
With Galaxy, it is better to use the built-in for-each on a collection which will play nicely with whatever scheduler is present and will accomplish the same goal as the pipeline. So the user should be using the underlying actions directly instead of the pipeline.
Improvement Description Typically we use hidden actions for the inner part of a parallel pipeline loop, e.g.
where
partition_data
,_hidden_method
, andcollate_data
are all qiime2 actions.With Galaxy, it is better to use the built-in for-each on a collection which will play nicely with whatever scheduler is present and will accomplish the same goal as the pipeline. So the user should be using the underlying actions directly instead of the pipeline.