Local runtime will allow secrets only on worker tasks
Secrets will be set on all kinds of tasks when run remotely (control/worker)
fix tests for ubf based on new changes to core.
fix tests for tag-catch for ubf based on new changes to core.
[feedback] register metadata in parallel decorator
[feedback]@parallel inject in current: - move current.parallel from metaflow_current to parallel_decorator
[feedback] appropariately setting task-metadata for parallel stuff
The 'world size' metadata will be set in the @parallel decorator.
The 'node-index' metadata, however, varies depending on the type of computing environment executing the task so it will be set in the appropriate compute decorators.
One reason to specify 'node-index' within compute decorators is that the parallel implementation in the compute decorator might not directly set the required environment variables (MF_PARALLEL_*). Instead, these environment variables (MF_PARALLEL_*) may be set during the task_pre_step callback of the compute decorator using decorator implementation specific logic.
[feedback] reflecting changes to aws batch
[feedback] safety check for _parallel_buf_iter in task_pre_step for @parallel
[feedback] set is_parallel in current to denote a step is running under an @parallel decorator.
current.parallelfrommetaflow_currenttoparallel_decoratorMF_PARALLEL_*). Instead, these environment variables (MF_PARALLEL_*) may be set during thetask_pre_stepcallback of the compute decorator using decorator implementation specific logic.is_parallelin current to denote a step is running under an@paralleldecorator.TODO