Below is my config file. I tried setting jobs parameter outside of steps as well as inside of calling and extract steps. But still it has no effect as they are run one at a time rather than parallelized as expected. I am running the pipeline on a 64 vCPUs instance.
Below is my
config
file. I tried settingjobs
parameter outside of steps as well as inside ofcalling
andextract
steps. But still it has no effect as they are run one at a time rather than parallelized as expected. I am running the pipeline on a 64 vCPUs instance.How can I make it work?