Add configuration options to specify the number of cores to use for Dask operations. A sepearate config option is available for io operations and (num_workers_io).
Also add a config option to specify the size of partitions in MB where required (max_partition_mb).
These options are optional parameters with defaults so should not change the config from how it existed previously.
Add configuration options to specify the number of cores to use for Dask operations. A sepearate config option is available for io operations and (
num_workers_io).Also add a config option to specify the size of partitions in MB where required (
max_partition_mb).These options are optional parameters with defaults so should not change the config from how it existed previously.
This PR addresses issue #750