MacOS has a fairly low limit for max environment variable size, which could bit hit with large pipelines (in terms of number of nodes). This change adds the option to the worker to load the program from a file rather than environment variable, and makes use of that in the process and node schedulers.
MacOS has a fairly low limit for max environment variable size, which could bit hit with large pipelines (in terms of number of nodes). This change adds the option to the worker to load the program from a file rather than environment variable, and makes use of that in the process and node schedulers.