Add variations of line_map for both multiprocessing and joblib.Parallel backends
I have been trying to use the last for calling guidance in a component. For reasons which are pickle-related, only the multiprocessing backend appears to work (even after changing the component implementation to ensure that the partial function evaluation only uses pickleable objects). I have tried both LOKY_PICKLER=pickle on the command line (per joblib.parallel), and cloudpickle.register_pickle_by_value(guidance) (per cloudpickle itself) but both just get me different error messages.
Assorted improvements to the AzureML code:
line_mapfor bothmultiprocessingandjoblib.ParallelbackendsI have been trying to use the last for calling
guidancein a component. For reasons which are pickle-related, only themultiprocessingbackend appears to work (even after changing the component implementation to ensure that the partial function evaluation only uses pickleable objects). I have tried bothLOKY_PICKLER=pickleon the command line (per joblib.parallel), andcloudpickle.register_pickle_by_value(guidance)(per cloudpickle itself) but both just get me different error messages.