Right now, Azure ML built-in caching mechanism is disabled by the plugin explicitly.
We should add an option to enable it on specific nodes based on tags (in the same way as the resources are configured).
Proposed configuration azureml.yml:
azure:
# rest of the config
cache:
__default__: false
specific_tag: true
Right now, Azure ML built-in caching mechanism is disabled by the plugin explicitly. We should add an option to enable it on specific nodes based on tags (in the same way as the resources are configured).
Proposed configuration
azureml.yml
:then, all nodes tagged with
specific_tag
should haveis_deterministic
flag set to true: https://github.com/getindata/kedro-azureml/blob/2e5836b72256d7455d8525c7769a68d4c844ccf7/kedro_azureml/generator.py#L207