This content explains how caching works when using data science pipelines, so that users can understand how to leverage caching for more efficient pipeline runs and how to disable caching when necessary.
Kubeflow Pipelines support caching to reduce redundant executions and enhance pipeline efficiency, as explained in the upstream document Kubeflow Pipelines - Caching. To help users make the most of this feature, we should enhance the existing "Working with data science pipelines" documentation to explain:
How caching works in RHOAI.
How cached pipeline steps are displayed in the UI.
How users can disable caching if needed.
How Has This Been Tested?
Merge criteria:
[ ] The commits are squashed in a cohesive manner and have meaningful messages.
[ ] Testing instructions have been added in the PR body (for PRs involving changes that are not immediately obvious).
[ ] The developer has manually tested the changes and verified that the changes work
something else that could be added (in this PR or a follow-up one) is that, when a pipeline task is cached, the task execution logs are not available a shown in the UI
Description
This content explains how caching works when using data science pipelines, so that users can understand how to leverage caching for more efficient pipeline runs and how to disable caching when necessary.
Kubeflow Pipelines support caching to reduce redundant executions and enhance pipeline efficiency, as explained in the upstream document Kubeflow Pipelines - Caching. To help users make the most of this feature, we should enhance the existing "Working with data science pipelines" documentation to explain:
How caching works in RHOAI. How cached pipeline steps are displayed in the UI. How users can disable caching if needed.
How Has This Been Tested?
Merge criteria: