opendatahub-io / opendatahub-documentation

Repository for official documentation of ODH Core components
Apache License 2.0
6 stars 18 forks source link

ODH-9352 - initial draft of dsp caching docs #530

Closed chtyler closed 6 days ago

chtyler commented 1 week ago

Description

This content explains how caching works when using data science pipelines, so that users can understand how to leverage caching for more efficient pipeline runs and how to disable caching when necessary.

Kubeflow Pipelines support caching to reduce redundant executions and enhance pipeline efficiency, as explained in the upstream document Kubeflow Pipelines - Caching. To help users make the most of this feature, we should enhance the existing "Working with data science pipelines" documentation to explain:

How caching works in RHOAI. How cached pipeline steps are displayed in the UI. How users can disable caching if needed.

How Has This Been Tested?

Merge criteria:

jgarciao commented 6 days ago

something else that could be added (in this PR or a follow-up one) is that, when a pipeline task is cached, the task execution logs are not available a shown in the UI

image

aduquett commented 6 days ago

LGTM

jgarciao commented 6 days ago

lgtm