kubeflow / examples

A repository to host extended examples and tutorials
Apache License 2.0
1.4k stars 753 forks source link

add framingham-cvd-risk example #1091

Open tarilabs opened 8 months ago

tarilabs commented 8 months ago

@lampajr and myself would like to propose this example. We hope this is interesting and useful! 👍 🚀

The goal and objectives of this example is listed in the README.md, included.

We have tested this using Kubeflow Pipelines 2.0.5 and KFP sdk 2.6.0.

Notes:

While building this example, we have noticed some limitations in the KF Pipelines/SDK as we were trying to make use of some of the KFP 2.x capabilities; we have found alternative ways and opted for those alternative in this example as it currently stand, but we believe these information could be helpful for the community, maybe could also be of support in prioritizing backlogs, etc. Sharing our notes below:

In a tightened Enterprise environment, container don't run as root. We used alternative image for components. See also:

We couldn't use Artifacts due to permission errors. See also:

We couldn't use ParallelFor as mountPVC not supported. See also:

We coudln't use Collected for the downstream tasks due to error:

{"error":"Failed to create a new run: InternalServerError: Failed to validate workflow for (): templates.entrypoint.tasks.root templates.root sorting failed: invalid dependency for-loop-2","code":13,"message":"Failed to create a new run: InternalServerError: Failed to validate workflow for (): templates.entrypoint.tasks.root templates.root sorting failed: invalid dependency for-loop-2","details":[{"@type":"type.googleapis.com/google.rpc.Status","code":13,"message":"Internal Server Error"}]}

We had to force disable caching on each task due to permission errors. See also:

review-notebook-app[bot] commented 8 months ago

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

google-oss-prow[bot] commented 8 months ago

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: tarilabs Once this PR has been reviewed and has the lgtm label, please assign js-ts for approval. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files: - **[OWNERS](https://github.com/kubeflow/examples/blob/master/OWNERS)** Approvers can indicate their approval by writing `/approve` in a comment Approvers can cancel approval by writing `/approve cancel` in a comment