kubeflow / website

Kubeflow's public website
Creative Commons Attribution 4.0 International
145 stars 752 forks source link

add Model Registry doc to website #3698

Closed tarilabs closed 1 month ago

tarilabs commented 3 months ago

Opening this PR for early feedback.

As feedback received by Release Team during KF community meetings and Model Registry meetings, As identified in the Model Registry KF 1.9 tracker issue on request by Release Team,

➡️ Documentation is needed for Model Registry alpha on the KF website, as part of the KF 1.9 deliverables by Model Registry wg.

This PR focus on the following received requests:

This documentations is loosely based on the content presented with this demo.

StefanoFioravanzo commented 2 months ago

@tarilabs thanks a lot for getting this started! I went through though the current version, I think it's a good first version.

First of all a comment on timeline: we do not have to rush this in time for feature freeze. We have a couple more weeks to finetune and improve the docs. So let's keep this PR running until we have a good version.

Then, I'll refrain from commenting specific sections and instead provide some higher level feedback:

I know it's a lot. Great documentation takes a lot of time and effort. Let's try and do these things incrementally.

I hope that @diegolovison and @hbelmiro can also help out a little bit here. Looking forward to hearing your thoughts!

tarilabs commented 2 months ago

First of all a comment on timeline: we do not have to rush this in time for feature freeze. We have a couple more weeks to finetune and improve the docs. So let's keep this PR running until we have a good version.

ack, and agreed

  • We should also document a list of use cases and jobs that the model registry solves within the Kubeflow ecosystem

yes, this was discussed in the KF community-calls, in the KF MR bi-weekly Josh already suggested the same, we're iterating on a google doc already which will be "poured" in content into this PR as soon as the copy is ready

  • Getting Started: I would split up the getting started into two guides

noted, will do 👉 done with 2f567ae

  • I'd also love to see an architecture diagram under a "reference" section.

noted, will do 👉 done with 3bbf750

Thanks for the feedback @StefanoFioravanzo ! 📥 ✍️

StefanoFioravanzo commented 2 months ago

@tarilabs This is what I was talking about on Monday:

G2CM_FI427_Learn_Article_ Machine_learning_operationalization _Infographic_image1b_V1 2

I took a random picture from the web and added labels by hand. But you get the idea. It would be nice if the MLOps loop that we present in the overview showed how the model registry contributes to the various MLOps stages. Especially when paired with the descriptions you added here https://github.com/kubeflow/website/pull/3698/commits/be3ebf8be6d62ed3e5b5871784c753e5cac96cfd

We could add a small icon that represents the MR presence within the stages with the label, to highlight that MR has a contribution in that stage (what I did in green)

tarilabs commented 2 months ago

We could add a small icon that represents the MR presence within the stages with the label, to highlight that MR has a contribution in that stage (what I did in green)

nice suggestion, thanks! Implemented on top of current diagram with: fca21205f6a58448839386dd7c0598a8fe722bec

StefanoFioravanzo commented 2 months ago

nice suggestion, thanks! Implemented on top of current diagram with: https://github.com/kubeflow/website/commit/fca21205f6a58448839386dd7c0598a8fe722bec

@tarilabs but what do you think about my proposal of moving the MR labeling to each individual section, removing it from the middle? Just want to understand if you like the idea and the mock I sent above. If you do, we can work together on an editable space.

tarilabs commented 2 months ago

what do you think about my proposal of moving the MR labeling to each individual section, removing it from the middle? Just want to understand if you like the idea and the mock I sent above. If you do, we can work together on an editable space.

Removing a "single instance" of a Model Registry "box" and make a cloned "smaller boxes" repeated on the loop can arguably give the false impression there is no "single pane of glass". That is why I incorporated as much as possible from your original comment: https://github.com/kubeflow/website/pull/3698#issuecomment-2063330587 and adapted on top of existing work.

I'm not against iterating again on the diagram, but I would prefer moving forward with a "best candidate" (which imho is present now on this PR) and eventually iterate on it as a separate, focused PR: wdyt?

StefanoFioravanzo commented 2 months ago

can arguably give the false impression there is no "single pane of glass".

I don't agree with this but let's not block on it now. Let's iterate on this after this PR!

StefanoFioravanzo commented 2 months ago

Hey @tarilabs ! Is there something left before we can merge this one?

tarilabs commented 2 months ago

Hey @tarilabs ! Is there something left before we can merge this one?

@StefanoFioravanzo to me this can be merged as this thread shows most of the feedback was incorporated, either as-is, either as incorporation into previous work done as part of this PR. From my pov this PR can be merged following https://github.com/kubeflow/website/pull/3698#issuecomment-2071694592 And further iteration on diagrams, tutorial, etc could be done in later, separate and potentially in-parallels PR :)

StefanoFioravanzo commented 2 months ago

Then let's go! 🚀 @andreyvelich can you approve?

StefanoFioravanzo commented 1 month ago

@tarilabs @andreyvelich I see there are a few last comments to be addressed here. Can we quickly close the loop and get this merged?

tarilabs commented 1 month ago

@tarilabs @andreyvelich I see there are a few last comments to be addressed here. Can we quickly close the loop and get this merged?

yep thanks again for the feedback @andreyvelich , I addressed most of them, about the remaining kindly let me know if, as discussed previously in this thread, do you require them as part of this PR or could be follow-ed up in subsequent PRs (so as also to "parallelize" changes). Thank you!

andreyvelich commented 1 month ago

@tarilabs @andreyvelich I see there are a few last comments to be addressed here. Can we quickly close the loop and get this merged?

yep thanks again for the feedback @andreyvelich , I addressed most of them, about the remaining kindly let me know if, as discussed previously in this thread, do you require them as part of this PR or could be follow-ed up in subsequent PRs (so as also to "parallelize" changes). Thank you!

Sure, we can incorporate them in a following PR. Do you want to address this change in the next PR: https://github.com/kubeflow/website/pull/3698#discussion_r1607313025 ?

tarilabs commented 1 month ago

Sure, we can incorporate them in a following PR. Do you want to address this change in the next PR: #3698 (comment) ?

unless anyone has any "blocker" or "veto" comments, since this PR has been open for a long time (March) and incorporated as many comments as possible in the time being (see thread), I'd be happy to have it merged, and parallelize any further comments/amendments in separate PRs (multiple).

Kindly let me know your guidance here, and once again thanks for all who contributed reviews!!

andreyvelich commented 1 month ago

Absolutely, thanks again for your hard work @tarilabs! /lgtm /assign @jbottum for the approval

google-oss-prow[bot] commented 1 month ago

@andreyvelich: GitHub didn't allow me to assign the following users: for, the, approval.

Note that only kubeflow members with read permissions, repo collaborators and people who have commented on this issue/PR can be assigned. Additionally, issues/PRs can only have 10 assignees at the same time. For more information please see the contributor guide

In response to [this](https://github.com/kubeflow/website/pull/3698#issuecomment-2122552137): >Absolutely, thanks again for your hard work @tarilabs! >/lgtm >/assign @jbottum for the approval Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes-sigs/prow](https://github.com/kubernetes-sigs/prow/issues/new?title=Prow%20issue:) repository.
jbottum commented 1 month ago

/lgtm

jbottum commented 1 month ago

/approve

google-oss-prow[bot] commented 1 month ago

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: jbottum

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files: - ~~[OWNERS](https://github.com/kubeflow/website/blob/master/OWNERS)~~ [jbottum] Approvers can indicate their approval by writing `/approve` in a comment Approvers can cancel approval by writing `/approve cancel` in a comment