search

tensorflow / tfx-addons

Developers helping developers. TFX-Addons is a collection of community projects to build new components, examples, libraries, and tools for TFX. The projects are organized under the auspices of the special interest group, SIG TFX-Addons. Join the group at http://goo.gle/tfx-addons-group
Apache License 2.0
125 stars 62 forks source link

ML Lineage UI for TFX #14

Open theadactyl opened 3 years ago

theadactyl commented 3 years ago

While all the data exists in MLMD, we currently have to rely on orchestrator to represent the executions and other metadata in a nice and organized UI. This would bring a frontend and backend to generate Web UIs from TFX metadata.

cc @casassg

peteboothroyd commented 3 years ago

Would love to see this too. In case you haven't come across it there is prior art within the tfx repo, and a frontend built into the kubeflow project

Edit: I guess you have seen the kubeflow UI... Anyway might be useful for anybody else who ends up here

rcrowe-google commented 3 years ago
htahir1 commented 2 years ago

We have a new implementation of a lineage explorer over at ZenML https://github.com/zenml-io/zenml/tree/main/examples/lineage. Would the community be interested in addition this as part of tfx-addons?

casassg commented 2 years ago

@htahir1 that would be great! I think it would be interesting first to have the lineage as a low level API from MLMD (viz can be added after we have that). I'm one of the owners for MLMD Client, so if you want to contribute it there: https://github.com/tensorflow/tfx-addons/tree/main/tfx_addons/mlmd_client I would be happy to review :D

Curious on what you think this could be implemented like?

rcrowe-google commented 2 years ago

Coming back to this, I think it would be a nice addition! One question - I don't see an example of how lineage is displayed for components which produce multiple artifacts. Is there any issue with that?

Robert Crowe | TensorFlow Developer Engineer | @.*** | @robert_crowe https://twitter.com/robert_crowe

On Wed, Dec 8, 2021 at 4:27 PM Gerard Casas Saez @.***> wrote:

@htahir1 https://github.com/htahir1 that would be great! I think it would be interesting first to have the lineage as a low level API from MLMD (viz can be added after we have that). I'm one of the owners for MLMD Client, so if you want to contribute it there: https://github.com/tensorflow/tfx-addons/tree/main/tfx_addons/mlmd_client I would be happy to review :D

Curious on what you think this could be implemented like?

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/tensorflow/tfx-addons/issues/14#issuecomment-989337276, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKVWSW43QU333UOMQBR6GH3UP7ZVRANCNFSM42K2S2DQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.