tensorflow / tfx-addons

Developers helping developers. TFX-Addons is a collection of community projects to build new components, examples, libraries, and tools for TFX. The projects are organized under the auspices of the special interest group, SIG TFX-Addons. Join the group at http://goo.gle/tfx-addons-group
Apache License 2.0
125 stars 62 forks source link

TFX MLMD Client library #12

Open theadactyl opened 3 years ago

theadactyl commented 3 years ago

Currently it's hard to query MLMD as it requires a lot of information on how TFX structures data internally in MLMD. There's several examples (including Airflow TFX example or Model Cards) that have repetitive functions just because they are not included in the core library. We can simplify MLMD querying by providing some of those functions ourselves.

cc @casassg

casassg commented 3 years ago

Some small previous example from Twitter: https://github.com/tensorflow/tfx/pull/2415

BACtaki commented 3 years ago

Can be used as a starting point for MLMD client library: https://github.com/google/nitroml/tree/master/nitroml/analytics

rcrowe-google commented 3 years ago
casassg commented 3 years ago
casassg commented 2 years ago

Another similar example: https://github.com/zenml-io/zenml/blob/main/src/zenml/repository.py