search

MarquezProject / marquez

Collect, aggregate, and visualize a data ecosystem's metadata
https://marquezproject.ai
Apache License 2.0
1.78k stars 320 forks source link

Display Stream schema in the Marquez UI #857

Open julienledem opened 3 years ago

julienledem commented 3 years ago

The STREAM type Dataset has a schemaLocation field that points to a schema stored in a registry. https://marquezproject.github.io/marquez/openapi.html#tag/Datasets/paths/~1namespaces~1{namespace}~1datasets~1{dataset}/put It would make sense to display the schema in the UI.

wslulciuc commented 3 years ago

We can approach displaying the schema in the UI for stream datasets in two ways:

  1. Have the UI directly call out to the schema registry to fetch, then display the schema
  2. Have the backend API expose an endpoint that would proxy calls to a schema registry

Thoughts?