search

apache / incubator-xtable

Apache XTable (incubating) is a cross-table converter for lakehouse table formats that facilitates interoperability across data processing systems and query engines.
https://xtable.apache.org/
Apache License 2.0
919 stars 147 forks source link

Capture all XTable Metadata in a JSON object #412

Closed the-other-tim-brown closed 6 months ago

the-other-tim-brown commented 7 months ago

Currently we add two entries to the metadata of the target tables. If we want to add more information, we'll need to add additional fields with this approach.

Instead, I am proposing we capture the metadata in a json object and only add a single entry to the metadata of the target tables. This json object can contain a version as well allowing for evolution of this metadata in the future.

vinishjail97 commented 6 months ago

@the-other-tim-brown Can we close this issue ?