search

open-metadata / OpenMetadata

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.
https://open-metadata.org
Apache License 2.0
5.51k stars 1.04k forks source link

Ingest API Metadata -> wsdl, openapi, odata metadata #18409

Open fuzolan opened 2 weeks ago

fuzolan commented 2 weeks ago

Not everything is stored in a database with access. Although a lot of data is available through api. Documentation is crucial here. Although there are standards like wsdl, openapi or odata which contains a lot of meta data. I wonder there is no adapter for it!

sushi30 commented 2 weeks ago

Hi @fuzolan. Can you provide more information? What are trying to ingest from OpenMetadata and where can we find more information about these systems?

fuzolan commented 2 weeks ago

https://swagger.io/specification/ https://www.w3schools.com/xml/xml_wsdl.asp https://www.odata.org/blog/queryable-odata-metadata/

Metadata from most soap-services you can get with {URI}?wsdl From odata it is often {URI}{ressource}/$metadata And from REST-Endpoints you can get often an OPENAPI Spec file in json or yml.

It might also help to have a file ingester for these types.

What i like to ingest are the data models and types and endpoint of that api. It would also be nice to see the lineage between the database objects and API Endpoints. In most cases there are differences here. So it would be a great benefit for transparency.