search

open-metadata / OpenMetadata

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.
https://open-metadata.org
Apache License 2.0
5.46k stars 1.03k forks source link

Inquiry about managing custom AI datasets #18258

Open Ryannn41 opened 2 weeks ago

Ryannn41 commented 2 weeks ago

Dear Developers,

I have a question regarding managing custom AI datasets. Specifically, I was wondering if it is possible to manage our own AI datasets using your framework, and if so, what form or method would be recommended for this management?

Looking forward to your response.

harshach commented 2 weeks ago

@Ryannn41 can you add more details what are these AI data assets and what constitute an AI data asset. Would be good to see how we can model that.

Ryannn41 commented 2 weeks ago

@harshach Just like the webpage https://www.modelscope.cn/datasets/MuGeminorum/HEp2 manages datasets, where the dataset is essentially a collection of files, and on the webpage, there are different tabs to manage dataset files: https://www.modelscope.cn/datasets/MuGeminorum/HEp2/files.