search

aiondemand / AIOD-rest-api

Services for the core of AIoD: Authentication and the metadata catalogue with REST API.
https://api.aiod.eu
MIT License
10 stars 7 forks source link

HuggingFace Dataset Connector: update existing resources #239

Open josvandervelde opened 9 months ago

josvandervelde commented 9 months ago

In Issue https://github.com/aiondemand/AIOD-rest-api/issues/131, we should make sure that connectors can, generically, handle updates.

Then we'll still have the problem that the HuggingFace connector doesn't know of any updates. With the current HuggingFace API, this isn't solvable, except if we periodically re-ingest all metadata.

The cleanest solution might be to create an issue on HuggingFace github, or even help contributing towards an extra endpoint?