search

indigo-dc / onedata

Indigo mirror of http://github.com/onedata/onedata
Apache License 2.0
1 stars 1 forks source link

Automatic metadata ingestion #19

Open evasciacca opened 7 years ago

evasciacca commented 7 years ago

We would like to understand how to automatize the insertion of extended metadata during OneData ingestion (metadata are stored on the file header). This task is fundamental in production to be executed by the OneData system instead instead of an external call from CDMI. Any hints?

Thank you in advance,

Eva.

xorver commented 7 years ago

We have plans to embed such functionality in onedata release, but not in the near future. To make it work, @groundnuty will provide you with a script running as a daemon connected to our changes stream REST API, that listens for newly created files, scans through file headers and inserts metadata. It will remain transparent for users.

Tomasz

evasciacca commented 7 years ago

Thank you very much. So I wait for the script in order to understand in which format you will need the metadata from the file headers? Please also send us documentation on how to configure and manage this script... Cheers, Eva.

evasciacca commented 7 years ago

Dear @xorver and @groundnuty , any news on this issue? Thank you in advance, Eva.