polifonia-project / facets-search-engine

6 stars 0 forks source link

load data (UI and curl): add metadata by uploading json?? #78

Closed TiangeZhu closed 1 year ago

TiangeZhu commented 1 year ago

should we add a function for adding metadata to existing files by uploading json? if yes, codes should be modified in many places: process json in ScoreProcessing.py, and change metadata info in database + re-index document to ES

TiangeZhu commented 1 year ago

Q1: upload json for a single score - another module in load data called load metadata? Q2: json in a zip: is it json of the zip or json for specific score? Q3: when the metadata is also extract-able from scores, do we prioritize info from json?

TiangeZhu commented 1 year ago

added a module for uploading json, also allow including json in the zip. Every json should be named after the doc_id it is referring to, and we discard the concept of corpus metadata in neuma. There should not be a json that describes all the docs in one zip, for now.

TiangeZhu commented 1 year ago

5bbf053e753036fda5d5c69644e245f2dbb939a2 working for single json not yet for json in zip