search

nemoarchive / analytics

Repository for the NeMO Analytics project.
MIT License
1 stars 0 forks source link

JSON metadata flexibility- metadatavalidator.py/cron uploader #87

Closed apaala closed 3 years ago

apaala commented 4 years ago

The metadata validator rejects files that don't allow a very specific format. That might be hard to get everyone to do. Jayaram mentions Json Schema, which can help with that issue. (example of a scenario is when a field is given "" value.)

jkanche commented 4 years ago

a library to validate json schemas - https://json-schema.org/

They have implementations for different languages

apaala commented 4 years ago

@adkinsrs The metadata validator part of the process is highly specific and easily fails if the format is not exactly right. Since that will be hard to implement we want to make it more flexible. This script is part of the gear git.

adkinsrs commented 3 years ago

I am going to close for now. Given my experiences for loosening up restrictions for submissions on the NeMO Archive side and how that made more work for the analysts and myself, I would rather err on the side of keep validation script as it ensures the underlying code receives nothing out-of-the-ordinary.

If this is still an issue that should be addressed please either reopen the ticket or just create a new one.