search

kaiiam / mifc

A minimum information standard checklist formalizing the description of food composition data and related metadata.
MIT License
2 stars 1 forks source link

Provide automation of CSV <-> YAML conversion and validation #15

Closed turbomam closed 1 week ago

turbomam commented 1 week ago

validation can be part of the conversion, so may not need to be executed separately

turbomam commented 1 week ago 
find . -name "*.yaml" | sort
./config.yaml
./data_validation/results/yaml/Component-001.yaml
./data_validation/results/yaml/Component-002.yaml
./data_validation/results/yaml/Component-003.yaml
./data_validation/results/yaml/Food-001.yaml
./data_validation/results/yaml/Food-002.yaml
./data_validation/results/yaml/Provenance-001.yaml
./examples/output/Container-Component-001.yaml
./examples/output/Container-Component-002.yaml
./examples/output/Container-Component-003.yaml
./examples/output/Container-Food-001.yaml
./examples/output/Container-Food-002.yaml
./examples/output/Container-Provenance-001.yaml
./.github/workflows/deploy-docs.yaml
./.github/workflows/main.yaml
./.github/workflows/pypi-publish.yaml
./project/prefixmap/mifc.yaml
./src/data/examples/invalid/Container-Food-001-illegal-primary-preservation.yaml
./src/data/examples/invalid/Container-Food-001-missing-component_id.yaml
./src/data/examples/valid/Container-Component-001.yaml
./src/data/examples/valid/Container-Component-002.yaml
./src/data/examples/valid/Container-Component-003.yaml
./src/data/examples/valid/Container-Food-001.yaml
./src/data/examples/valid/Container-Food-002.yaml
./src/data/examples/valid/Container-Provenance-001.yaml
./src/mifc/schema/mifc.yaml
./tmp/prefixmap/mifc.yaml
turbomam commented 1 week ago

I don't see ant CSV s

find . -name "*.csv" | wc -l

0

turbomam commented 1 week ago

But I do see TSV s

find . -name "*.tsv" | sort
./data_validation/test_data/Component-001.tsv
./data_validation/test_data/Component-002.tsv
./data_validation/test_data/Component-003.tsv
./data_validation/test_data/Food-001.tsv
./data_validation/test_data/Food-002.tsv
./data_validation/test_data/Provenance-001.tsv
turbomam commented 1 week ago

I will take data_validation/test_data/*.tsv as inputs

I suspect that I will be deleting ./data_validation/*.sh and replacing the functionality with targets in project.Makefile

turbomam commented 1 week ago

see also