search

komparo / certigo

GNU General Public License v3.0
0 stars 0 forks source link

Output validation #11

Closed zouter closed 6 years ago

zouter commented 6 years ago

The output should not only be checked on its presence, but also on its format. Whether the format is checked when running the workflow can be something optional.

It is required for testing however.

When a format fails, useful information messages should be printed.

Formats should be defined beforehand. Eg. as an R package.

Default format = just presence of the file Than go further

zouter commented 6 years ago

The best way to organise this is to extend the DerivedFile class I think

zouter commented 6 years ago

JSON Schema: http://json-schema.org/ https://github.com/jessedc/ajv-cli

zouter commented 6 years ago

One issue however currently: how to support validation between outputs/inputs? Eg. if you have a dataset as input, and a model as output. The model output should know that there was a dataset as input, etc...