Tests in yaml

[MalinAhlberg]

Expressing compliance tests in yaml

This is a suggestion of how to translate the tests from python code into yaml. Test data is given in separate csv files. It is also possible (but not required) to give references to vcf files.

• An example of a test file.

• An example of test data.

  There is also a schema (also in yaml), describing what the tests should look like. Using this, one can easily verify that a newly added tests is correct (syntax-wise), by running python beacon_api_tester.py --validate_tests tests/test1.yaml

  Changes made

  Test data

• translate the tests from python code to yaml (as proof of concept)
• schema (tests/schema.yaml)
• optional vcf ref

• data for tests in separate files (tests/testdata.csv)

  Code

• code for running yaml tests

• code for testing that yaml tests complies with schema

  Addresses #32.

  Although there is still more job to do regarding the code updates for this, it would be nice to start a discussion about the format.

[mbaudis]

@MalinAhlberg This looks very nice! So the tests in YAML, and the data in testdata.csv, instead of the VCF?

[MalinAhlberg]

@mbaudis Yes, exactly. There is still a possibility to add a reference to a vcf line, in addition to the csv data (although we are still not sure about the details for that).