inferno-framework / us-core-test-kit

Inferno Test Kit for evaluating API conformance to the US Core Implementation Guide
Apache License 2.0
7 stars 5 forks source link

Incorrect text in the "about" tab for validation tests #177

Open projkov opened 3 months ago

projkov commented 3 months ago

Hello. It looks like there is an inconsistency between the text in the "about" tab for each validation test and the implementation in the source code. Please correct me if I'm wrong.

Any validation test: "This test verifies that resources returned from the first search conform to the US Core Profile. Systems must demonstrate at least one valid example in order to pass this test."

For example, see here: GitHub Source.

According to the test source, it uses the "perform_validation_test" method: perform_validation_test.

According to the source of this method, it will fail if there is at least one invalid resource. This is inconsistent with the description of the test: Validation Test Source.

Summary: "At least one valid example in order to pass this test" is not the same as "all examples should be valid."