search

decentralized-identity / JWS-Test-Suite

JsonWebSignature2020 Test Suite
https://identity.foundation/JWS-Test-Suite
Apache License 2.0
9 stars 11 forks source link

Add ability to test verification with multiple vendors #19

Open OR13 opened 3 years ago

OR13 commented 3 years ago

Partially implemented... ideally every implementation verifies all test vectors.

clehner commented 2 years ago

ideally every implementation verifies all test vectors

I think this would be good. The report structure would need to be changed, e.g. either to replace each current pass/fail/none with a vector of pass/fail/none for each implementation; or so that each section is a matrix of implementation-implementation results for a particular test vector and signature alg/type.

An alternative approach that could be simpler may be to continue the pattern that was started as an expedient in #31, to effectively delegate each signature/proof type to a particular verifier implementation. But this does create an ambiguity where failures that are implementation-specific may appear to signature-type-specific, e.g. as seen in #52, which could be confusing.