w3c / vc-di-eddsa-test-suite

Interoperability Test Suite for Data Integrity Eddsa 2022 Signatures.
https://w3c.github.io/vc-di-eddsa-test-suite/
BSD 3-Clause "New" or "Revised" License
2 stars 5 forks source link

Error: seedMultibase required #28

Closed HelgeKrueger closed 8 months ago

HelgeKrueger commented 9 months ago

Hi.

If I follow the instructions to run the tests, they fail with:

  eddsa-rdfc-2022 (create)
    ❌ "before all" hook in "eddsa-rdfc-2022 (create)"
    Error: seedMultibase required

This seems to be set by the environment variable KEY_SEED_DB. I have no idea what this could be.

aljones15 commented 9 months ago

KEY_SEED_DB is a base58 key seed used to sign the zcaps on our endpoint, my apologies about this we are looking into making the suites more resilient, unfortunately I don't think we can give you a KEY_SEED for the issuer and verifier endpoints, but we might be able to make the test ignore DB if there is no key seed set. you can try setting it to a random string, but that might not result in the test suite running with out DB.

aljones15 commented 9 months ago

@HelgeKrueger sorry after a little review it turns out the vc-generator is local so you can use this key seed: z1AYMku6XEB5KV3XJbYzz9VejGJYRuqzu5wmq4JDRyUCjr8

I added a branch here: https://github.com/w3c/vc-di-eddsa-test-suite/tree/use-local-issuer-for-test-data that adds that key seed automatically. Sadly because of the holidays this issue will probably not be addressed til next week, but that should get a basic test suite going (I'm seeing 77% pass in that branch with no env variables set). If you run into that issue in other suites that seed should work as a DB seed, but will not give you access to our APIs.

HelgeKrueger commented 9 months ago

Thanks for the information. With the key seed, I can also run some 78% of tests successfully.

Unfortunately, I think I'm still missing something. I was hoping for a way to just execute local tests, see https://github.com/w3c/vc-test-suite-implementations#testing-locally

So something like create localImplementationsConfig.cjs and then only calls to localhost are done. Is a functionality like that planned?

JSAssassin commented 8 months ago

@HelgeKrueger You should be able to run the tests only against local implementations. After adding the config file, you can update the tags in the test suite (https://github.com/w3c/vc-di-eddsa-test-suite/blob/main/tests/10-rdfc-create.js#L16, https://github.com/w3c/vc-di-eddsa-test-suite/blob/main/tests/20-rdfc-verify.js#L14 and https://github.com/w3c/vc-di-eddsa-test-suite/blob/main/tests/30-rdfc-interop.js#L10) that is used to filter implementations to use a specific tag that is in your config file. See - https://github.com/w3c/vc-test-suite-implementations/pull/10/files

HelgeKrueger commented 8 months ago

Thanks! I got it working now.