openwallet-foundation / owl-agent-test-harness

Aries agent test framework, with agent backchannel support
https://aries-interop.info
Apache License 2.0
60 stars 66 forks source link

The example test fails on MacBook M1 #554

Closed YoungeonLee closed 9 months ago

YoungeonLee commented 2 years ago

The example

git clone https://github.com/hyperledger/aries-agent-test-harness
cd aries-agent-test-harness
./manage build -a acapy -a dotnet
./manage run -d acapy -b dotnet -t @AcceptanceTest -t ~@wip

does not work consistently on MacBook M1. For every try, I ran ./manage stop then ./manage run -d acapy -b dotnet -t @AcceptanceTest -t ~@wip I also had to change AGENT_TIMEOUT and LEDGER_TIMEOUT variables to a very large number in manage script because the services would take a significantly longer time to spin up.

Environment:

Log and Errors

Previously, some acapy containers would fail as well, but I couldn't reproduce it this time (I used an older version of Docker Desktop when this happened)

Rob-S commented 1 year ago

For me, 13 scenarios failed on MacBook M1:

Failing scenarios:
  features/0023-did-exchange.feature:45  Establish a connection with DID Exchange between two agents with an implicit invitation
  features/0025-didcomm-transports.feature:28  Create DIDExchange connection between two agents with overlapping transports -- @2.1 DIDExchange connection with both agents using WS for inbound and outbound transport
  features/0211-coordinate-mediation.feature:106  Two agents creating a connection using a mediator without having inbound transports -- @1.1 Acme and Faber creating a DIDExchange connection using Bob as a mediator without having inbound transports
  features/0211-coordinate-mediation.feature:111  Two agents creating a connection using a mediator without having inbound transports -- @2.1 Acme and Faber creating a 0160 connection using Bob as a mediator without having inbound transports
  features/0453-issue-credential-v2.feature:58  Issue a JSON-LD credential with the Holder beginning with a proposal -- @3.1 
  features/0453-issue-credential-v2.feature:63  Issue a JSON-LD credential with the Holder beginning with a proposal -- @4.1 
  features/0453-issue-credential-v2.feature:68  Issue a JSON-LD credential with the Holder beginning with a proposal -- @5.1 
  features/0454-present-proof-v2.feature:31  Present Proof of specific types and proof is acknowledged with a Drivers License credential type with a DID Exchange Connection -- @3.1 
  features/0454-present-proof-v2.feature:36  Present Proof of specific types and proof is acknowledged with a Drivers License credential type with a DID Exchange Connection -- @4.1 
  features/0454-present-proof-v2.feature:41  Present Proof of specific types and proof is acknowledged with a Drivers License credential type with a DID Exchange Connection -- @5.1 
  features/0454-present-proof-v2.feature:70  Present Proof of specific types and proof is acknowledged with a Citizenship credential type with a DID Exchange Connection -- @2.1 
  features/0454-present-proof-v2.feature:75  Present Proof of specific types and proof is acknowledged with a Citizenship credential type with a DID Exchange Connection -- @3.1 
  features/0454-present-proof-v2.feature:80  Present Proof of specific types and proof is acknowledged with a Citizenship credential type with a DID Exchange Connection -- @4.1 

5 features passed, 5 failed, 4 skipped
82 scenarios passed, 13 failed, 58 skipped
701 steps passed, 13 failed, 606 skipped, 0 undefined

Environment: MacBook Pro Chip: Apple M1 Max macOS Ventura: Version 13.3.1 (a) (22E772610a)

When time permits, I will try to verify if there are issues in ACA-Py, specific to Apple M1 silicon or otherwise and create the appropriate Issues, vs. something going on with the Test Harness.

esune commented 1 year ago

Relates to #713