hashgraph / hedera-mirror-node

Hedera Mirror Node archives data from consensus nodes and serves it via an API
Apache License 2.0
117 stars 110 forks source link

Chart install job fails consistently #8659

Open xin-hedera opened 4 days ago

xin-hedera commented 4 days ago

Description

The chart install job now fails consistently on rest-monitor test after /api/v1/status now returns 409 when there is any test failure:

Rest monitor pod log

2024-06-26T20:31:32.599Z INFO Finished test run #1 in 33311 ms
2024-06-26T20:32:32.602Z INFO Running test #2
2024-06-26T20:32:32.890Z ERROR schedule test #2 failed for kubernetes: schedules.length of 0 was expected to be 2
2024-06-26T20:32:33.488Z WARN Attempt #1 failed with  500, retry in 1000 ms: http://hedera-mirror-4urwbvk3i2-web3:80/api/v1/contracts/call
2024-06-26T20:32:33.786Z ERROR contract test #2 failed for kubernetes: logs.length of 0 was expected to be 2
2024-06-26T20:32:34.504Z WARN Attempt #2 failed with  500, retry in 1000 ms: http://hedera-mirror-4urwbvk3i2-web3:80/api/v1/contracts/call
2024-06-26T20:32:35.516Z WARN Attempt #3 failed with  500, retry in 1000 ms: http://hedera-mirror-4urwbvk3i2-web3:80/api/v1/contracts/call
2024-06-26T20:32:36.529Z WARN Attempt #4 failed with  500, retry in 1000 ms: http://hedera-mirror-4urwbvk3i2-web3:80/api/v1/contracts/call
2024-06-26T20:32:37.542Z WARN Attempt #5 failed with  500, retry in 1000 ms: http://hedera-mirror-4urwbvk3i2-web3:80/api/v1/contracts/call
2024-06-26T20:32:38.544Z ERROR contract test #2 failed for kubernetes: Retries exhausted with  500. Cause: undefined
2024-06-26T20:32:38.545Z INFO Completed test run #2 for kubernetes with 19/22 tests passed in 5943 ms
2024-06-26T20:32:38.545Z INFO Finished test run #2 in 5943 ms
2024-06-26T20:33:21.759Z INFO ::ffff:10.244.0.22 GET /api/v1/status returned 409: 19/22 tests passed

Rest monitor test pod log:

2024-06-26T20:33:28.2722530Z Connecting to hedera-mirror-4urwbvk3i2-rest-monitor:3000 (10.96.3.21:3000)
2024-06-26T20:33:28.2723632Z wget: server returned error: HTTP/1.1 409 Conflict

Steps to reproduce

Check Charts workflow runs: https://github.com/hashgraph/hedera-mirror-node/actions/workflows/charts.yml

Additional context

No response

Hedera network

other

Version

V0.109.0-SNAPSHOT

Operating system

None