cardano-scaling / hydra

Implementation of the Hydra Head protocol
https://hydra.family/head-protocol/
Apache License 2.0
274 stars 84 forks source link

Use github hosted ARM64 based MacOS runners in binaries workflow #1568

Closed ch1bo closed 4 weeks ago

ch1bo commented 4 weeks ago

Our self-hosted runner is stuck and I wondered why we just not use the new macos arm64 runners of github?

Let's see if the binaries job works on this and produces an artifact. @ffakenz would be good if you could give them a try on your machine.


github-actions[bot] commented 4 weeks ago

Transaction costs

Sizes and execution budgets for Hydra protocol transactions. Note that unlisted parameters are currently using arbitrary values and results are not fully deterministic and comparable to previous runs.

Metadata
Generated at 2024-08-15 17:17:50.588373066 UTC
Max. memory units 14000000
Max. CPU units 10000000000
Max. tx size (kB) 16384

Script summary

Name Hash Size (Bytes)
νInitial 2fac819a1f4f14e29639d1414220d2a18b6abd6b8e444d88d0dda8ff 3799
νCommit 2043a9f1a685bcf491413a5f139ee42e335157c8c6bc8d9e4018669d 1743
νHead bd9fad235c871fb7f837c767593018a84be3083ff80f9dab5f1c55f9 10194
μHead c8038945816586c4d38926ee63bba67821eb863794220ebbd0bf79ee* 4607
Parties Tx size % max Mem % max CPU Min fee ₳
1 5186 5.61 2.21 0.44
2 5390 7.18 2.84 0.47
3 5590 8.78 3.48 0.49
5 5993 11.22 4.43 0.54
10 7003 18.11 7.16 0.66
56 16246 81.63 32.29 1.76

Commit transaction costs

This uses ada-only outputs for better comparability.

UTxO Tx size % max Mem % max CPU Min fee ₳
1 559 10.52 4.15 0.29
2 745 13.86 5.65 0.34
3 935 17.33 7.20 0.38
5 1313 24.65 10.44 0.48
10 2244 45.22 19.36 0.75
20 4107 95.99 40.76 1.40

CollectCom transaction costs

Parties UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
1 57 549 21.46 8.41 0.41
2 113 659 32.28 12.81 0.53
3 170 769 47.62 19.01 0.71
4 226 879 62.39 25.09 0.87
5 283 989 72.25 29.48 0.99
6 340 1104 98.72 40.17 1.29

Cost of Decrement Transaction

Parties Tx size % max Mem % max CPU Min fee ₳
1 622 17.93 7.87 0.38
2 810 20.30 9.51 0.42
3 966 21.54 10.74 0.44
5 1264 25.10 13.57 0.51
10 1881 30.45 19.26 0.62
49 7788 94.19 72.48 1.78

Close transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 672 20.98 9.41 0.42
2 830 22.83 11.12 0.45
3 1016 24.54 12.73 0.49
5 1273 27.24 15.37 0.54
10 2054 36.22 23.68 0.70
49 7853 97.46 82.12 1.88

Contest transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 628 26.76 11.34 0.48
2 817 28.94 13.20 0.52
3 936 30.72 14.69 0.55
5 1391 35.44 18.74 0.63
10 2198 45.31 27.22 0.81
38 6165 96.72 71.21 1.72

Abort transaction costs

There is some variation due to the random mixture of initial and already committed outputs.

Parties Tx size % max Mem % max CPU Min fee ₳
1 5063 17.43 7.58 0.57
2 5232 29.46 12.98 0.71
3 5219 34.01 14.72 0.76
4 5509 59.70 26.52 1.07
5 5596 75.70 33.64 1.25

FanOut transaction costs

Involves spending head output and burning head tokens. Uses ada-only UTxO for better comparability.

Parties UTxO UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
5 0 0 5022 7.56 3.20 0.46
5 1 57 5056 8.88 3.99 0.47
5 5 284 5191 13.60 6.92 0.54
5 10 569 5361 19.06 10.39 0.62
5 20 1139 5701 30.38 17.51 0.77
5 30 1706 6041 41.90 24.72 0.93
5 40 2280 6384 52.84 31.67 1.09
5 50 2844 6719 64.76 39.06 1.25
5 81 4614 7776 99.53 61.01 1.74

End-to-end benchmark results

This page is intended to collect the latest end-to-end benchmark results produced by Hydra's continuous integration (CI) system from the latest master code.

Please note that these results are approximate as they are currently produced from limited cloud VMs and not controlled hardware. Rather than focusing on the absolute results, the emphasis should be on relative results, such as how the timings for a scenario evolve as the code changes.

Generated at 2024-08-15 17:20:16.362817947 UTC

Baseline Scenario

Number of nodes 1
Number of txs 3000
Avg. Confirmation Time (ms) 4.918251378
P99 10.942391249999995ms
P95 6.890481999999998ms
P50 4.5391195ms
Number of Invalid txs 0

Three local nodes

Number of nodes 3
Number of txs 9000
Avg. Confirmation Time (ms) 24.283682903
P99 59.369522790000175ms
P95 33.14124344999998ms
P50 22.147585ms
Number of Invalid txs 0
github-actions[bot] commented 4 weeks ago

Test Results

469 tests  ±0   462 :white_check_mark: ±0   17m 42s :stopwatch: -21s 150 suites ±0     7 :zzz: ±0    5 files   ±0     0 :x: ±0 

Results for commit 46f5aa4f. ± Comparison against base commit 8d8d3a36.

:recycle: This comment has been updated with latest results.

ch1bo commented 4 weeks ago

@ffakenz reported that these binaries work on his machine. Merging it.