cardano-scaling / hydra

Implementation of the Hydra Head protocol
https://hydra.family/head-protocol/
Apache License 2.0
274 stars 84 forks source link

Use the github revision to name binaries from PRs #1583

Closed ch1bo closed 2 weeks ago

ch1bo commented 3 weeks ago

The binaries action was yielding an empty VERSION when built on pull_request triggers because how Github checks out pull requests. For example: https://github.com/cardano-scaling/hydra/actions/runs/10510022466/job/29121321565#step:5:29

This now uses git describe HEAD which should just work (tm) on both, branches, tags and PRs.

Before: image

After: image


github-actions[bot] commented 3 weeks ago

Transaction costs

Sizes and execution budgets for Hydra protocol transactions. Note that unlisted parameters are currently using arbitrary values and results are not fully deterministic and comparable to previous runs.

Metadata
Generated at 2024-08-26 17:17:26.927885721 UTC
Max. memory units 14000000
Max. CPU units 10000000000
Max. tx size (kB) 16384

Script summary

Name Hash Size (Bytes)
νInitial 2fac819a1f4f14e29639d1414220d2a18b6abd6b8e444d88d0dda8ff 3799
νCommit 2043a9f1a685bcf491413a5f139ee42e335157c8c6bc8d9e4018669d 1743
νHead bd9fad235c871fb7f837c767593018a84be3083ff80f9dab5f1c55f9 10194
μHead c8038945816586c4d38926ee63bba67821eb863794220ebbd0bf79ee* 4607
Parties Tx size % max Mem % max CPU Min fee ₳
1 5189 5.71 2.25 0.44
2 5390 6.99 2.76 0.46
3 5590 8.37 3.30 0.49
5 5991 11.45 4.53 0.54
10 6999 18.02 7.12 0.66
56 16247 81.43 32.21 1.76

Commit transaction costs

This uses ada-only outputs for better comparability.

UTxO Tx size % max Mem % max CPU Min fee ₳
1 559 10.52 4.15 0.29
2 745 13.86 5.65 0.34
3 934 17.33 7.20 0.38
5 1307 24.65 10.44 0.48
10 2243 45.22 19.36 0.75
20 4123 95.99 40.76 1.40

CollectCom transaction costs

Parties UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
1 57 549 21.46 8.41 0.41
2 114 659 33.86 13.39 0.55
3 170 769 45.28 18.14 0.68
4 227 883 59.60 24.05 0.84
5 281 989 75.04 30.51 1.02
6 336 1100 97.82 39.81 1.28

Cost of Decrement Transaction

Parties Tx size % max Mem % max CPU Min fee ₳
1 631 17.96 7.88 0.38
2 832 20.26 9.50 0.42
3 913 20.43 10.32 0.43
5 1360 27.27 14.37 0.53
10 2009 33.93 20.63 0.66
49 7824 95.90 73.14 1.80

Close transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 658 21.02 9.42 0.42
2 824 22.82 11.12 0.45
3 931 23.84 12.18 0.47
5 1290 27.58 15.65 0.54
10 2164 36.68 24.10 0.72
50 8141 98.82 83.96 1.91

Contest transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 673 27.18 11.68 0.48
2 818 28.94 13.20 0.52
3 1028 31.55 15.37 0.56
5 1327 34.99 18.37 0.62
10 2020 43.91 26.04 0.78
38 6320 97.33 72.06 1.73

Abort transaction costs

There is some variation due to the random mixture of initial and already committed outputs.

Parties Tx size % max Mem % max CPU Min fee ₳
1 5076 17.47 7.60 0.57
2 5137 24.98 10.81 0.66
3 5352 42.69 18.88 0.87
4 5436 57.15 25.26 1.03
5 5528 73.96 32.80 1.23
6 5776 93.76 41.73 1.46

FanOut transaction costs

Involves spending head output and burning head tokens. Uses ada-only UTxO for better comparability.

Parties UTxO UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
5 0 0 5022 7.95 3.36 0.46
5 1 57 5056 8.88 3.99 0.47
5 5 285 5192 13.41 6.84 0.54
5 10 569 5362 18.87 10.31 0.61
5 20 1136 5698 30.38 17.51 0.77
5 30 1706 6041 42.10 24.80 0.94
5 40 2276 6380 53.03 31.76 1.09
5 50 2845 6719 63.97 38.72 1.24
5 81 4616 7777 99.53 61.01 1.74

End-to-end benchmark results

This page is intended to collect the latest end-to-end benchmark results produced by Hydra's continuous integration (CI) system from the latest master code.

Please note that these results are approximate as they are currently produced from limited cloud VMs and not controlled hardware. Rather than focusing on the absolute results, the emphasis should be on relative results, such as how the timings for a scenario evolve as the code changes.

Generated at 2024-08-26 17:19:26.344696694 UTC

Baseline Scenario

Number of nodes 1
Number of txs 3000
Avg. Confirmation Time (ms) 5.036339756
P99 9.209138989999994ms
P95 6.103635699999996ms
P50 4.4265675ms
Number of Invalid txs 0

Three local nodes

Number of nodes 3
Number of txs 9000
Avg. Confirmation Time (ms) 23.422675434
P99 112.90784177000012ms
P95 32.11890279999999ms
P50 21.041046ms
Number of Invalid txs 0
github-actions[bot] commented 3 weeks ago

Test Results

469 tests  ±0   462 :white_check_mark: ±0   17m 34s :stopwatch: +35s 150 suites ±0     7 :zzz: ±0    5 files   ±0     0 :x: ±0 

Results for commit b5253bc3. ± Comparison against base commit 16c87520.