Closed plebhash closed 2 months ago
Report | Wed, August 28, 2024 at 17:23:04 UTC |
Project | Stratum v2 (SRI) |
Branch | stop-publishing-some-crates |
Testbed | sv1 |
Benchmark | Estimated Cycles | Estimated Cycles Results estimated cycles | (Δ%) | Estimated Cycles Upper Boundary estimated cycles | (%) | Instructions | Instructions Results instructions | (Δ%) | Instructions Upper Boundary instructions | (%) | L1 Accesses | L1 Accesses Results accesses | (Δ%) | L1 Accesses Upper Boundary accesses | (%) | L2 Accesses | L2 Accesses Results accesses | (Δ%) | L2 Accesses Upper Boundary accesses | (%) | RAM Accesses | RAM Accesses Results accesses | (Δ%) | RAM Accesses Upper Boundary accesses | (%) |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
get_authorize | ✅ (view plot) | 8,507.00 (+0.81%) | 8,739.54 (97.34%) | ✅ (view plot) | 3,772.00 (+0.77%) | 3,862.66 (97.65%) | ✅ (view plot) | 5,297.00 (+0.89%) | 5,413.53 (97.85%) | ✅ (view plot) | 5.00 (-33.33%) | 10.60 (47.17%) | ✅ (view plot) | 91.00 (+1.08%) | 94.16 (96.65%) |
get_submit | ✅ (view plot) | 95,684.00 (+0.12%) | 96,154.03 (99.51%) | ✅ (view plot) | 59,522.00 (+0.08%) | 59,768.84 (99.59%) | ✅ (view plot) | 85,499.00 (+0.09%) | 85,827.91 (99.62%) | ✅ (view plot) | 49.00 (-9.28%) | 62.91 (77.89%) | ✅ (view plot) | 284.00 (+0.66%) | 288.77 (98.35%) |
get_subscribe | ✅ (view plot) | 8,068.00 (+1.06%) | 8,294.30 (97.27%) | ✅ (view plot) | 2,848.00 (+0.65%) | 2,944.71 (96.72%) | ✅ (view plot) | 3,983.00 (+0.72%) | 4,107.60 (96.97%) | ✅ (view plot) | 12.00 (-21.43%) | 21.02 (57.08%) | ✅ (view plot) | 115.00 (+1.84%) | 117.70 (97.71%) |
serialize_authorize | ✅ (view plot) | 12,358.00 (+1.10%) | 12,552.40 (98.45%) | ✅ (view plot) | 5,343.00 (+0.54%) | 5,433.66 (98.33%) | ✅ (view plot) | 7,458.00 (+0.61%) | 7,576.05 (98.44%) | ✅ (view plot) | 7.00 (-31.76%) | 13.86 (50.52%) | ✅ (view plot) | 139.00 (+2.21%) | 141.45 (98.27%) |
serialize_deserialize_authorize | ✅ (view plot) | 24,636.00 (+0.59%) | 24,760.95 (99.50%) | ✅ (view plot) | 9,950.00 (+0.44%) | 10,037.58 (99.13%) | ✅ (view plot) | 14,051.00 (+0.52%) | 14,170.60 (99.16%) | ✅ (view plot) | 31.00 (-13.45%) | 42.22 (73.42%) | ✅ (view plot) | 298.00 (+0.94%) | 298.87 (99.71%) |
serialize_deserialize_handle_authorize | ✅ (view plot) | 30,236.00 (+0.28%) | 30,387.70 (99.50%) | ✅ (view plot) | 12,127.00 (+0.24%) | 12,217.66 (99.26%) | ✅ (view plot) | 17,166.00 (+0.25%) | 17,290.82 (99.28%) | ✅ (view plot) | 59.00 (+1.33%) | 64.46 (91.53%) | ✅ (view plot) | 365.00 (+0.30%) | 367.61 (99.29%) |
serialize_deserialize_handle_submit | ✅ (view plot) | 126,605.00 (+0.14%) | 127,073.46 (99.63%) | ✅ (view plot) | 73,307.00 (+0.07%) | 73,610.86 (99.59%) | ✅ (view plot) | 105,095.00 (+0.09%) | 105,505.42 (99.61%) | ✅ (view plot) | 109.00 (-7.73%) | 132.75 (82.11%) | ✅ (view plot) | 599.00 (+0.63%) | 601.54 (99.58%) |
serialize_deserialize_handle_subscribe | ✅ (view plot) | 27,580.00 (+0.42%) | 27,670.15 (99.67%) | ✅ (view plot) | 9,650.00 (+0.19%) | 9,746.71 (99.01%) | ✅ (view plot) | 13,650.00 (+0.19%) | 13,781.87 (99.04%) | ✅ (view plot) | 63.00 (-3.53%) | 73.37 (85.87%) | ✅ (view plot) | 389.00 (+0.74%) | 389.96 (99.75%) |
serialize_deserialize_submit | ✅ (view plot) | 115,367.00 (+0.21%) | 115,717.17 (99.70%) | ✅ (view plot) | 68,167.00 (+0.13%) | 68,407.06 (99.65%) | ✅ (view plot) | 97,842.00 (+0.16%) | 98,169.12 (99.67%) | ✅ (view plot) | 61.00 (-10.49%) | 76.95 (79.27%) | ✅ (view plot) | 492.00 (+0.71%) | 494.46 (99.50%) |
serialize_deserialize_subscribe | ✅ (view plot) | 23,054.00 (+0.68%) | 23,176.55 (99.47%) | ✅ (view plot) | 8,209.00 (+0.27%) | 8,303.28 (98.86%) | ✅ (view plot) | 11,564.00 (+0.28%) | 11,691.00 (98.91%) | ✅ (view plot) | 37.00 (-4.94%) | 44.10 (83.90%) | ✅ (view plot) | 323.00 (+1.20%) | 323.74 (99.77%) |
serialize_submit | ✅ (view plot) | 100,091.00 (+0.17%) | 100,505.52 (99.59%) | ✅ (view plot) | 61,566.00 (+0.07%) | 61,817.51 (99.59%) | ✅ (view plot) | 88,346.00 (+0.09%) | 88,680.88 (99.62%) | ✅ (view plot) | 46.00 (-15.03%) | 64.54 (71.28%) | ✅ (view plot) | 329.00 (+1.17%) | 331.75 (99.17%) |
serialize_subscribe | ✅ (view plot) | 11,507.00 (+1.39%) | 11,670.45 (98.60%) | ✅ (view plot) | 4,195.00 (+0.44%) | 4,291.71 (97.75%) | ✅ (view plot) | 5,837.00 (+0.43%) | 5,965.59 (97.84%) | ✅ (view plot) | 14.00 (-10.98%) | 19.86 (70.48%) | ✅ (view plot) | 160.00 (+2.59%) | 161.82 (98.88%) |
Report | Wed, August 28, 2024 at 17:22:50 UTC |
Project | Stratum v2 (SRI) |
Branch | 1151/merge |
Testbed | sv1 |
Benchmark | Latency | Latency Results nanoseconds (ns) | (Δ%) | Latency Upper Boundary nanoseconds (ns) | (%) |
---|---|---|---|
client-submit-serialize | ✅ (view plot) | 6,434.80 (-6.19%) | 7,370.27 (87.31%) |
client-submit-serialize-deserialize | ✅ (view plot) | 7,421.30 (-4.66%) | 8,347.07 (88.91%) |
client-submit-serialize-deserialize-handle/client-submit-serialize-deserialize-handle | ✅ (view plot) | 7,992.70 (-4.37%) | 8,853.01 (90.28%) |
client-sv1-authorize-serialize-deserialize-handle/client-sv1-authorize-serialize-deserialize-handle | ✅ (view plot) | 911.32 (+1.24%) | 928.25 (98.18%) |
client-sv1-authorize-serialize-deserialize/client-sv1-authorize-serialize-deserialize | ✅ (view plot) | 710.87 (+1.59%) | 722.00 (98.46%) |
client-sv1-authorize-serialize/client-sv1-authorize-serialize | ✅ (view plot) | 253.20 (+1.79%) | 256.11 (98.86%) |
client-sv1-get-authorize/client-sv1-get-authorize | ✅ (view plot) | 157.07 (-0.01%) | 161.82 (97.06%) |
client-sv1-get-submit | ✅ (view plot) | 6,241.60 (-5.98%) | 7,135.48 (87.47%) |
client-sv1-get-subscribe/client-sv1-get-subscribe | ✅ (view plot) | 277.05 (-0.56%) | 289.94 (95.55%) |
client-sv1-subscribe-serialize-deserialize-handle/client-sv1-subscribe-serialize-deserialize-handle | ✅ (view plot) | 744.65 (-0.68%) | 779.32 (95.55%) |
client-sv1-subscribe-serialize-deserialize/client-sv1-subscribe-serialize-deserialize | ✅ (view plot) | 598.49 (-2.51%) | 636.85 (93.98%) |
client-sv1-subscribe-serialize/client-sv1-subscribe-serialize | ✅ (view plot) | 203.15 (-1.80%) | 219.10 (92.72%) |
Report | Wed, August 28, 2024 at 17:23:03 UTC |
Project | Stratum v2 (SRI) |
Branch | stop-publishing-some-crates |
Testbed | sv2 |
🚨 1 ALERT: Threshold Boundary Limit exceeded!
Benchmark | Measure (units) | View | Value | Lower Boundary | Upper Boundary |
---|---|---|---|---|---|
client_sv2_setup_connection_serialize_deserialize | Latency (nanoseconds (ns)) | 🚨 (view plot | view alert) | 1,273.60 (+30.50%) | 1,079.82 (117.95%) |
Benchmark | Latency | Latency Results nanoseconds (ns) | (Δ%) | Latency Upper Boundary nanoseconds (ns) | (%) |
---|---|---|---|
client_sv2_handle_message_common | ✅ (view plot) | 45.27 (+1.46%) | 45.46 (99.58%) |
client_sv2_handle_message_mining | ✅ (view plot) | 72.61 (-0.73%) | 80.57 (90.12%) |
client_sv2_mining_message_submit_standard | ✅ (view plot) | 14.69 (+0.24%) | 14.70 (99.93%) |
client_sv2_mining_message_submit_standard_serialize | ✅ (view plot) | 281.75 (+5.98%) | 286.03 (98.50%) |
client_sv2_mining_message_submit_standard_serialize_deserialize | ✅ (view plot) | 580.77 (-2.09%) | 625.05 (92.92%) |
client_sv2_open_channel | ✅ (view plot) | 162.15 (-2.02%) | 171.05 (94.80%) |
client_sv2_open_channel_serialize | ✅ (view plot) | 283.05 (+0.05%) | 293.48 (96.45%) |
client_sv2_open_channel_serialize_deserialize | ✅ (view plot) | 375.66 (-0.45%) | 419.34 (89.58%) |
client_sv2_setup_connection | ✅ (view plot) | 159.70 (-2.31%) | 174.23 (91.66%) |
client_sv2_setup_connection_serialize | ✅ (view plot) | 475.32 (+0.38%) | 502.68 (94.56%) |
client_sv2_setup_connection_serialize_deserialize | 🚨 (view plot | view alert) | 1,273.60 (+30.50%) | 1,079.82 (117.95%) |
Report | Wed, August 28, 2024 at 17:23:01 UTC |
Project | Stratum v2 (SRI) |
Branch | stop-publishing-some-crates |
Testbed | sv2 |
🚨 4 ALERTS: Threshold Boundary Limits exceeded!
Benchmark | Measure (units) | View | Value | Lower Boundary | Upper Boundary |
---|---|---|---|---|---|
client_sv2_handle_message_common | L2 Accesses (accesses) | 🚨 (view plot | view alert) | 12.00 (+63.40%) | 11.73 (102.27%) | |
client_sv2_mining_message_submit_standard | L2 Accesses (accesses) | 🚨 (view plot | view alert) | 23.00 (+31.08%) | 22.49 (102.26%) | |
client_sv2_mining_message_submit_standard_serialize_deserialize | Instructions (instructions) | 🚨 (view plot | view alert) | 10,591.00 (+0.39%) | 10,590.56 (100.00%) | |
client_sv2_open_channel_serialize_deserialize | L2 Accesses (accesses) | 🚨 (view plot | view alert) | 85.00 (+14.91%) | 83.00 (102.41%) |
Benchmark | Estimated Cycles | Estimated Cycles Results estimated cycles | (Δ%) | Estimated Cycles Upper Boundary estimated cycles | (%) | Instructions | Instructions Results instructions | (Δ%) | Instructions Upper Boundary instructions | (%) | L1 Accesses | L1 Accesses Results accesses | (Δ%) | L1 Accesses Upper Boundary accesses | (%) | L2 Accesses | L2 Accesses Results accesses | (Δ%) | L2 Accesses Upper Boundary accesses | (%) | RAM Accesses | RAM Accesses Results accesses | (Δ%) | RAM Accesses Upper Boundary accesses | (%) |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
client_sv2_handle_message_common | ✅ (view plot) | 2,119.00 (+2.99%) | 2,139.66 (99.03%) | ✅ (view plot) | 473.00 (+0.39%) | 485.72 (97.38%) | ✅ (view plot) | 729.00 (-0.44%) | 753.46 (96.75%) | 🚨 (view plot | view alert) | 12.00 (+63.40%) | 11.73 (102.27%) | ✅ (view plot) | 38.00 (+3.23%) | 38.80 (97.93%) |
client_sv2_handle_message_mining | ✅ (view plot) | 8,251.00 (+0.57%) | 8,337.18 (98.97%) | ✅ (view plot) | 2,143.00 (+0.62%) | 2,171.81 (98.67%) | ✅ (view plot) | 3,166.00 (+0.56%) | 3,216.04 (98.44%) | ✅ (view plot) | 37.00 (-2.59%) | 43.29 (85.48%) | ✅ (view plot) | 140.00 (+0.70%) | 142.02 (98.58%) |
client_sv2_mining_message_submit_standard | ✅ (view plot) | 6,344.00 (+1.00%) | 6,390.58 (99.27%) | ✅ (view plot) | 1,756.00 (+0.31%) | 1,764.28 (99.53%) | ✅ (view plot) | 2,554.00 (-0.03%) | 2,575.60 (99.16%) | 🚨 (view plot | view alert) | 23.00 (+31.08%) | 22.49 (102.26%) | ✅ (view plot) | 105.00 (+1.01%) | 106.88 (98.24%) |
client_sv2_mining_message_submit_standard_serialize | ✅ (view plot) | 14,843.00 (+0.39%) | 15,023.21 (98.80%) | ✅ (view plot) | 4,700.00 (+0.11%) | 4,708.28 (99.82%) | ✅ (view plot) | 6,758.00 (+0.03%) | 6,775.69 (99.74%) | ✅ (view plot) | 49.00 (+4.32%) | 51.42 (95.30%) | ✅ (view plot) | 224.00 (+0.58%) | 229.63 (97.55%) |
client_sv2_mining_message_submit_standard_serialize_deserialize | ✅ (view plot) | 27,625.00 (+0.47%) | 27,843.98 (99.21%) | 🚨 (view plot | view alert) | 10,591.00 (+0.39%) | 10,590.56 (100.00%) | ✅ (view plot) | 15,405.00 (+0.36%) | 15,408.10 (99.98%) | ✅ (view plot) | 85.00 (+2.20%) | 88.73 (95.80%) | ✅ (view plot) | 337.00 (+0.55%) | 344.85 (97.72%) |
client_sv2_open_channel | ✅ (view plot) | 4,361.00 (-2.48%) | 4,630.02 (94.19%) | ✅ (view plot) | 1,461.00 (+0.04%) | 1,473.54 (99.15%) | ✅ (view plot) | 2,156.00 (+0.12%) | 2,172.51 (99.24%) | ✅ (view plot) | 14.00 (+15.76%) | 15.14 (92.44%) | ✅ (view plot) | 61.00 (-5.45%) | 68.95 (88.47%) |
client_sv2_open_channel_serialize | ✅ (view plot) | 14,080.00 (-0.83%) | 14,447.99 (97.45%) | ✅ (view plot) | 5,064.00 (+0.01%) | 5,076.54 (99.75%) | ✅ (view plot) | 7,325.00 (+0.08%) | 7,339.99 (99.80%) | ✅ (view plot) | 35.00 (-4.56%) | 41.30 (84.74%) | ✅ (view plot) | 188.00 (-1.73%) | 198.43 (94.74%) |
client_sv2_open_channel_serialize_deserialize | ✅ (view plot) | 22,697.00 (+0.23%) | 22,998.10 (98.69%) | ✅ (view plot) | 8,027.00 (+0.46%) | 8,027.74 (99.99%) | ✅ (view plot) | 11,667.00 (+0.38%) | 11,674.48 (99.94%) | 🚨 (view plot | view alert) | 85.00 (+14.91%) | 83.00 (102.41%) | ✅ (view plot) | 303.00 (-0.45%) | 314.02 (96.49%) |
client_sv2_setup_connection | ✅ (view plot) | 4,689.00 (-0.15%) | 4,760.61 (98.50%) | ✅ (view plot) | 1,502.00 (+0.04%) | 1,514.54 (99.17%) | ✅ (view plot) | 2,274.00 (-0.12%) | 2,297.71 (98.97%) | ✅ (view plot) | 14.00 (+45.45%) | 14.74 (94.97%) | ✅ (view plot) | 67.00 (-1.11%) | 69.60 (96.26%) |
client_sv2_setup_connection_serialize | ✅ (view plot) | 16,180.00 (-0.48%) | 16,472.11 (98.23%) | ✅ (view plot) | 5,963.00 (+0.01%) | 5,975.54 (99.79%) | ✅ (view plot) | 8,655.00 (-0.00%) | 8,676.12 (99.76%) | ✅ (view plot) | 49.00 (+9.00%) | 49.30 (99.39%) | ✅ (view plot) | 208.00 (-1.32%) | 216.96 (95.87%) |
client_sv2_setup_connection_serialize_deserialize | ✅ (view plot) | 35,588.00 (+0.14%) | 35,735.72 (99.59%) | ✅ (view plot) | 14,855.00 (+0.25%) | 14,855.58 (100.00%) | ✅ (view plot) | 21,813.00 (+0.24%) | 21,819.10 (99.97%) | ✅ (view plot) | 102.00 (+3.16%) | 111.56 (91.43%) | ✅ (view plot) | 379.00 (-0.15%) | 384.04 (98.69%) |
https://github.com/stratum-mining/stratum/pull/1143 was mistakenly merged against
dev
this PR aims to close #1128 and replace #1143