issues
search
AztecProtocol
/
aztec-packages
Apache License 2.0
155
stars
156
forks
source link
chore: Use prefix op_ for every instruction in avm_trace.hpp
#7214
Closed
jeanmon
closed
4 days ago
AztecBot
commented
4 days ago
Benchmark results
Metrics with a significant change:
proof_construction_time_sha256_30_ms
(16): 1,774 (
+28%
)
avm_simulation_time_ms
(Token:mint_public): 627 (
+894%
)
avm_simulation_time_ms
(Token:assert_minter_and_mint): 60.1 (
-71%
)
app_circuit_proving_time_in_ms
(AuthRegistry:set_authorized (avm)): 1,581 (
+16%
)
app_circuit_proving_time_in_ms
(FPC:pay_refund (avm)): 8,757 (
-22%
)
protocol_circuit_witness_generation_time_in_ms
(root-rollup): 72.2 (
-36%
)
protocol_circuit_proving_time_in_ms
(private-kernel-tail): 45,626 (
-19%
)
protocol_circuit_proving_time_in_ms
(private-kernel-tail-to-public): 84,590 (
-19%
)
protocol_circuit_proving_time_in_ms
(root-parity): 34,023 (
-17%
)
protocol_circuit_proving_time_in_ms
(public-kernel-teardown): 40,015 (
-17%
)
protocol_circuit_proving_time_in_ms
(root-rollup): 19,650 (
-21%
)
Detailed results
All benchmarks are run on txs on the `Benchmarking` contract on the repository. Each tx consists of a batch call to `create_note` and `increment_balance`, which guarantees that each tx has a private call, a nested private call, a public call, and a nested public call, as well as an emitted private note, an unencrypted log, and public storage read and write. This benchmark source data is available in JSON format on S3 [here](https://aztec-ci-artifacts.s3.us-east-2.amazonaws.com/benchmarks-v1/pulls/7214.json). ### Proof generation Each column represents the number of threads used in proof generation. | Metric | 1 threads | 4 threads | 16 threads | 32 threads | 64 threads | | - | - | - | - | - | - |
proof_construction_time_sha256_30_ms
| 11,401 (
-1%
) | 3,096 | :warning: 1,774 (**
+28%
**) | 1,557 (
-6%
) | 1,462 |
proof_construction_time_sha256_100_ms
| 43,968 (
-1%
) | 11,784 | 5,476 (
+1%
) | 5,446 (
+1%
) | 5,359 |
proof_construction_time_poseidon_hash_ms
| 79.0 | 34.0 | 34.0 | 58.0 (
+2%
) | 88.0 (
+1%
) |
proof_construction_time_poseidon_hash_30_ms
| 1,518 (
-1%
) | 415 (
-1%
) | 200 | 220 | 267 |
proof_construction_time_poseidon_hash_100_ms
| 5,753 (
-1%
) | 1,559 (
-1%
) | 723 (
+1%
) | 781 | 796 | ### L2 block published to L1 Each column represents the number of txs on an L2 block published to L1. | Metric | 4 txs | 8 txs | 16 txs | | - | - | - | - |
l1_rollup_calldata_size_in_bytes
| 1,412 | 1,412 | 1,412 |
l1_rollup_calldata_gas
| 9,464 | 9,456 | 9,452 |
l1_rollup_execution_gas
| 610,285 | 610,277 | 610,273 |
l2_block_processing_time_in_ms
| 758 (
+1%
) | 1,413 (
+1%
) | 2,706 |
l2_block_building_time_in_ms
| 25,199 | 50,633 | 99,088 |
l2_block_rollup_simulation_time_in_ms
| 25,198 | 50,633 | 99,088 |
l2_block_public_tx_process_time_in_ms
| 21,648 | 46,881 | 95,354 | ### L2 chain processing Each column represents the number of blocks on the L2 chain where each block has 8 txs. | Metric | 3 blocks | 5 blocks | | - | - | - |
node_history_sync_time_in_ms
| 7,039 | 9,861 |
node_database_size_in_bytes
| 12,157,008 | 16,121,936 |
pxe_database_size_in_bytes
| 16,254 | 26,813 | ### Circuits stats Stats on running time and I/O sizes collected for every kernel circuit run across all benchmarks. | Circuit | simulation_time_in_ms | witness_generation_time_in_ms | proving_time_in_ms | input_size_in_bytes | output_size_in_bytes | proof_size_in_bytes | num_public_inputs | size_in_gates | | - | - | - | - | - | - | - | - | - | private-kernel-init | 129 | 491 (
+4%
) | 11,996 (
-7%
) | 20,634 | 67,190 | 92,352 | 2,819 | 524,288 | private-kernel-inner | 393 (
+1%
) | 1,100 (
-1%
) | 44,888 (
-10%
) | 94,902 | 67,190 | 92,352 | 2,819 | 2,097,152 | private-kernel-tail | 370 (
+1%
) | 1,869 (
+2%
) | :warning: 45,626 (**
-19%
**) | 99,121 | 71,733 | 14,912 | 399 | 2,097,152 | base-parity | 6.26 (
-1%
) | 1,951 (
+3%
) | 2,594 (
-7%
) | 128 | 64.0 | 2,208 | 2.00 | 131,072 | root-parity | 49.3 (
+1%
) | 56.2 (
-26%
) | :warning: 34,023 (**
-17%
**) | 27,100 | 64.0 | 2,720 | 18.0 | 2,097,152 | base-rollup | 7,885 | 5,032 (
+5%
) | 72,599 (
-15%
) | 170,330 | 756 | 3,648 | 47.0 | 4,194,304 | root-rollup | 112 (
+3%
) | :warning: 72.2 (**
-36%
**) | :warning: 19,650 (**
-21%
**) | 25,309 | 620 | 3,456 | 41.0 | 1,048,576 | public-kernel-setup | 721 | 3,724 (
+1%
) | 38,910 (
-14%
) | 116,905 | 93,334 | 125,344 | 3,850 | 2,097,152 | public-kernel-app-logic | 609 | 4,853 | 39,777 (
-15%
) | 116,905 | 93,334 | 125,344 | 3,850 | 2,097,152 | public-kernel-tail | 1,417 (
+1%
) | 37,819 (
+5%
) | 165,588 (
-15%
) | 511,910 | 10,014 | 14,912 | 399 | 8,388,608 | private-kernel-reset-small | 592 (
+1%
) | 2,120 (
+8%
) | 41,266 (
-13%
) | 123,313 | 67,190 | 92,352 | 2,819 | 2,097,152 | public-kernel-teardown | 619 | 4,822 (
+2%
) | :warning: 40,015 (**
-17%
**) | 116,905 | 93,334 | 125,344 | 3,850 | 2,097,152 | merge-rollup | 28.8 (
-1%
) | N/A | N/A | 16,542 | 756 | N/A | N/A | N/A | private-kernel-tail-to-public | N/A | 7,135 (
+5%
) | :warning: 84,590 (**
-19%
**) | N/A | N/A | 125,344 | 3,850 | 4,194,304 | Stats on running time collected for app circuits | Function | input_size_in_bytes | output_size_in_bytes | witness_generation_time_in_ms | proof_size_in_bytes | proving_time_in_ms | size_in_gates | num_public_inputs | | - | - | - | - | - | - | - | - | ContractClassRegisterer:register | 1,344 | 9,944 | 427 (
+1%
) | N/A | N/A | N/A | N/A | ContractInstanceDeployer:deploy | 1,408 | 9,944 | 40.6 (
+2%
) | N/A | N/A | N/A | N/A | MultiCallEntrypoint:entrypoint | 1,920 | 9,944 | 1,809 (
+2%
) | N/A | N/A | N/A | N/A | GasToken:deploy | 1,376 | 9,944 | 1,009 (
+3%
) | N/A | N/A | N/A | N/A | SchnorrAccount:constructor | 1,312 | 9,944 | 1,438 (
+2%
) | N/A | N/A | N/A | N/A | SchnorrAccount:entrypoint | 2,304 | 9,944 | 2,842 (
+1%
) | 16,768 | 50,522 (
-11%
) | 2,097,152 | 457 | Token:privately_mint_private_note | 1,280 | 9,944 | 1,701 (
+5%
) | N/A | N/A | N/A | N/A | FPC:fee_entrypoint_public | 1,344 | 9,944 | 378 (
+5%
) | 16,768 | 10,269 (
-8%
) | 524,288 | 457 | Token:transfer | 1,312 | 9,944 | 4,576 (
+1%
) | 16,768 | 41,582 (
-14%
) | 2,097,152 | 457 | AuthRegistry:set_authorized (avm) | 21,043 | N/A | N/A | 87,200 | :warning: 1,581 (**
+16%
**) | N/A | N/A | FPC:prepare_fee (avm) | 28,553 | N/A | N/A | 88,032 | 4,942 (
-15%
) | N/A | N/A | Token:transfer_public (avm) | 44,885 | N/A | N/A | 87,754 | 3,640 (
-10%
) | N/A | N/A | AuthRegistry:consume (avm) | 34,973 | N/A | N/A | 87,616 | 2,865 (
-3%
) | N/A | N/A | FPC:pay_refund (avm) | 33,413 | N/A | N/A | 88,448 | :warning: 8,757 (**
-22%
**) | N/A | N/A | Benchmarking:create_note | 1,344 | 9,944 | 1,400 (
+1%
) | N/A | N/A | N/A | N/A | SchnorrAccount:verify_private_authwit | 1,280 | 9,944 | 73.2 | N/A | N/A | N/A | N/A | Token:unshield | 1,376 | 9,944 | 3,826 (
+3%
) | N/A | N/A | N/A | N/A | FPC:fee_entrypoint_private | 1,376 | 9,944 | 4,950 (
+6%
) | N/A | N/A | N/A | N/A | ### AVM Simulation Time to simulate various public functions in the AVM. | Function | time_ms | bytecode_size_in_bytes | | - | - | - | GasToken:_increase_public_balance | 70.4 (
+3%
) | 13,873 | GasToken:set_portal | 16.5 (
-3%
) | 3,495 | Token:constructor | 93.1 (
+1%
) | 24,207 | FPC:constructor | 64.4 (
-2%
) | 13,893 | GasToken:mint_public | 53.0 (
+1%
) | 10,241 | Token:mint_public | :warning: 627 (**
+894%
**) | 19,216 | Token:assert_minter_and_mint | :warning: 60.1 (**
-71%
**) | 13,034 | AuthRegistry:set_authorized | 31.5 (
-2%
) | 7,869 | FPC:prepare_fee | 146 (
-27%
) | 15,187 | Token:transfer_public | 37.1 (
+6%
) | 31,425 | FPC:pay_refund | 137 (
+5%
) | 20,080 | Benchmarking:increment_balance | 2,674 | 15,465 | Token:_increase_public_balance | 56.1 | 15,089 | FPC:pay_refund_with_shielded_rebate | 148 | 21,167 | ### Public DB Access Time to access various public DBs. | Function | time_ms | | - | - | get-nullifier-index | 0.146 (
-6%
) | ### Tree insertion stats The duration to insert a fixed batch of leaves into each tree type. | Metric | 1 leaves | 16 leaves | 64 leaves | 128 leaves | 256 leaves | 512 leaves | 1024 leaves | | - | - | - | - | - | - | - | - |
batch_insert_into_append_only_tree_16_depth_ms
| 10.4 (
+1%
) | 16.8 (
+1%
) | N/A | N/A | N/A | N/A | N/A |
batch_insert_into_append_only_tree_16_depth_hash_count
| 16.8 | 31.7 | N/A | N/A | N/A | N/A | N/A |
batch_insert_into_append_only_tree_16_depth_hash_ms
| 0.602 (
+1%
) | 0.516 (
+1%
) | N/A | N/A | N/A | N/A | N/A |
batch_insert_into_append_only_tree_32_depth_ms
| N/A | N/A | 48.5 | 76.4 (
+1%
) | 131 | 244 | 469 |
batch_insert_into_append_only_tree_32_depth_hash_count
| N/A | N/A | 95.9 | 159 | 287 | 543 | 1,055 |
batch_insert_into_append_only_tree_32_depth_hash_ms
| N/A | N/A | 0.496 | 0.468 (
+1%
) | 0.450 | 0.442 | 0.438 |
batch_insert_into_indexed_tree_20_depth_ms
| N/A | N/A | 59.9 (
+1%
) | 113 (
+1%
) | 182 | 352 | 694 |
batch_insert_into_indexed_tree_20_depth_hash_count
| N/A | N/A | 109 | 207 | 355 | 691 | 1,363 |
batch_insert_into_indexed_tree_20_depth_hash_ms
| N/A | N/A | 0.507 (
+1%
) | 0.507 (
+1%
) | 0.483 | 0.476 | 0.475 |
batch_insert_into_indexed_tree_40_depth_ms
| N/A | N/A | 73.3 (
+1%
) | N/A | N/A | N/A | N/A |
batch_insert_into_indexed_tree_40_depth_hash_count
| N/A | N/A | 133 | N/A | N/A | N/A | N/A |
batch_insert_into_indexed_tree_40_depth_hash_ms
| N/A | N/A | 0.522 (
+1%
) | N/A | N/A | N/A | N/A | ### Miscellaneous Transaction sizes based on how many contract classes are registered in the tx. | Metric | 0 registered classes | 1 registered classes | | - | - | - |
tx_size_in_bytes
| 85,672 | 670,983 | Transaction size based on fee payment method | Metric | | | - | |
Benchmark results
Metrics with a significant change:
Detailed results
All benchmarks are run on txs on the `Benchmarking` contract on the repository. Each tx consists of a batch call to `create_note` and `increment_balance`, which guarantees that each tx has a private call, a nested private call, a public call, and a nested public call, as well as an emitted private note, an unencrypted log, and public storage read and write. This benchmark source data is available in JSON format on S3 [here](https://aztec-ci-artifacts.s3.us-east-2.amazonaws.com/benchmarks-v1/pulls/7214.json). ### Proof generation Each column represents the number of threads used in proof generation. | Metric | 1 threads | 4 threads | 16 threads | 32 threads | 64 threads | | - | - | - | - | - | - | proof_construction_time_sha256_30_ms | 11,401 (-1%) | 3,096 | :warning: 1,774 (**+28%**) | 1,557 (-6%) | 1,462 | proof_construction_time_sha256_100_ms | 43,968 (-1%) | 11,784 | 5,476 (+1%) | 5,446 (+1%) | 5,359 | proof_construction_time_poseidon_hash_ms | 79.0 | 34.0 | 34.0 | 58.0 (+2%) | 88.0 (+1%) | proof_construction_time_poseidon_hash_30_ms | 1,518 (-1%) | 415 (-1%) | 200 | 220 | 267 | proof_construction_time_poseidon_hash_100_ms | 5,753 (-1%) | 1,559 (-1%) | 723 (+1%) | 781 | 796 | ### L2 block published to L1 Each column represents the number of txs on an L2 block published to L1. | Metric | 4 txs | 8 txs | 16 txs | | - | - | - | - | l1_rollup_calldata_size_in_bytes | 1,412 | 1,412 | 1,412 | l1_rollup_calldata_gas | 9,464 | 9,456 | 9,452 | l1_rollup_execution_gas | 610,285 | 610,277 | 610,273 | l2_block_processing_time_in_ms | 758 (+1%) | 1,413 (+1%) | 2,706 | l2_block_building_time_in_ms | 25,199 | 50,633 | 99,088 | l2_block_rollup_simulation_time_in_ms | 25,198 | 50,633 | 99,088 | l2_block_public_tx_process_time_in_ms | 21,648 | 46,881 | 95,354 | ### L2 chain processing Each column represents the number of blocks on the L2 chain where each block has 8 txs. | Metric | 3 blocks | 5 blocks | | - | - | - | node_history_sync_time_in_ms | 7,039 | 9,861 | node_database_size_in_bytes | 12,157,008 | 16,121,936 | pxe_database_size_in_bytes | 16,254 | 26,813 | ### Circuits stats Stats on running time and I/O sizes collected for every kernel circuit run across all benchmarks. | Circuit | simulation_time_in_ms | witness_generation_time_in_ms | proving_time_in_ms | input_size_in_bytes | output_size_in_bytes | proof_size_in_bytes | num_public_inputs | size_in_gates | | - | - | - | - | - | - | - | - | - | private-kernel-init | 129 | 491 (+4%) | 11,996 (-7%) | 20,634 | 67,190 | 92,352 | 2,819 | 524,288 | private-kernel-inner | 393 (+1%) | 1,100 (-1%) | 44,888 (-10%) | 94,902 | 67,190 | 92,352 | 2,819 | 2,097,152 | private-kernel-tail | 370 (+1%) | 1,869 (+2%) | :warning: 45,626 (**-19%**) | 99,121 | 71,733 | 14,912 | 399 | 2,097,152 | base-parity | 6.26 (-1%) | 1,951 (+3%) | 2,594 (-7%) | 128 | 64.0 | 2,208 | 2.00 | 131,072 | root-parity | 49.3 (+1%) | 56.2 (-26%) | :warning: 34,023 (**-17%**) | 27,100 | 64.0 | 2,720 | 18.0 | 2,097,152 | base-rollup | 7,885 | 5,032 (+5%) | 72,599 (-15%) | 170,330 | 756 | 3,648 | 47.0 | 4,194,304 | root-rollup | 112 (+3%) | :warning: 72.2 (**-36%**) | :warning: 19,650 (**-21%**) | 25,309 | 620 | 3,456 | 41.0 | 1,048,576 | public-kernel-setup | 721 | 3,724 (+1%) | 38,910 (-14%) | 116,905 | 93,334 | 125,344 | 3,850 | 2,097,152 | public-kernel-app-logic | 609 | 4,853 | 39,777 (-15%) | 116,905 | 93,334 | 125,344 | 3,850 | 2,097,152 | public-kernel-tail | 1,417 (+1%) | 37,819 (+5%) | 165,588 (-15%) | 511,910 | 10,014 | 14,912 | 399 | 8,388,608 | private-kernel-reset-small | 592 (+1%) | 2,120 (+8%) | 41,266 (-13%) | 123,313 | 67,190 | 92,352 | 2,819 | 2,097,152 | public-kernel-teardown | 619 | 4,822 (+2%) | :warning: 40,015 (**-17%**) | 116,905 | 93,334 | 125,344 | 3,850 | 2,097,152 | merge-rollup | 28.8 (-1%) | N/A | N/A | 16,542 | 756 | N/A | N/A | N/A | private-kernel-tail-to-public | N/A | 7,135 (+5%) | :warning: 84,590 (**-19%**) | N/A | N/A | 125,344 | 3,850 | 4,194,304 | Stats on running time collected for app circuits | Function | input_size_in_bytes | output_size_in_bytes | witness_generation_time_in_ms | proof_size_in_bytes | proving_time_in_ms | size_in_gates | num_public_inputs | | - | - | - | - | - | - | - | - | ContractClassRegisterer:register | 1,344 | 9,944 | 427 (+1%) | N/A | N/A | N/A | N/A | ContractInstanceDeployer:deploy | 1,408 | 9,944 | 40.6 (+2%) | N/A | N/A | N/A | N/A | MultiCallEntrypoint:entrypoint | 1,920 | 9,944 | 1,809 (+2%) | N/A | N/A | N/A | N/A | GasToken:deploy | 1,376 | 9,944 | 1,009 (+3%) | N/A | N/A | N/A | N/A | SchnorrAccount:constructor | 1,312 | 9,944 | 1,438 (+2%) | N/A | N/A | N/A | N/A | SchnorrAccount:entrypoint | 2,304 | 9,944 | 2,842 (+1%) | 16,768 | 50,522 (-11%) | 2,097,152 | 457 | Token:privately_mint_private_note | 1,280 | 9,944 | 1,701 (+5%) | N/A | N/A | N/A | N/A | FPC:fee_entrypoint_public | 1,344 | 9,944 | 378 (+5%) | 16,768 | 10,269 (-8%) | 524,288 | 457 | Token:transfer | 1,312 | 9,944 | 4,576 (+1%) | 16,768 | 41,582 (-14%) | 2,097,152 | 457 | AuthRegistry:set_authorized (avm) | 21,043 | N/A | N/A | 87,200 | :warning: 1,581 (**+16%**) | N/A | N/A | FPC:prepare_fee (avm) | 28,553 | N/A | N/A | 88,032 | 4,942 (-15%) | N/A | N/A | Token:transfer_public (avm) | 44,885 | N/A | N/A | 87,754 | 3,640 (-10%) | N/A | N/A | AuthRegistry:consume (avm) | 34,973 | N/A | N/A | 87,616 | 2,865 (-3%) | N/A | N/A | FPC:pay_refund (avm) | 33,413 | N/A | N/A | 88,448 | :warning: 8,757 (**-22%**) | N/A | N/A | Benchmarking:create_note | 1,344 | 9,944 | 1,400 (+1%) | N/A | N/A | N/A | N/A | SchnorrAccount:verify_private_authwit | 1,280 | 9,944 | 73.2 | N/A | N/A | N/A | N/A | Token:unshield | 1,376 | 9,944 | 3,826 (+3%) | N/A | N/A | N/A | N/A | FPC:fee_entrypoint_private | 1,376 | 9,944 | 4,950 (+6%) | N/A | N/A | N/A | N/A | ### AVM Simulation Time to simulate various public functions in the AVM. | Function | time_ms | bytecode_size_in_bytes | | - | - | - | GasToken:_increase_public_balance | 70.4 (+3%) | 13,873 | GasToken:set_portal | 16.5 (-3%) | 3,495 | Token:constructor | 93.1 (+1%) | 24,207 | FPC:constructor | 64.4 (-2%) | 13,893 | GasToken:mint_public | 53.0 (+1%) | 10,241 | Token:mint_public | :warning: 627 (**+894%**) | 19,216 | Token:assert_minter_and_mint | :warning: 60.1 (**-71%**) | 13,034 | AuthRegistry:set_authorized | 31.5 (-2%) | 7,869 | FPC:prepare_fee | 146 (-27%) | 15,187 | Token:transfer_public | 37.1 (+6%) | 31,425 | FPC:pay_refund | 137 (+5%) | 20,080 | Benchmarking:increment_balance | 2,674 | 15,465 | Token:_increase_public_balance | 56.1 | 15,089 | FPC:pay_refund_with_shielded_rebate | 148 | 21,167 | ### Public DB Access Time to access various public DBs. | Function | time_ms | | - | - | get-nullifier-index | 0.146 (-6%) | ### Tree insertion stats The duration to insert a fixed batch of leaves into each tree type. | Metric | 1 leaves | 16 leaves | 64 leaves | 128 leaves | 256 leaves | 512 leaves | 1024 leaves | | - | - | - | - | - | - | - | - | batch_insert_into_append_only_tree_16_depth_ms | 10.4 (+1%) | 16.8 (+1%) | N/A | N/A | N/A | N/A | N/A | batch_insert_into_append_only_tree_16_depth_hash_count | 16.8 | 31.7 | N/A | N/A | N/A | N/A | N/A | batch_insert_into_append_only_tree_16_depth_hash_ms | 0.602 (+1%) | 0.516 (+1%) | N/A | N/A | N/A | N/A | N/A | batch_insert_into_append_only_tree_32_depth_ms | N/A | N/A | 48.5 | 76.4 (+1%) | 131 | 244 | 469 | batch_insert_into_append_only_tree_32_depth_hash_count | N/A | N/A | 95.9 | 159 | 287 | 543 | 1,055 | batch_insert_into_append_only_tree_32_depth_hash_ms | N/A | N/A | 0.496 | 0.468 (+1%) | 0.450 | 0.442 | 0.438 | batch_insert_into_indexed_tree_20_depth_ms | N/A | N/A | 59.9 (+1%) | 113 (+1%) | 182 | 352 | 694 | batch_insert_into_indexed_tree_20_depth_hash_count | N/A | N/A | 109 | 207 | 355 | 691 | 1,363 | batch_insert_into_indexed_tree_20_depth_hash_ms | N/A | N/A | 0.507 (+1%) | 0.507 (+1%) | 0.483 | 0.476 | 0.475 | batch_insert_into_indexed_tree_40_depth_ms | N/A | N/A | 73.3 (+1%) | N/A | N/A | N/A | N/A | batch_insert_into_indexed_tree_40_depth_hash_count | N/A | N/A | 133 | N/A | N/A | N/A | N/A | batch_insert_into_indexed_tree_40_depth_hash_ms | N/A | N/A | 0.522 (+1%) | N/A | N/A | N/A | N/A | ### Miscellaneous Transaction sizes based on how many contract classes are registered in the tx. | Metric | 0 registered classes | 1 registered classes | | - | - | - | tx_size_in_bytes | 85,672 | 670,983 | Transaction size based on fee payment method | Metric | | | - | |