issues
search
AztecProtocol
/
aztec-packages
Apache License 2.0
184
stars
184
forks
source link
feat: deploy L1 contracts on GA
#7262
Closed
spypsy
closed
3 months ago
AztecBot
commented
3 months ago
Benchmark results
Metrics with a significant change:
batch_insert_into_append_only_tree_32_depth_ms
(128): 106 (
+39%
)
batch_insert_into_append_only_tree_32_depth_ms
(256): 356 (
+172%
)
batch_insert_into_append_only_tree_32_depth_hash_ms
(128): 0.656 (
+41%
)
batch_insert_into_append_only_tree_32_depth_hash_ms
(256): 1.23 (
+172%
)
batch_insert_into_indexed_tree_20_depth_ms
(128): 156 (
+39%
)
batch_insert_into_indexed_tree_20_depth_ms
(256): 268 (
+46%
)
batch_insert_into_indexed_tree_20_depth_hash_ms
(128): 0.703 (
+40%
)
batch_insert_into_indexed_tree_20_depth_hash_ms
(256): 0.703 (
+46%
)
l2_block_processing_time_in_ms
(4): 1,104 (
+45%
)
Detailed results
All benchmarks are run on txs on the `Benchmarking` contract on the repository. Each tx consists of a batch call to `create_note` and `increment_balance`, which guarantees that each tx has a private call, a nested private call, a public call, and a nested public call, as well as an emitted private note, an unencrypted log, and public storage read and write. This benchmark source data is available in JSON format on S3 [here](https://aztec-ci-artifacts.s3.us-east-2.amazonaws.com/benchmarks-v1/pulls/7262.json). ### Proof generation Each column represents the number of threads used in proof generation. | Metric | 1 threads | 4 threads | 16 threads | 32 threads | 64 threads | | - | - | - | - | - | - |
proof_construction_time_sha256_30_ms
| 11,955 | 3,216 (
+1%
) | 1,715 | 1,581 (
+9%
) | 1,482 (
-5%
) |
proof_construction_time_sha256_100_ms
| 44,329 | 11,897 | 5,471 (
+1%
) | 5,451 (
+1%
) | 5,392 (
+1%
) |
proof_construction_time_poseidon_hash_ms
| 79.0 | 35.0 (
-24%
) | 34.0 (
-3%
) | 57.0 (
-3%
) | 88.0 |
proof_construction_time_poseidon_hash_30_ms
| 1,545 (
+1%
) | 422 | 202 (
+2%
) | 238 (
+4%
) | 271 (
+1%
) |
proof_construction_time_poseidon_hash_100_ms
| 5,819 | 1,600 (
+1%
) | 732 (
+1%
) | 782 (
-2%
) | 809 (
+2%
) | ### L2 block published to L1 Each column represents the number of txs on an L2 block published to L1. | Metric | 4 txs | 8 txs | 16 txs | | - | - | - | - |
l1_rollup_calldata_size_in_bytes
| 1,412 | 1,412 | 1,412 |
l1_rollup_calldata_gas
| 9,476 | 9,466 | 9,464 |
l1_rollup_execution_gas
| 610,297 | 610,287 | 610,285 |
l2_block_processing_time_in_ms
| :warning: 1,104 (**
+45%
**) | 1,406 (
-1%
) | 2,686 (
-2%
) |
l2_block_building_time_in_ms
| 25,343 (
-1%
) | 50,825 | 107,522 (
+8%
) |
l2_block_rollup_simulation_time_in_ms
| 25,343 (
-1%
) | 50,825 | 107,522 (
+8%
) |
l2_block_public_tx_process_time_in_ms
| 21,788 (
-1%
) | 47,072 | 100,362 (
+4%
) | ### L2 chain processing Each column represents the number of blocks on the L2 chain where each block has 8 txs. | Metric | 3 blocks | 5 blocks | | - | - | - |
node_history_sync_time_in_ms
| 7,008 (
-1%
) | 9,848 (
-1%
) |
node_database_size_in_bytes
| 12,157,008 | 16,101,456 |
pxe_database_size_in_bytes
| 16,254 | 26,813 | ### Circuits stats Stats on running time and I/O sizes collected for every kernel circuit run across all benchmarks. | Circuit | simulation_time_in_ms | witness_generation_time_in_ms | proving_time_in_ms | input_size_in_bytes | output_size_in_bytes | proof_size_in_bytes | num_public_inputs | size_in_gates | | - | - | - | - | - | - | - | - | - | private-kernel-init | 138 (
+5%
) | 476 | 12,717 (
-2%
) | 20,634 | 67,190 | 92,352 | 2,819 | 524,288 | private-kernel-inner | 417 (
+6%
) | 970 (
+3%
) | 49,920 | 94,902 | 67,190 | 92,352 | 2,819 | 2,097,152 | private-kernel-tail | 383 (
+3%
) | 1,776 (
-4%
) | 52,291 (
+3%
) | 99,121 | 71,733 | 14,912 | 399 | 2,097,152 | base-parity | 6.29 (
+2%
) | 1,897 (
-2%
) | 2,725 | 128 | 64.0 | 2,208 | 2.00 | 131,072 | root-parity | 49.0 (
+1%
) | 74.0 (
+1%
) | 38,853 (
-11%
) | 27,100 | 64.0 | 2,720 | 18.0 | 2,097,152 | base-rollup | 8,032 (
+1%
) | 4,991 (
+1%
) | 85,966 (
-5%
) | 170,330 | 756 | 3,648 | 47.0 | 4,194,304 | root-rollup | 111 (
+1%
) | 84.6 (
-5%
) | 24,807 (
+12%
) | 25,309 | 620 | 3,456 | 41.0 | 1,048,576 | public-kernel-setup | 718 (
+1%
) | 3,716 | 44,549 (
-2%
) | 116,905 | 93,334 | 125,344 | 3,850 | 2,097,152 | public-kernel-app-logic | 623 (
+1%
) | 4,750 (
-1%
) | 48,319 (
+2%
) | 116,905 | 93,334 | 125,344 | 3,850 | 2,097,152 | public-kernel-tail | 1,428 (
+1%
) | 39,016 (
+3%
) | 193,110 (
-1%
) | 511,910 | 10,014 | 14,912 | 399 | 8,388,608 | private-kernel-reset-small | 623 (
+5%
) | 2,152 (
+2%
) | 45,740 (
-2%
) | 123,313 | 67,190 | 92,352 | 2,819 | 2,097,152 | public-kernel-teardown | 615 | 4,694 | 46,645 (
-1%
) | 116,905 | 93,334 | 125,344 | 3,850 | 2,097,152 | merge-rollup | 31.9 (
+11%
) | N/A | N/A | 16,542 | 756 | N/A | N/A | N/A | private-kernel-tail-to-public | N/A | 6,866 (
-11%
) | 100,593 | N/A | N/A | 125,344 | 3,850 | 4,194,304 | Stats on running time collected for app circuits | Function | input_size_in_bytes | output_size_in_bytes | witness_generation_time_in_ms | proof_size_in_bytes | proving_time_in_ms | size_in_gates | num_public_inputs | | - | - | - | - | - | - | - | - | ContractClassRegisterer:register | 1,344 | 9,944 | 443 (
+5%
) | N/A | N/A | N/A | N/A | ContractInstanceDeployer:deploy | 1,408 | 9,944 | 41.2 (
+4%
) | N/A | N/A | N/A | N/A | MultiCallEntrypoint:entrypoint | 1,920 | 9,944 | 1,884 (
+6%
) | N/A | N/A | N/A | N/A | GasToken:deploy | 1,376 | 9,944 | 988 | N/A | N/A | N/A | N/A | SchnorrAccount:constructor | 1,312 | 9,944 | 1,410 | N/A | N/A | N/A | N/A | SchnorrAccount:entrypoint | 2,304 | 9,944 | 2,886 (
+2%
) | 16,768 | 54,646 (
-1%
) | 2,097,152 | 457 | Token:privately_mint_private_note | 1,280 | 9,944 | 1,716 (
+3%
) | N/A | N/A | N/A | N/A | FPC:fee_entrypoint_public | 1,344 | 9,944 | 367 (
+4%
) | 16,768 | 11,125 (
-1%
) | 524,288 | 457 | Token:transfer | 1,312 | 9,944 | 4,770 (
+6%
) | 16,768 | 45,611 (
-5%
) | 2,097,152 | 457 | AuthRegistry:set_authorized (avm) | 21,043 | N/A | N/A | 87,200 | 1,354 | N/A | N/A | FPC:prepare_fee (avm) | 28,521 | N/A | N/A | 88,032 | 5,869 (
-1%
) | N/A | N/A | AuthRegistry:consume (avm) | 34,973 | N/A | N/A | 87,616 | 3,066 (
+1%
) | N/A | N/A | Token:transfer_public (avm) | 44,849 | N/A | N/A | 87,616 | 3,089 (
+1%
) | N/A | N/A | FPC:pay_refund (avm) | 33,381 | N/A | N/A | 88,448 | 11,072 (
-4%
) | N/A | N/A | Benchmarking:create_note | 1,344 | 9,944 | 1,395 (
-1%
) | N/A | N/A | N/A | N/A | SchnorrAccount:verify_private_authwit | 1,280 | 9,944 | 73.5 (
+1%
) | N/A | N/A | N/A | N/A | Token:unshield | 1,376 | 9,944 | 3,715 (
+1%
) | N/A | N/A | N/A | N/A | FPC:fee_entrypoint_private | 1,376 | 9,944 | 4,737 (
+2%
) | N/A | N/A | N/A | N/A | ### AVM Simulation Time to simulate various public functions in the AVM. | Function | time_ms | bytecode_size_in_bytes | | - | - | - | GasToken:_increase_public_balance | 70.9 (
-2%
) | 13,873 | GasToken:set_portal | 16.2 (
-4%
) | 3,495 | Token:constructor | 96.3 (
+4%
) | 24,207 | FPC:constructor | 63.7 | 13,893 | GasToken:mint_public | 52.4 (
+2%
) | 10,241 | Token:mint_public | 605 (
-2%
) | 19,216 | Token:assert_minter_and_mint | 69.8 (
-3%
) | 13,034 | AuthRegistry:set_authorized | 32.6 (
+5%
) | 7,869 | FPC:prepare_fee | 157 (
-13%
) | 15,187 | Token:transfer_public | 55.9 (
-7%
) | 31,425 | FPC:pay_refund | 147 (
+19%
) | 20,080 | Benchmarking:increment_balance | 2,722 (
+1%
) | 15,465 | Token:_increase_public_balance | 56.5 | 15,089 | FPC:pay_refund_with_shielded_rebate | 146 (
-3%
) | 21,167 | ### Public DB Access Time to access various public DBs. | Function | time_ms | | - | - | get-nullifier-index | 0.167 (
+9%
) | ### Tree insertion stats The duration to insert a fixed batch of leaves into each tree type. | Metric | 1 leaves | 16 leaves | 64 leaves | 128 leaves | 256 leaves | 512 leaves | 1024 leaves | | - | - | - | - | - | - | - | - |
batch_insert_into_append_only_tree_16_depth_ms
| 11.5 (
+11%
) | 18.8 (
+12%
) | N/A | N/A | N/A | N/A | N/A |
batch_insert_into_append_only_tree_16_depth_hash_count
| 16.8 | 31.7 | N/A | N/A | N/A | N/A | N/A |
batch_insert_into_append_only_tree_16_depth_hash_ms
| 0.664 (
+11%
) | 0.579 (
+12%
) | N/A | N/A | N/A | N/A | N/A |
batch_insert_into_append_only_tree_32_depth_ms
| N/A | N/A | 48.8 (
+1%
) | :warning: 106 (**
+39%
**) | :warning: 356 (**
+172%
**) | 245 | 470 (
-1%
) |
batch_insert_into_append_only_tree_32_depth_hash_count
| N/A | N/A | 95.9 | 159 | 287 | 543 | 1,055 |
batch_insert_into_append_only_tree_32_depth_hash_ms
| N/A | N/A | 0.497 (
+1%
) | :warning: 0.656 (**
+41%
**) | :warning: 1.23 (**
+172%
**) | 0.443 | 0.439 (
-1%
) |
batch_insert_into_indexed_tree_20_depth_ms
| N/A | N/A | 59.8 | :warning: 156 (**
+39%
**) | :warning: 268 (**
+46%
**) | 353 | 691 (
-1%
) |
batch_insert_into_indexed_tree_20_depth_hash_count
| N/A | N/A | 109 | 207 | 355 | 691 | 1,363 |
batch_insert_into_indexed_tree_20_depth_hash_ms
| N/A | N/A | 0.505 | :warning: 0.703 (**
+40%
**) | :warning: 0.703 (**
+46%
**) | 0.478 | 0.475 (
-1%
) |
batch_insert_into_indexed_tree_40_depth_ms
| N/A | N/A | 75.8 (
+4%
) | N/A | N/A | N/A | N/A |
batch_insert_into_indexed_tree_40_depth_hash_count
| N/A | N/A | 133 | N/A | N/A | N/A | N/A |
batch_insert_into_indexed_tree_40_depth_hash_ms
| N/A | N/A | 0.547 (
+5%
) | N/A | N/A | N/A | N/A | ### Miscellaneous Transaction sizes based on how many contract classes are registered in the tx. | Metric | 0 registered classes | 1 registered classes | | - | - | - |
tx_size_in_bytes
| 85,672 | 670,983 | Transaction size based on fee payment method | Metric | | | - | |
Benchmark results
Metrics with a significant change:
Detailed results
All benchmarks are run on txs on the `Benchmarking` contract on the repository. Each tx consists of a batch call to `create_note` and `increment_balance`, which guarantees that each tx has a private call, a nested private call, a public call, and a nested public call, as well as an emitted private note, an unencrypted log, and public storage read and write. This benchmark source data is available in JSON format on S3 [here](https://aztec-ci-artifacts.s3.us-east-2.amazonaws.com/benchmarks-v1/pulls/7262.json). ### Proof generation Each column represents the number of threads used in proof generation. | Metric | 1 threads | 4 threads | 16 threads | 32 threads | 64 threads | | - | - | - | - | - | - | proof_construction_time_sha256_30_ms | 11,955 | 3,216 (+1%) | 1,715 | 1,581 (+9%) | 1,482 (-5%) | proof_construction_time_sha256_100_ms | 44,329 | 11,897 | 5,471 (+1%) | 5,451 (+1%) | 5,392 (+1%) | proof_construction_time_poseidon_hash_ms | 79.0 | 35.0 (-24%) | 34.0 (-3%) | 57.0 (-3%) | 88.0 | proof_construction_time_poseidon_hash_30_ms | 1,545 (+1%) | 422 | 202 (+2%) | 238 (+4%) | 271 (+1%) | proof_construction_time_poseidon_hash_100_ms | 5,819 | 1,600 (+1%) | 732 (+1%) | 782 (-2%) | 809 (+2%) | ### L2 block published to L1 Each column represents the number of txs on an L2 block published to L1. | Metric | 4 txs | 8 txs | 16 txs | | - | - | - | - | l1_rollup_calldata_size_in_bytes | 1,412 | 1,412 | 1,412 | l1_rollup_calldata_gas | 9,476 | 9,466 | 9,464 | l1_rollup_execution_gas | 610,297 | 610,287 | 610,285 | l2_block_processing_time_in_ms | :warning: 1,104 (**+45%**) | 1,406 (-1%) | 2,686 (-2%) | l2_block_building_time_in_ms | 25,343 (-1%) | 50,825 | 107,522 (+8%) | l2_block_rollup_simulation_time_in_ms | 25,343 (-1%) | 50,825 | 107,522 (+8%) | l2_block_public_tx_process_time_in_ms | 21,788 (-1%) | 47,072 | 100,362 (+4%) | ### L2 chain processing Each column represents the number of blocks on the L2 chain where each block has 8 txs. | Metric | 3 blocks | 5 blocks | | - | - | - | node_history_sync_time_in_ms | 7,008 (-1%) | 9,848 (-1%) | node_database_size_in_bytes | 12,157,008 | 16,101,456 | pxe_database_size_in_bytes | 16,254 | 26,813 | ### Circuits stats Stats on running time and I/O sizes collected for every kernel circuit run across all benchmarks. | Circuit | simulation_time_in_ms | witness_generation_time_in_ms | proving_time_in_ms | input_size_in_bytes | output_size_in_bytes | proof_size_in_bytes | num_public_inputs | size_in_gates | | - | - | - | - | - | - | - | - | - | private-kernel-init | 138 (+5%) | 476 | 12,717 (-2%) | 20,634 | 67,190 | 92,352 | 2,819 | 524,288 | private-kernel-inner | 417 (+6%) | 970 (+3%) | 49,920 | 94,902 | 67,190 | 92,352 | 2,819 | 2,097,152 | private-kernel-tail | 383 (+3%) | 1,776 (-4%) | 52,291 (+3%) | 99,121 | 71,733 | 14,912 | 399 | 2,097,152 | base-parity | 6.29 (+2%) | 1,897 (-2%) | 2,725 | 128 | 64.0 | 2,208 | 2.00 | 131,072 | root-parity | 49.0 (+1%) | 74.0 (+1%) | 38,853 (-11%) | 27,100 | 64.0 | 2,720 | 18.0 | 2,097,152 | base-rollup | 8,032 (+1%) | 4,991 (+1%) | 85,966 (-5%) | 170,330 | 756 | 3,648 | 47.0 | 4,194,304 | root-rollup | 111 (+1%) | 84.6 (-5%) | 24,807 (+12%) | 25,309 | 620 | 3,456 | 41.0 | 1,048,576 | public-kernel-setup | 718 (+1%) | 3,716 | 44,549 (-2%) | 116,905 | 93,334 | 125,344 | 3,850 | 2,097,152 | public-kernel-app-logic | 623 (+1%) | 4,750 (-1%) | 48,319 (+2%) | 116,905 | 93,334 | 125,344 | 3,850 | 2,097,152 | public-kernel-tail | 1,428 (+1%) | 39,016 (+3%) | 193,110 (-1%) | 511,910 | 10,014 | 14,912 | 399 | 8,388,608 | private-kernel-reset-small | 623 (+5%) | 2,152 (+2%) | 45,740 (-2%) | 123,313 | 67,190 | 92,352 | 2,819 | 2,097,152 | public-kernel-teardown | 615 | 4,694 | 46,645 (-1%) | 116,905 | 93,334 | 125,344 | 3,850 | 2,097,152 | merge-rollup | 31.9 (+11%) | N/A | N/A | 16,542 | 756 | N/A | N/A | N/A | private-kernel-tail-to-public | N/A | 6,866 (-11%) | 100,593 | N/A | N/A | 125,344 | 3,850 | 4,194,304 | Stats on running time collected for app circuits | Function | input_size_in_bytes | output_size_in_bytes | witness_generation_time_in_ms | proof_size_in_bytes | proving_time_in_ms | size_in_gates | num_public_inputs | | - | - | - | - | - | - | - | - | ContractClassRegisterer:register | 1,344 | 9,944 | 443 (+5%) | N/A | N/A | N/A | N/A | ContractInstanceDeployer:deploy | 1,408 | 9,944 | 41.2 (+4%) | N/A | N/A | N/A | N/A | MultiCallEntrypoint:entrypoint | 1,920 | 9,944 | 1,884 (+6%) | N/A | N/A | N/A | N/A | GasToken:deploy | 1,376 | 9,944 | 988 | N/A | N/A | N/A | N/A | SchnorrAccount:constructor | 1,312 | 9,944 | 1,410 | N/A | N/A | N/A | N/A | SchnorrAccount:entrypoint | 2,304 | 9,944 | 2,886 (+2%) | 16,768 | 54,646 (-1%) | 2,097,152 | 457 | Token:privately_mint_private_note | 1,280 | 9,944 | 1,716 (+3%) | N/A | N/A | N/A | N/A | FPC:fee_entrypoint_public | 1,344 | 9,944 | 367 (+4%) | 16,768 | 11,125 (-1%) | 524,288 | 457 | Token:transfer | 1,312 | 9,944 | 4,770 (+6%) | 16,768 | 45,611 (-5%) | 2,097,152 | 457 | AuthRegistry:set_authorized (avm) | 21,043 | N/A | N/A | 87,200 | 1,354 | N/A | N/A | FPC:prepare_fee (avm) | 28,521 | N/A | N/A | 88,032 | 5,869 (-1%) | N/A | N/A | AuthRegistry:consume (avm) | 34,973 | N/A | N/A | 87,616 | 3,066 (+1%) | N/A | N/A | Token:transfer_public (avm) | 44,849 | N/A | N/A | 87,616 | 3,089 (+1%) | N/A | N/A | FPC:pay_refund (avm) | 33,381 | N/A | N/A | 88,448 | 11,072 (-4%) | N/A | N/A | Benchmarking:create_note | 1,344 | 9,944 | 1,395 (-1%) | N/A | N/A | N/A | N/A | SchnorrAccount:verify_private_authwit | 1,280 | 9,944 | 73.5 (+1%) | N/A | N/A | N/A | N/A | Token:unshield | 1,376 | 9,944 | 3,715 (+1%) | N/A | N/A | N/A | N/A | FPC:fee_entrypoint_private | 1,376 | 9,944 | 4,737 (+2%) | N/A | N/A | N/A | N/A | ### AVM Simulation Time to simulate various public functions in the AVM. | Function | time_ms | bytecode_size_in_bytes | | - | - | - | GasToken:_increase_public_balance | 70.9 (-2%) | 13,873 | GasToken:set_portal | 16.2 (-4%) | 3,495 | Token:constructor | 96.3 (+4%) | 24,207 | FPC:constructor | 63.7 | 13,893 | GasToken:mint_public | 52.4 (+2%) | 10,241 | Token:mint_public | 605 (-2%) | 19,216 | Token:assert_minter_and_mint | 69.8 (-3%) | 13,034 | AuthRegistry:set_authorized | 32.6 (+5%) | 7,869 | FPC:prepare_fee | 157 (-13%) | 15,187 | Token:transfer_public | 55.9 (-7%) | 31,425 | FPC:pay_refund | 147 (+19%) | 20,080 | Benchmarking:increment_balance | 2,722 (+1%) | 15,465 | Token:_increase_public_balance | 56.5 | 15,089 | FPC:pay_refund_with_shielded_rebate | 146 (-3%) | 21,167 | ### Public DB Access Time to access various public DBs. | Function | time_ms | | - | - | get-nullifier-index | 0.167 (+9%) | ### Tree insertion stats The duration to insert a fixed batch of leaves into each tree type. | Metric | 1 leaves | 16 leaves | 64 leaves | 128 leaves | 256 leaves | 512 leaves | 1024 leaves | | - | - | - | - | - | - | - | - | batch_insert_into_append_only_tree_16_depth_ms | 11.5 (+11%) | 18.8 (+12%) | N/A | N/A | N/A | N/A | N/A | batch_insert_into_append_only_tree_16_depth_hash_count | 16.8 | 31.7 | N/A | N/A | N/A | N/A | N/A | batch_insert_into_append_only_tree_16_depth_hash_ms | 0.664 (+11%) | 0.579 (+12%) | N/A | N/A | N/A | N/A | N/A | batch_insert_into_append_only_tree_32_depth_ms | N/A | N/A | 48.8 (+1%) | :warning: 106 (**+39%**) | :warning: 356 (**+172%**) | 245 | 470 (-1%) | batch_insert_into_append_only_tree_32_depth_hash_count | N/A | N/A | 95.9 | 159 | 287 | 543 | 1,055 | batch_insert_into_append_only_tree_32_depth_hash_ms | N/A | N/A | 0.497 (+1%) | :warning: 0.656 (**+41%**) | :warning: 1.23 (**+172%**) | 0.443 | 0.439 (-1%) | batch_insert_into_indexed_tree_20_depth_ms | N/A | N/A | 59.8 | :warning: 156 (**+39%**) | :warning: 268 (**+46%**) | 353 | 691 (-1%) | batch_insert_into_indexed_tree_20_depth_hash_count | N/A | N/A | 109 | 207 | 355 | 691 | 1,363 | batch_insert_into_indexed_tree_20_depth_hash_ms | N/A | N/A | 0.505 | :warning: 0.703 (**+40%**) | :warning: 0.703 (**+46%**) | 0.478 | 0.475 (-1%) | batch_insert_into_indexed_tree_40_depth_ms | N/A | N/A | 75.8 (+4%) | N/A | N/A | N/A | N/A | batch_insert_into_indexed_tree_40_depth_hash_count | N/A | N/A | 133 | N/A | N/A | N/A | N/A | batch_insert_into_indexed_tree_40_depth_hash_ms | N/A | N/A | 0.547 (+5%) | N/A | N/A | N/A | N/A | ### Miscellaneous Transaction sizes based on how many contract classes are registered in the tx. | Metric | 0 registered classes | 1 registered classes | | - | - | - | tx_size_in_bytes | 85,672 | 670,983 | Transaction size based on fee payment method | Metric | | | - | |