search

HerodotusDev / hdp

Herodotus Data Processor Toolkit. Enhance zk-offchain compute for verifiable onchain data using zkVMs
https://docs.herodotus.dev/herodotus-docs/developers/herodotus-data-processor-hdp
GNU General Public License v3.0
27 stars 4 forks source link

Benchmark for HDP provider #35

Open rkdud007 opened 6 months ago

rkdud007 commented 6 months ago

Context

Add proper benchmark for provider. Split headers vs account vs storage so that we could calculate upper bound easily

rkdud007 commented 6 months ago

Updated Numbers

10 blocks /account

2024-03-13T07:50:51.377235Z  INFO common::fetcher: Successfully fetched MMR data from indexer
2024-03-13T07:50:51.377273Z  INFO common::fetcher: Time taken (fetch from Indexer): 1.742653834s
2024-03-13T07:50:51.946096Z  INFO common::fetcher: Time taken (Account Fetch): 568.485208ms
2024-03-13T07:50:51.946821Z  INFO hdp: HDP Cli Finished in: 2.320740792s

10 Blocks /storage

2024-03-13T07:51:06.939756Z  INFO common::fetcher: Successfully fetched MMR data from indexer
2024-03-13T07:51:06.939795Z  INFO common::fetcher: Time taken (fetch from Indexer): 1.701699959s
2024-03-13T07:51:07.898453Z  INFO common::fetcher: Time taken (Storage Fetch): 958.328791ms
2024-03-13T07:51:07.899212Z  INFO hdp: HDP Cli Finished in: 2.670000208s

100 blocks / account

2024-03-13T07:50:31.704751Z  INFO common::fetcher: Successfully fetched MMR data from indexer
2024-03-13T07:50:31.704788Z  INFO common::fetcher: Time taken (fetch from Indexer): 2.979114792s
2024-03-13T07:50:34.888794Z  INFO common::fetcher: Time taken (Account Fetch): 3.181802917s
2024-03-13T07:50:34.892383Z  INFO hdp: HDP Cli Finished in: 6.173844208s

100blocks / storage

2024-03-13T07:48:28.226775Z  INFO common::fetcher: Successfully fetched MMR data from indexer
2024-03-13T07:48:28.226811Z  INFO common::fetcher: Time taken (fetch from Indexer): 2.462463083s
2024-03-13T07:48:31.397137Z  INFO common::fetcher: Time taken (Storage Fetch): 3.168066583s
2024-03-13T07:48:31.400563Z  INFO hdp: HDP Cli Finished in: 5.64314875s

200 blocks / account

2024-03-13T07:49:51.336903Z  INFO common::fetcher: Successfully fetched MMR data from indexer
2024-03-13T07:49:51.336942Z  INFO common::fetcher: Time taken (fetch from Indexer): 6.321296917s
2024-03-13T07:49:56.386808Z  INFO common::fetcher: Time taken (Account Fetch): 5.047839292s
2024-03-13T07:49:56.397708Z  INFO hdp: HDP Cli Finished in: 11.388872167s

200 Blocks / Storage

2024-03-13T07:48:01.853367Z  INFO common::fetcher: Successfully fetched MMR data from indexer
2024-03-13T07:48:01.853397Z  INFO common::fetcher: Time taken (fetch from Indexer): 2.621862583s
2024-03-13T07:48:07.333569Z  INFO common::fetcher: Time taken (Storage Fetch): 5.478314209s
2024-03-13T07:48:07.340712Z  INFO hdp: HDP Cli Finished in: 8.118455708s

300 Blocks / account

2024-03-13T07:49:22.111032Z  INFO common::fetcher: Successfully fetched MMR data from indexer
2024-03-13T07:49:22.111064Z  INFO common::fetcher: Time taken (fetch from Indexer): 4.45608425s
2024-03-13T07:49:29.754096Z  INFO common::fetcher: Time taken (Account Fetch): 7.640519583s
2024-03-13T07:49:29.762429Z  INFO hdp: HDP Cli Finished in: 12.115215666s

300 blocks / storage

2024-03-13T07:47:29.346052Z  INFO common::fetcher: Successfully fetched MMR data from indexer
2024-03-13T07:47:29.346074Z  INFO common::fetcher: Time taken (fetch from Indexer): 5.026759958s
2024-03-13T07:47:36.821636Z  INFO common::fetcher: Time taken (Storage Fetch): 7.473240708s
2024-03-13T07:47:36.830445Z  INFO hdp: HDP Cli Finished in: 12.519645s