search

hashgraph / hedera-block-node

New Block Node services
Apache License 2.0
24 stars 3 forks source link

To algoritm-profile MirrorNode code #354

Open alex-kuzmin-hg opened 1 week ago

alex-kuzmin-hg commented 1 week ago

NB for myself: Xin Li to send me example Output: algorithm profiling in dynamics of 100M, published to perf web site

alex-kuzmin-hg commented 1 week ago

Reported to Xin:

minimal tests importing from AWS S3 resulted in https://perf.analytics.eng.hashgraph.io/ephemeral/mirror_node_smoke/reports/ There are only 2 formal point of interest: 1) https://perf.analytics.eng.hashgraph.io/ephemeral/mirror_node_smoke/reports/com.hedera.mirror.importer.downloader.Downloader.html#231 2 nested iterators make it costly per every function call (picture 1) - but difficult to tell due to very small sample 2) https://perf.analytics.eng.hashgraph.io/ephemeral/mirror_node_smoke/reports/com.hedera.mirror.importer.parser.record.entity.EntityRecordItemListener.html#305 high number of function call, escalated huge number of iterations (picture 2) - but, again, difficult to tell due to very small sample

alex-kuzmin-hg commented 1 week ago

Next step - to run large experiment: Xin: we may also have to wait since IIRC perfnet1 cloud bucket files retention is 7 days, last time Tom ran 10k TPS canonical was Tuesday last week, so most likely no files avail now.

alex-kuzmin-hg commented 1 week ago

Closing this project as Done, as Xin's project is completed. Future experiments will be an corresponding tickets