search

soteria-dag / soterd

A GoLang Implementation of Soteria DAG Protocol Daemon
http://www.soteriadag.org
ISC License
14 stars 9 forks source link

bootstrapping speed drop. #11

Open totaloutput opened 5 years ago

totaloutput commented 5 years ago

the first couple hundred blocks went pretty fast, then the speed drops.. I'm bootstrapping from genesis, here is the log:

log.zip

totaloutput commented 5 years ago

it started with 

2019-06-05 17:21:17.499 [INF] SYNC: Processed 329 blocks in the last 10.02s (329 transactions, height 327, 2019-05-06 18:33:54 +0000 UTC)
2019-06-05 17:21:27.552 [INF] SYNC: Processed 116 blocks in the last 10.05s (116 transactions, height 442, 2019-05-06 19:55:48 +0000 UTC)

then slow down to

2019-06-05 17:53:31.384 [INF] SYNC: Processed 12 blocks in the last 10.22s (12 transactions, height 4216, 2019-05-13 01:57:43 +0000 UTC)
2019-06-05 17:53:42.362 [INF] SYNC: Processed 13 blocks in the last 10.97s (13 transactions, height 4227, 2019-05-13 02:41:13 +0000 UTC)
colakong commented 5 years ago

This is the result of limiting phantom-type cache sizes. I'll attempt to scale-out the use of cache by persisting phantom-type cache entries to disk. We'll trade disk usage for memory usage, and I expect disk access will still be much faster than recalculating past-graph, blueSet, or dag order.