ssbc / ssb-db2

A new database for secure-scuttlebutt
47 stars 8 forks source link

move jitdb indexes to db2/jit #335

Closed staltz closed 2 years ago

staltz commented 2 years ago

Fixes issue #333

staltz commented 2 years ago

@arj03 thanks. Yes, after this is merged I intend to:

github-actions[bot] commented 2 years ago

Benchmark results

Part Duration
add 1000 elements 497ms
add 1000 private box1 elements 1329ms
unbox 1000 private box1 elements first run 138ms
unbox 1000 private box1 elements second run 99ms
add 1000 private box1 elements 1345ms
query 1000 elements first run 39ms
query 1000 elements second run 19ms
add 1000 private box2 elements 731ms
unbox 1000 private box2 elements first run 397ms
unbox 1000 private box2 elements second run 374ms
Migrate (+db1) 13022ms
Migrate (alone) 4370ms
Migrate (+db1 +db2) 9369ms
Migrate (+db2) 7029ms
Migrate continuation (+db2) 1002ms
Memory usage without indexes 750.28 MB = 26.25 MB + etc
Initial indexing 728ms
Initial indexing maxCpu=86 4507ms
Initial indexing compat 869ms
Two indexes updating concurrently 899ms
key one initial 55ms
key two 5ms
key one again 4ms
reboot and key one again 62ms
latest root posts 716ms
latest posts 10ms
votes one initial 621ms
votes again 2ms
hasRoot 406ms
hasRoot again 1ms
author one posts 364ms
author two posts 20ms
dedicated author one posts 328ms
dedicated author one posts again 2ms
Maximum memory usage 791.48 MB = 47.06 MB + etc
Indexes folder size 9.97mb
github-actions[bot] commented 2 years ago

Benchmark results

Part Duration
add 1000 elements 482ms
add 1000 private box1 elements 1155ms
unbox 1000 private box1 elements first run 132ms
unbox 1000 private box1 elements second run 84ms
add 1000 private box1 elements 1010ms
query 1000 elements first run 42ms
query 1000 elements second run 17ms
add 1000 private box2 elements 648ms
unbox 1000 private box2 elements first run 359ms
unbox 1000 private box2 elements second run 344ms
Migrate (+db1) 12022ms
Migrate (alone) 3882ms
Migrate (+db1 +db2) 7415ms
Migrate (+db2) 6133ms
Migrate continuation (+db2) 1214ms
Memory usage without indexes 721.92 MB = 34.59 MB + etc
Initial indexing 565ms
Initial indexing maxCpu=86 2973ms
Initial indexing compat 706ms
Two indexes updating concurrently 718ms
key one initial 46ms
key two 1ms
key one again 1ms
reboot and key one again 44ms
latest root posts 609ms
latest posts 11ms
votes one initial 462ms
votes again 2ms
hasRoot 317ms
hasRoot again 1ms
author one posts 279ms
author two posts 14ms
dedicated author one posts 279ms
dedicated author one posts again 3ms
Maximum memory usage 910.40 MB = 62.93 MB + etc
Indexes folder size 9.97mb