search

ssbc / ssb-db2

A new database for secure-scuttlebutt
47 stars 8 forks source link

test that deleteFeed and compact works #359

Closed staltz closed 2 years ago

staltz commented 2 years ago

Context: evaluating and benchmarking compaction, https://github.com/ssbc/ssb-db2/issues/306#issuecomment-1167816382.

Problem: we didn't have a test for deleteFeed of some author that is not the sbot.id, followed by a compaction.

Solution: now we do.

github-actions[bot] commented 2 years ago

Benchmark results

Part Duration
add 1000 elements 509ms
add 1000 private box1 elements 1431ms
unbox 1000 private box1 elements first run 150ms
unbox 1000 private box1 elements second run 128ms
add 1000 private box1 elements 1421ms
query 1000 elements first run 34ms
query 1000 elements second run 16ms
add 1000 private box2 elements 761ms
unbox 1000 private box2 elements first run 428ms
unbox 1000 private box2 elements second run 430ms
Migrate (+db1) 14013ms
Migrate (alone) 4944ms
Migrate (+db1 +db2) 10986ms
Migrate (+db2) 7842ms
Migrate continuation (+db2) 1081ms
Memory usage without indexes 750.31 MB = 34.67 MB + etc
Initial indexing 915ms
Initial indexing maxCpu=86 5120ms
Initial indexing compat 1124ms
Two indexes updating concurrently 1202ms
key one initial 71ms
key two 6ms
key one again 1ms
reboot and key one again 79ms
latest root posts 776ms
latest posts 11ms
votes one initial 653ms
votes again 1ms
hasRoot 467ms
hasRoot again 0ms
author one posts 372ms
author two posts 24ms
dedicated author one posts 435ms
dedicated author one posts again 0ms
Maximum memory usage 954.33 MB = 60.42 MB + etc
Indexes folder size 9.97mb
github-actions[bot] commented 2 years ago

Benchmark results

Part Duration
add 1000 elements 501ms
add 1000 private box1 elements 1167ms
unbox 1000 private box1 elements first run 125ms
unbox 1000 private box1 elements second run 93ms
add 1000 private box1 elements 1143ms
query 1000 elements first run 34ms
query 1000 elements second run 13ms
add 1000 private box2 elements 633ms
unbox 1000 private box2 elements first run 380ms
unbox 1000 private box2 elements second run 359ms
Migrate (+db1) 13620ms
Migrate (alone) 4182ms
Migrate (+db1 +db2) 7884ms
Migrate (+db2) 6677ms
Migrate continuation (+db2) 918ms
Memory usage without indexes 721.00 MB = 34.73 MB + etc
Initial indexing 684ms
Initial indexing maxCpu=86 5038ms
Initial indexing compat 897ms
Two indexes updating concurrently 940ms
key one initial 51ms
key two 3ms
key one again 2ms
reboot and key one again 42ms
latest root posts 667ms
latest posts 7ms
votes one initial 562ms
votes again 0ms
hasRoot 356ms
hasRoot again 0ms
author one posts 321ms
author two posts 19ms
dedicated author one posts 304ms
dedicated author one posts again 0ms
Maximum memory usage 959.46 MB = 61.18 MB + etc
Indexes folder size 9.97mb
github-actions[bot] commented 2 years ago

Benchmark results

Part Duration
add 1000 elements 498ms
add 1000 private box1 elements 1161ms
unbox 1000 private box1 elements first run 114ms
unbox 1000 private box1 elements second run 98ms
add 1000 private box1 elements 1135ms
query 1000 elements first run 36ms
query 1000 elements second run 13ms
add 1000 private box2 elements 622ms
unbox 1000 private box2 elements first run 348ms
unbox 1000 private box2 elements second run 351ms
Migrate (+db1) 11272ms
Migrate (alone) 3852ms
Migrate (+db1 +db2) 8184ms
Migrate (+db2) 6228ms
Migrate continuation (+db2) 905ms
Memory usage without indexes 734.24 MB = 35.08 MB + etc
Initial indexing 721ms
Initial indexing maxCpu=86 4118ms
Initial indexing compat 740ms
Two indexes updating concurrently 931ms
key one initial 40ms
key two 1ms
key one again 1ms
reboot and key one again 53ms
latest root posts 608ms
latest posts 8ms
votes one initial 550ms
votes again 1ms
hasRoot 359ms
hasRoot again 0ms
author one posts 299ms
author two posts 18ms
dedicated author one posts 313ms
dedicated author one posts again 1ms
Maximum memory usage 993.64 MB = 58.86 MB + etc
Indexes folder size 9.97mb