ssbc / ssb-db2

A new database for secure-scuttlebutt
47 stars 8 forks source link

add reset() API #384

Closed staltz closed 2 years ago

staltz commented 2 years ago

We have this API hacked in Manyverse already, would be nice to upstream it in ssb-db2: https://github.com/staltz/manyverse/blob/b0f5f4b17e85ac6d2777bd581dd084fbf97f5b59/src/backend/patches/ssb-db2%2B4.2.1.patch

github-actions[bot] commented 2 years ago

Benchmark results

Part Duration
Create 5000 new messages 312.40ms
Validate 5000 messages 394.16ms
Native to db format 5000 messages 100.15ms
Db to native format 5000 messages 72.67ms
Add 1000 elements 352.12ms
Add 1000 box1 msgs 819.10ms
Unbox 1000 box1 msgs first run 132.82ms
Unbox 1000 box1 msgs second run 94.94ms
Add 1000 box1 msgs 790.78ms
Query 1000 msgs first run 24.00ms
Query 1000 msgs second run 13.37ms
Add 1000 box2 msgs 1105.43ms
Unbox 1000 box2 msgs first run 193.09ms
Unbox 1000 box2 msgs second run 146.80ms
Migrate (+db1) 10101.87ms
Migrate (alone) 3648.00ms
Migrate (+db1 +db2) 6773.94ms
Migrate (+db2) 5370.93ms
Migrate continuation (+db2) 829.55ms
Memory usage without indexes 732.70 MB = 39.30 MB + etc
Initial indexing 596.64ms
Initial indexing maxcpu=86 3276.08ms
Initial indexing compat 504.66ms
Two indexes updating concurrently 918.31ms
Key one initial 40.54ms
Key two 0.44ms
Key one again 1.40ms
Reboot and key one again 39.53ms
Latest root posts 667.02ms
Latest posts 8.26ms
Votes one initial 472.18ms
Votes again 0.68ms
HasRoot 308.71ms
HasRoot again 0.36ms
Author one posts 414.44ms
Author two posts 13.94ms
Dedicated author one posts 437.18ms
Dedicated author one posts again 0.30ms
DeleteFeed 2476.50ms
Maximum memory usage 1029.68 MB = 68.50 MB + etc
Indexes folder size 10.01mb
github-actions[bot] commented 2 years ago

Benchmark results

Part Duration
Create 5000 new messages 448.01ms
Validate 5000 messages 562.52ms
Native to db format 5000 messages 137.63ms
Db to native format 5000 messages 98.52ms
Add 1000 elements 385.55ms
Add 1000 box1 msgs 1157.64ms
Unbox 1000 box1 msgs first run 189.09ms
Unbox 1000 box1 msgs second run 127.91ms
Add 1000 box1 msgs 1063.19ms
Query 1000 msgs first run 30.64ms
Query 1000 msgs second run 18.49ms
Add 1000 box2 msgs 1499.94ms
Unbox 1000 box2 msgs first run 246.54ms
Unbox 1000 box2 msgs second run 168.00ms
Migrate (+db1) 14093.77ms
Migrate (alone) 4941.60ms
Migrate (+db1 +db2) 10384.82ms
Migrate (+db2) 7400.63ms
Migrate continuation (+db2) 1116.32ms
Memory usage without indexes 771.43 MB = 39.81 MB + etc
Initial indexing 769.88ms
Initial indexing maxcpu=86 4618.27ms
Initial indexing compat 874.41ms
Two indexes updating concurrently 1229.11ms
Key one initial 53.72ms
Key two 0.74ms
Key one again 1.57ms
Reboot and key one again 55.55ms
Latest root posts 882.07ms
Latest posts 10.90ms
Votes one initial 644.45ms
Votes again 0.59ms
HasRoot 432.99ms
HasRoot again 0.34ms
Author one posts 546.21ms
Author two posts 21.58ms
Dedicated author one posts 572.38ms
Dedicated author one posts again 0.72ms
DeleteFeed 3615.33ms
Maximum memory usage 1013.61 MB = 65.14 MB + etc
Indexes folder size 10.01mb