ssbc / ssb-db2

A new database for secure-scuttlebutt
47 stars 8 forks source link

Disable compaction in browser #413

Closed arj03 closed 1 year ago

arj03 commented 1 year ago

Related to https://github.com/ssbc/async-append-only-log/pull/91. I tried the minimum possible to get things running again. A better fix would of course be to allow compaction to run in the browser, but for now I'd like to get things running again. See https://github.com/arj03/ssb-browser-core/issues/71.

github-actions[bot] commented 1 year ago

Benchmark results

Part Duration
Create 5000 new messages 480.80ms
Validate 5000 messages 586.48ms
Native to db format 5000 messages 140.42ms
Db to native format 5000 messages 99.39ms
Add 1000 elements 523.81ms
Add 1000 box1 msgs 1254.66ms
Unbox 1000 box1 msgs first run 270.28ms
Unbox 1000 box1 msgs second run 122.60ms
Add 1000 box1 msgs 1197.12ms
Query 1000 msgs first run 43.60ms
Query 1000 msgs second run 26.60ms
Add 1000 box2 msgs 1766.20ms
Unbox 1000 box2 msgs first run 470.64ms
Unbox 1000 box2 msgs second run 213.64ms
Migrate (+db1) 15618.06ms
Migrate (alone) 5683.78ms
Migrate (+db1 +db2) 11615.28ms
Migrate (+db2) 7988.50ms
Migrate continuation (+db2) 1198.53ms
Memory usage without indexes 757.62 MB = 40.92 MB + etc
Initial indexing 1952.12ms
Initial indexing maxcpu=86 6426.09ms
Initial indexing compat 997.14ms
Two indexes updating concurrently 3524.18ms
Key one initial 58.63ms
Key two 0.78ms
Key one again 0.62ms
Reboot and key one again 54.03ms
Latest root posts 2170.31ms
Latest posts 12.59ms
Votes one initial 1810.43ms
Votes again 0.85ms
HasRoot 1610.79ms
HasRoot again 0.50ms
Author one posts 1745.13ms
Author two posts 19.29ms
Dedicated author one posts 1705.79ms
Dedicated author one posts again 0.66ms
DeleteFeed 6983.69ms
Maximum memory usage 1014.69 MB = 59.03 MB + etc
Indexes folder size 10.01mb
arj03 commented 1 year ago

Will probably do some more testing around the new group stuff once we get there, but this is a start. Thanks for the quick review.

github-actions[bot] commented 1 year ago

Benchmark results

Part Duration
Create 5000 new messages 357.23ms
Validate 5000 messages 471.47ms
Native to db format 5000 messages 113.39ms
Db to native format 5000 messages 86.41ms
Add 1000 elements 366.05ms
Add 1000 box1 msgs 940.60ms
Unbox 1000 box1 msgs first run 214.11ms
Unbox 1000 box1 msgs second run 110.46ms
Add 1000 box1 msgs 891.87ms
Query 1000 msgs first run 39.93ms
Query 1000 msgs second run 12.97ms
Add 1000 box2 msgs 1256.75ms
Unbox 1000 box2 msgs first run 303.04ms
Unbox 1000 box2 msgs second run 138.91ms
Migrate (+db1) 11549.46ms
Migrate (alone) 3925.15ms
Migrate (+db1 +db2) 8052.14ms
Migrate (+db2) 6297.54ms
Migrate continuation (+db2) 970.75ms
Memory usage without indexes 741.89 MB = 39.39 MB + etc
Initial indexing 1637.85ms
Initial indexing maxcpu=86 5235.25ms
Initial indexing compat 719.21ms
Two indexes updating concurrently 2791.69ms
Key one initial 56.29ms
Key two 1.94ms
Key one again 1.28ms
Reboot and key one again 46.95ms
Latest root posts 1721.26ms
Latest posts 9.59ms
Votes one initial 1496.52ms
Votes again 0.55ms
HasRoot 1277.66ms
HasRoot again 0.29ms
Author one posts 1368.55ms
Author two posts 18.09ms
Dedicated author one posts 1422.45ms
Dedicated author one posts again 0.71ms
DeleteFeed 5696.05ms
Maximum memory usage 930.23 MB = 60.04 MB + etc
Indexes folder size 10.01mb