github-actions[bot]
commented
1 year ago Benchmark results
| Part | Duration |
|---|---|
| Create 5000 new messages | 375.36ms |
| Validate 5000 messages | 453.85ms |
| Native to db format 5000 messages | 121.59ms |
| Db to native format 5000 messages | 84.52ms |
| Add 1000 elements | 487.80ms |
| Add 1000 box1 msgs | 929.53ms |
| Unbox 1000 box1 msgs first run | 214.18ms |
| Unbox 1000 box1 msgs second run | 98.99ms |
| Add 1000 box1 msgs | 893.36ms |
| Query 1000 msgs first run | 37.49ms |
| Query 1000 msgs second run | 21.09ms |
| Add 1000 box2 msgs | 1291.75ms |
| Unbox 1000 box2 msgs first run | 320.31ms |
| Unbox 1000 box2 msgs second run | 149.18ms |
| Migrate (+db1) | 11299.17ms |
| Migrate (alone) | 3895.10ms |
| Migrate (+db1 +db2) | 8275.14ms |
| Migrate (+db2) | 6070.83ms |
| Migrate continuation (+db2) | 918.66ms |
| Memory usage without indexes | 753.86 MB = 42.46 MB + etc |
| Initial indexing | 1628.30ms |
| Initial indexing maxcpu=86 | 5318.48ms |
| Initial indexing compat | 771.83ms |
| Two indexes updating concurrently | 2810.19ms |
| Key one initial | 52.00ms |
| Key two | 1.87ms |
| Key one again | 2.04ms |
| Reboot and key one again | 38.28ms |
| Latest root posts | 1771.49ms |
| Latest posts | 9.23ms |
| Votes one initial | 1488.35ms |
| Votes again | 0.56ms |
| HasRoot | 1280.07ms |
| HasRoot again | 0.37ms |
| Author one posts | 1379.34ms |
| Author two posts | 18.55ms |
| Dedicated author one posts | 1435.46ms |
| Dedicated author one posts again | 0.48ms |
| DeleteFeed | 5721.17ms |
| Maximum memory usage | 1018.56 MB = 56.37 MB + etc |
| Indexes folder size | 10.01mb |
arj03
This should fix #406
I went through a bit different solutions (see https://github.com/ssbc/jitdb/pull/236), but ended up with a new pull source api.
I considered doing this so the operators could be reused, but decided against that because the filtering is often pretty simple and this also shows people that doing a filter on the result is not that scary. Where this could also be useful is if you have something like do a rough filter on post but then filter the result only for specific stuff without creating an index in jitdb.