ssbc / ssb-db2

A new database for secure-scuttlebutt
47 stars 8 forks source link

Actions: update checkout + node-setup verisons #421

Closed mixmix closed 1 year ago

mixmix commented 1 year ago

I saw CI complaining: image

So I took a BLIND STAB at updating the actions ... lets see if they run or if we hit breaking changes to API.

github-actions[bot] commented 1 year ago

Benchmark results

Part Duration
Create 5000 new messages 357.73ms
Validate 5000 messages 476.85ms
Native to db format 5000 messages 109.40ms
Db to native format 5000 messages 85.78ms
Add 1000 elements 369.01ms
Add 1000 box1 msgs 1003.59ms
Unbox 1000 box1 msgs first run 217.60ms
Unbox 1000 box1 msgs second run 110.29ms
Add 1000 box1 msgs 962.72ms
Query 1000 msgs first run 48.74ms
Query 1000 msgs second run 12.27ms
Add 1000 box2 msgs 1284.96ms
Unbox 1000 box2 msgs first run 287.81ms
Unbox 1000 box2 msgs second run 134.50ms
Migrate (+db1) 10896.39ms
Migrate (alone) 3584.31ms
Migrate (+db1 +db2) 7916.77ms
Migrate (+db2) 5643.26ms
Migrate continuation (+db2) 820.19ms
Memory usage without indexes 755.58 MB = 40.69 MB + etc
Initial indexing 1539.53ms
Initial indexing maxcpu=86 4716.76ms
Initial indexing compat 674.77ms
Two indexes updating concurrently 2728.11ms
Key one initial 46.44ms
Key two 5.35ms
Key one again 1.89ms
Reboot and key one again 47.23ms
Latest root posts 1699.01ms
Latest posts 7.80ms
Votes one initial 1435.17ms
Votes again 0.54ms
HasRoot 1283.60ms
HasRoot again 0.29ms
Author one posts 1385.78ms
Author two posts 15.59ms
Dedicated author one posts 1389.23ms
Dedicated author one posts again 0.53ms
DeleteFeed 5052.82ms
Maximum memory usage 987.53 MB = 58.88 MB + etc
Indexes folder size 10.01mb
mixmix commented 1 year ago

ok will keep tweaking. References:

oh I think I spotted my mistake, lets see

mixmix commented 1 year ago

hmmm, error with Node 16 test

image

timing bug. re-running test

github-actions[bot] commented 1 year ago

Benchmark results%0A%0A| Part | Duration |%0A|---|---|%0A| Create 5000 new messages | 354.42ms |%0A| Validate 5000 messages | 458.89ms |%0A| Native to db format 5000 messages | 90.90ms |%0A| Db to native format 5000 messages | 85.39ms |%0A| Add 1000 elements | 491.06ms |%0A| Add 1000 box1 msgs | 974.66ms |%0A| Unbox 1000 box1 msgs first run | 186.95ms |%0A| Unbox 1000 box1 msgs second run | 93.53ms |%0A| Add 1000 box1 msgs | 935.73ms |%0A| Query 1000 msgs first run | 38.84ms |%0A| Query 1000 msgs second run | 10.09ms |%0A| Add 1000 box2 msgs | 1263.12ms |%0A| Unbox 1000 box2 msgs first run | 334.07ms |%0A| Unbox 1000 box2 msgs second run | 170.19ms |%0A| Migrate (+db1) | 10263.05ms |%0A| Migrate (alone) | 3150.50ms |%0A| Migrate (+db1 +db2) | 7325.48ms |%0A| Migrate (+db2) | 5073.69ms |%0A| Migrate continuation (+db2) | 896.30ms |%0A| Memory usage without indexes | 743.41 MB = 41.04 MB + etc |%0A| Initial indexing | 1384.81ms |%0A| Initial indexing maxcpu=86 | 4352.73ms |%0A| Initial indexing compat | 530.82ms |%0A| Two indexes updating concurrently | 2452.73ms |%0A| Key one initial | 77.68ms |%0A| Key two | 2.22ms |%0A| Key one again | 4.88ms |%0A| Reboot and key one again | 63.90ms |%0A| Latest root posts | 1481.90ms |%0A| Latest posts | 7.72ms |%0A| Votes one initial | 1263.41ms |%0A| Votes again | 0.36ms |%0A| HasRoot | 1134.78ms |%0A| HasRoot again | 0.46ms |%0A| Author one posts | 1234.79ms |%0A| Author two posts | 13.75ms |%0A| Dedicated author one posts | 1234.33ms |%0A| Dedicated author one posts again | 0.55ms |%0A| DeleteFeed | 4920.14ms |%0A| Maximum memory usage | 849.65 MB = 60.79 MB + etc |%0A| Indexes folder size | 10.01mb |

mixmix commented 1 year ago

ITS BEAUTIFUL

github-actions[bot] commented 1 year ago

Benchmark results | Part | Duration | |---|---| | Create 5000 new messages | 557.99ms | | Validate 5000 messages | 578.08ms | | Native to db format 5000 messages | 138.07ms | | Db to native format 5000 messages | 121.54ms | | Add 1000 elements | 398.94ms | | Add 1000 box1 msgs | 1254.24ms | | Unbox 1000 box1 msgs first run | 271.75ms | | Unbox 1000 box1 msgs second run | 146.55ms | | Add 1000 box1 msgs | 1264.26ms | | Query 1000 msgs first run | 47.38ms | | Query 1000 msgs second run | 14.08ms | | Add 1000 box2 msgs | 1938.19ms | | Unbox 1000 box2 msgs first run | 592.59ms | | Unbox 1000 box2 msgs second run | 286.56ms | | Migrate (+db1) | 16931.90ms | | Migrate (alone) | 5529.44ms | | Migrate (+db1 +db2) | 11498.78ms | | Migrate (+db2) | 8016.40ms | | Migrate continuation (+db2) | 1273.50ms | | Memory usage without indexes | 754.03 MB = 39.66 MB + etc | | Initial indexing | 1965.21ms | | Initial indexing maxcpu=86 | 5604.37ms | | Initial indexing compat | 1032.02ms | | Two indexes updating concurrently | 3476.99ms | | Key one initial | 109.52ms | | Key two | 2.45ms | | Key one again | 2.70ms | | Reboot and key one again | 86.50ms | | Latest root posts | 2139.88ms | | Latest posts | 9.86ms | | Votes one initial | 1784.06ms | | Votes again | 0.47ms | | HasRoot | 1552.20ms | | HasRoot again | 0.46ms | | Author one posts | 1706.31ms | | Author two posts | 16.78ms | | Dedicated author one posts | 1690.25ms | | Dedicated author one posts again | 2.47ms | | DeleteFeed | 7043.31ms | | Maximum memory usage | 848.20 MB = 57.05 MB + etc | | Indexes folder size | 10.01mb |

github-actions[bot] commented 1 year ago

Benchmark results | Part | Duration | |---|---| | Create 5000 new messages | 329.46ms | | Validate 5000 messages | 428.81ms | | Native to db format 5000 messages | 107.45ms | | Db to native format 5000 messages | 84.54ms | | Add 1000 elements | 364.11ms | | Add 1000 box1 msgs | 904.62ms | | Unbox 1000 box1 msgs first run | 181.28ms | | Unbox 1000 box1 msgs second run | 89.80ms | | Add 1000 box1 msgs | 866.47ms | | Query 1000 msgs first run | 35.04ms | | Query 1000 msgs second run | 15.11ms | | Add 1000 box2 msgs | 1269.54ms | | Unbox 1000 box2 msgs first run | 354.93ms | | Unbox 1000 box2 msgs second run | 172.90ms | | Migrate (+db1) | 10782.67ms | | Migrate (alone) | 3578.43ms | | Migrate (+db1 +db2) | 7379.67ms | | Migrate (+db2) | 5493.73ms | | Migrate continuation (+db2) | 905.34ms | | Memory usage without indexes | 740.53 MB = 37.96 MB + etc | | Initial indexing | 1428.28ms | | Initial indexing maxcpu=86 | 4824.03ms | | Initial indexing compat | 705.82ms | | Two indexes updating concurrently | 2448.69ms | | Key one initial | 78.97ms | | Key two | 2.49ms | | Key one again | 0.89ms | | Reboot and key one again | 72.56ms | | Latest root posts | 1526.12ms | | Latest posts | 8.39ms | | Votes one initial | 1237.06ms | | Votes again | 0.41ms | | HasRoot | 1118.11ms | | HasRoot again | 0.49ms | | Author one posts | 1203.65ms | | Author two posts | 15.72ms | | Dedicated author one posts | 1196.05ms | | Dedicated author one posts again | 0.60ms | | DeleteFeed | 5404.15ms | | Maximum memory usage | 849.72 MB = 64.46 MB + etc | | Indexes folder size | 10.01mb |

mixmix commented 1 year ago

Referneces: https://docs.github.com/en/actions/using-workflows/workflow-commands-for-github-actions#multiline-strings

github-actions[bot] commented 1 year ago

Benchmark results

Part Duration
Create 5000 new messages 372.37ms
Validate 5000 messages 459.54ms
Native to db format 5000 messages 97.53ms
Db to native format 5000 messages 86.84ms
Add 1000 elements 493.87ms
Add 1000 box1 msgs 978.91ms
Unbox 1000 box1 msgs first run 183.20ms
Unbox 1000 box1 msgs second run 94.85ms
Add 1000 box1 msgs 934.30ms
Query 1000 msgs first run 32.46ms
Query 1000 msgs second run 12.38ms
Add 1000 box2 msgs 1257.31ms
Unbox 1000 box2 msgs first run 279.93ms
Unbox 1000 box2 msgs second run 142.20ms
Migrate (+db1) 10246.56ms
Migrate (alone) 3129.76ms
Migrate (+db1 +db2) 7210.70ms
Migrate (+db2) 5080.99ms
Migrate continuation (+db2) 897.82ms
Memory usage without indexes 755.44 MB = 42.25 MB + etc
Initial indexing 1403.23ms
Initial indexing maxcpu=86 4706.52ms
Initial indexing compat 593.20ms
Two indexes updating concurrently 2432.18ms
Key one initial 72.67ms
Key two 0.48ms
Key one again 0.91ms
Reboot and key one again 65.10ms
Latest root posts 1487.09ms
Latest posts 7.95ms
Votes one initial 1250.03ms
Votes again 0.60ms
HasRoot 1135.85ms
HasRoot again 0.39ms
Author one posts 1220.29ms
Author two posts 13.79ms
Dedicated author one posts 1210.38ms
Dedicated author one posts again 0.60ms
DeleteFeed 4939.17ms
Maximum memory usage 871.38 MB = 62.14 MB + etc
Indexes folder size 10.01mb
mixmix commented 1 year ago

the changes to sbot.close(t.end) were because some tests failed with "but the server is already closed". This essentially drops all those errors (which I think it what we want errwhere?

(see image: https://github.com/ssbc/ssb-db2/pull/421#issuecomment-1504166429)

mixmix commented 1 year ago

hmmm... passing, but didn't publish benchmark message?

mixmix commented 1 year ago

image

github-actions[bot] commented 1 year ago

Benchmark results

Part Duration
Create 5000 new messages 351.05ms
Validate 5000 messages 436.91ms
Native to db format 5000 messages 102.89ms
Db to native format 5000 messages 89.39ms
Add 1000 elements 361.30ms
Add 1000 box1 msgs 899.60ms
Unbox 1000 box1 msgs first run 180.39ms
Unbox 1000 box1 msgs second run 88.99ms
Add 1000 box1 msgs 853.13ms
Query 1000 msgs first run 29.92ms
Query 1000 msgs second run 12.48ms
Add 1000 box2 msgs 1270.84ms
Unbox 1000 box2 msgs first run 349.76ms
Unbox 1000 box2 msgs second run 163.07ms
Migrate (+db1) 10883.37ms
Migrate (alone) 3587.81ms
Migrate (+db1 +db2) 7520.60ms
Migrate (+db2) 5544.26ms
Migrate continuation (+db2) 972.62ms
Memory usage without indexes 746.86 MB = 34.87 MB + etc
Initial indexing 1413.61ms
Initial indexing maxcpu=86 4614.77ms
Initial indexing compat 710.23ms
Two indexes updating concurrently 2415.30ms
Key one initial 77.98ms
Key two 1.14ms
Key one again 1.21ms
Reboot and key one again 70.97ms
Latest root posts 1525.75ms
Latest posts 8.98ms
Votes one initial 1281.05ms
Votes again 0.34ms
HasRoot 1117.15ms
HasRoot again 0.31ms
Author one posts 1219.08ms
Author two posts 14.43ms
Dedicated author one posts 1211.33ms
Dedicated author one posts again 0.60ms
DeleteFeed 5250.22ms
Maximum memory usage 857.33 MB = 56.43 MB + etc
Indexes folder size 10.01mb