toeverything / OctoBase

🐙 OctoBase is the open-source database behind AFFiNE, local-first, yet collaborative. A light-weight, scalable, data engine written in Rust.
https://octobase.dev
GNU Affero General Public License v3.0
1.41k stars 92 forks source link

ci: fix benchmark baseline compare #538

Closed darkskygit closed 1 year ago

vercel[bot] commented 1 year ago

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
octobase ✅ Ready (Inspect) Visit Preview 💬 Add feedback Sep 15, 2023 7:00am
github-actions[bot] commented 1 year ago

Benchmark for Linux

Click to view benchmark | Test | Base | PR | % | | --- | --- | --- | --- | | codec/jwst decode var_int (32 bit) | 359.2±3.39µs | 358.5±3.46µs | -0.19% | | codec/jwst decode var_uint (32 bit) | 277.5±1.87µs | 277.5±0.97µs | -0.00% | | codec/jwst decode var_uint (64 bit) | 278.2±1.52µs | 278.2±0.78µs | -0.00% | | codec/jwst encode var_int (32 bit) | 387.3±1.27µs | 387.7±1.56µs | +0.10% | | codec/jwst encode var_uint (32 bit) | 309.9±0.79µs | 310.4±1.88µs | **+0.16%** | | codec/jwst encode var_uint (64 bit) | 310.4±1.04µs | 310.2±1.08µs | -0.06% | | codec/lib0 decode var_int (64 bit) | 278.2±1.35µs | 278.1±0.86µs | **-0.04%** | | codec/lib0 decode var_uint (32 bit) | 254.2±6.58µs | 257.4±2.04µs | **+1.26%** | | codec/lib0 decode var_uint (64 bit) | 236.2±2.20µs | 233.8±2.04µs | **-1.02%** | | codec/lib0 encode var_int (64 bit) | 388.7±0.62µs | 389.7±0.71µs | **+0.26%** | | codec/lib0 encode var_uint (32 bit) | 296.4±2.96µs | 294.9±3.89µs | -0.51% | | codec/lib0 encode var_uint (64 bit) | 342.2±0.92µs | 342.4±1.31µs | **+0.06%** | | ops/array/jwst/insert | 276.2±0.27µs | 276.6±1.11µs | **+0.14%** | | ops/array/jwst/insert range | 406.6±2.62µs | 406.8±1.65µs | +0.05% | | ops/array/jwst/remove | 176.5±0.33µs | 175.0±0.17µs | **-0.85%** | | ops/array/yrs/insert | 89.9±1.48µs | 90.8±0.63µs | **+1.00%** | | ops/array/yrs/insert range | 114.1±1.27µs | 113.2±0.94µs | **-0.79%** | | ops/array/yrs/remove | 95.9±0.34µs | 103.2±1.18µs | **+7.61%** | | ops/text/jwst/insert | 141.8±0.48µs | 143.5±0.49µs | **+1.20%** | | ops/text/jwst/remove | 3.7±0.05µs | 3.6±0.00µs | **-2.70%** | | ops/text/yrs/insert | 42.1±0.05µs | 42.0±0.07µs | **-0.24%** | | ops/text/yrs/remove | 2.4±0.00µs | 2.4±0.01µs | -0.00% | | update/parse with jwst/basic.bin | 66.8±0.32µs | 67.1±0.07µs | **+0.45%** | | update/parse with jwst/database.bin | 53.9±0.02µs | 54.4±0.02µs | **+0.93%** | | update/parse with jwst/large.bin | 5.4±0.00ms | 3.5±0.03ms | **-35.19%** | | update/parse with jwst/with-subdoc.bin | 6.3±0.05µs | 6.3±0.09µs | -0.00% | | update/parse with yrs/basic.bin | 42.0±0.04µs | 42.4±0.47µs | **+0.95%** | | update/parse with yrs/database.bin | 34.0±0.44µs | 34.3±0.02µs | **+0.88%** | | update/parse with yrs/large.bin | 2.1±0.00ms | 2.1±0.00ms | -0.00% | | update/parse with yrs/with-subdoc.bin | 6.1±0.08µs | 6.3±0.04µs | **+3.28%** |

Benchmark for Windows

Click to view benchmark | Test | Base | PR | % | | --- | --- | --- | --- | | codec/jwst decode var_int (32 bit) | 365.1±4.76µs | 363.9±3.62µs | -0.33% | | codec/jwst decode var_uint (32 bit) | 389.2±7.13µs | 391.0±16.79µs | +0.46% | | codec/jwst decode var_uint (64 bit) | 483.2±5.04µs | 483.5±5.58µs | +0.06% | | codec/jwst encode var_int (32 bit) | 492.9±7.93µs | 495.2±8.63µs | +0.47% | | codec/jwst encode var_uint (32 bit) | 373.8±12.12µs | 366.8±9.48µs | -1.87% | | codec/jwst encode var_uint (64 bit) | 368.9±13.41µs | 367.4±10.07µs | -0.41% | | codec/lib0 decode var_int (64 bit) | 292.0±5.96µs | 290.2±3.40µs | -0.62% | | codec/lib0 decode var_uint (32 bit) | 242.9±3.00µs | 242.9±2.92µs | -0.00% | | codec/lib0 decode var_uint (64 bit) | 354.8±4.15µs | 355.1±3.99µs | +0.08% | | codec/lib0 encode var_int (64 bit) | 579.4±10.43µs | 576.5±11.14µs | -0.50% | | codec/lib0 encode var_uint (32 bit) | 396.4±5.58µs | 395.1±4.78µs | -0.33% | | codec/lib0 encode var_uint (64 bit) | 385.1±5.43µs | 384.6±4.93µs | -0.13% | | ops/array/jwst/insert | 300.7±4.16µs | 301.4±2.96µs | +0.23% | | ops/array/jwst/insert range | 419.7±6.67µs | 422.9±4.11µs | +0.76% | | ops/array/jwst/remove | 171.9±2.13µs | 171.9±1.67µs | -0.00% | | ops/array/yrs/insert | 105.6±1.27µs | 107.5±1.27µs | **+1.80%** | | ops/array/yrs/insert range | 148.1±1.58µs | 149.6±1.35µs | **+1.01%** | | ops/array/yrs/remove | 157.8±1.52µs | 159.6±2.63µs | **+1.14%** | | ops/text/jwst/insert | 178.8±1.70µs | 176.9±3.05µs | **-1.06%** | | ops/text/jwst/remove | 4.2±0.05µs | 4.2±0.04µs | -0.00% | | ops/text/yrs/insert | 46.7±0.42µs | 47.1±0.50µs | **+0.86%** | | ops/text/yrs/remove | 3.7±0.04µs | 3.7±0.05µs | -0.00% | | update/parse with jwst/basic.bin | 99.5±2.27µs | 97.1±1.15µs | **-2.41%** | | update/parse with jwst/database.bin | 76.3±0.92µs | 77.1±0.85µs | **+1.05%** | | update/parse with jwst/large.bin | 4.7±0.12ms | 4.7±0.13ms | -0.00% | | update/parse with jwst/with-subdoc.bin | 15.0±0.12µs | 15.2±0.16µs | **+1.33%** | | update/parse with yrs/basic.bin | 66.3±0.96µs | 66.9±1.23µs | **+0.90%** | | update/parse with yrs/database.bin | 51.7±0.47µs | 52.3±0.40µs | **+1.16%** | | update/parse with yrs/large.bin | 3.1±0.08ms | 3.2±0.09ms | **+3.23%** | | update/parse with yrs/with-subdoc.bin | 12.2±0.28µs | 11.7±0.16µs | **-4.10%** |