lanterndata / lantern

PostgreSQL vector database extension for building AI applications
https://lantern.dev
GNU Affero General Public License v3.0
790 stars 57 forks source link

Run benchmarks on self-hosted runner #190

Closed var77 closed 1 year ago

codecov[bot] commented 1 year ago

Codecov Report

Merging #190 (56f4b77) into main (4c80eca) will increase coverage by 0.16%. Report is 3 commits behind head on main. The diff coverage is n/a.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #190 +/- ## ========================================== + Coverage 82.93% 83.09% +0.16% ========================================== Files 17 17 Lines 1201 1201 Branches 256 256 ========================================== + Hits 996 998 +2 + Misses 87 81 -6 - Partials 118 122 +4 ``` [see 2 files with indirect coverage changes](https://app.codecov.io/gh/lanterndata/lantern/pull/190/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=lanterndata)
github-actions[bot] commented 1 year ago

Benchmarks

metric old new pct change
recall (after create) 0.740 0.740 -
recall (after insert) 0.784 0.776 -1.02%
select bulk tps 233.376 762.520 +226.73%
select bulk latency (ms) 33.162 9.978 -69.91%
select bulk latency (stddev ms) 9.651 1.915 -80.16%
create latency (ms) 1568.790 1222.557 -22.07%
insert bulk tps 14.084 15.077 +7.05%
insert bulk latency (ms) 70.990 66.318 -6.58%
insert bulk latency (stddev ms) 3.069 3.075 +0.20%
disk usage (bytes) 6348800.000 6348800.000 -