search

microsoft / LSKV

A Ledger-backed Secure Key-Value store (LSKV), built on the Confidential Consortium Framework (CCF)
https://microsoft.github.io/CCF
MIT License
35 stars 6 forks source link

CI benchmarking #104

Closed jeffa5 closed 2 years ago

github-actions[bot] commented 2 years ago

github-actions[bot] commented 2 years ago

github-actions[bot] commented 2 years ago

650c43e6b788d094677b6ef75c7d26a292d3eb00/ecdf.jpg 650c43e6b788d094677b6ef75c7d26a292d3eb00/scatter.jpg 650c43e6b788d094677b6ef75c7d26a292d3eb00/throughput.jpg

github-actions[bot] commented 2 years ago

Plots from benchmarking at 416746472e88d761ec407d47375a04c519dc4ba9

Available from here

416746472e88d761ec407d47375a04c519dc4ba9/ecdf.jpg

416746472e88d761ec407d47375a04c519dc4ba9/scatter.jpg

416746472e88d761ec407d47375a04c519dc4ba9/throughput.jpg

github-actions[bot] commented 2 years ago

Plots from benchmarking at 56d7860c37c940566a6adacae1b692013163e86e

Available from here

ecdf.jpg ![](../blob/ci-plots/ecdf.jpg?raw=true)
scatter.jpg ![](../blob/ci-plots/scatter.jpg?raw=true)
throughput.jpg ![](../blob/ci-plots/throughput.jpg?raw=true)
github-actions[bot] commented 2 years ago

Plots from benchmarking at 7b8246218a3ec90371f0d40b1920288152e6339e

Available from here

ecdf.jpg ![](../blob/ci-plots/7b8246218a3ec90371f0d40b1920288152e6339e/ecdf.jpg?raw=true)
scatter.jpg ![](../blob/ci-plots/7b8246218a3ec90371f0d40b1920288152e6339e/scatter.jpg?raw=true)
throughput.jpg ![](../blob/ci-plots/7b8246218a3ec90371f0d40b1920288152e6339e/throughput.jpg?raw=true)
github-actions[bot] commented 2 years ago

Plots from benchmarking at bee322501084ae20c196840f6c1582a752e71308

Available from here

ecdf.jpg
scatter.jpg
throughput.jpg
heidihoward commented 2 years ago

Have you consider @achamayou's suggestion of using a blob store instead?

jeffa5 commented 2 years ago

Have you consider @achamayou's suggestion of using a blob store instead?

Yeah, would probably need some help setting that up. Was also considering git lfs as it keeps it repo-oriented.

heidihoward commented 2 years ago

It is up to you but I would suggest sticking with this for now as it already works (although the throughput graph doesn't seem to have any data) and create a ticket to switch to blob storage/gitlfs before the repo gets too large

github-actions[bot] commented 2 years ago

Plots from benchmarking at b68e5fbb501d46b7cbe676f122131cb33fcdf7db

Available from here

ecdf.jpg
scatter.jpg
throughput.jpg
jeffa5 commented 2 years ago

I think this is ok for now and once merged we can look at improving it some more

heidihoward commented 2 years ago

throughput graph doesn't seem to have any data?

github-actions[bot] commented 2 years ago

Plots from benchmarking at c9aa513ebbd80e5c009b13eb41ad65f1ee14cf1c

Available from here

ecdf.jpg
scatter.jpg
throughput.jpg
jeffa5 commented 2 years ago

throughput graph doesn't seem to have any data?

Think I've fixed that now, was due to a 0 rate causing / 0 error

github-actions[bot] commented 2 years ago

Plots from benchmarking at 33eaf1ea6c2796cd09153f567b8d259923a307b2

Available from here

ecdf.jpg
scatter.jpg
throughput.jpg
github-actions[bot] commented 2 years ago

Plots from benchmarking at 54038892b5515c5f682048495f7c88d8fb3bbce9

Available from here

ecdf.jpg
scatter.jpg
throughput.jpg
jeffa5 commented 2 years ago

@heidihoward should be ready to go now, including throughput data!

heidihoward commented 2 years ago

Can you put othervars somewhere else and just show the variable which changes in the legend? They are quite long, and they will likely on get longer 😜

jeffa5 commented 2 years ago

Can you put othervars somewhere else and just show the variable which changes in the legend? They are quite long, and they will likely on get longer 😜

Yes, worked out the variable ones and only made them on the legend, kept the invariant ones as a title

github-actions[bot] commented 2 years ago

Plots from benchmarking at be77908e0befdf11f3dc0a364512f032318b0070

Available from here

ecdf.jpg
scatter.jpg
throughput.jpg
github-actions[bot] commented 2 years ago

Plots from benchmarking at 30c48d95db606438d4449e6c806fff3204b704b5

Available from here

ecdf.jpg
scatter.jpg
throughput.jpg