Set up YCSB benchmark - Githubissues

microsoft / LSKV

A Ledger-backed Secure Key-Value store (LSKV), built on the Confidential Consortium Framework (CCF)

https://microsoft.github.io/CCF

MIT License

35 stars 6 forks source link

Set up YCSB benchmark #112

Closed jeffa5 closed 2 years ago

jeffa5 commented 2 years ago

This ended up being a bit larger due to a lot of refactoring to handle different benchmark methods but should be more extensible in future for others.

Probably some follow-up things to do after merging:

Add ycsb to CI
setup python files for ci configuration and an all configuration rather than relying on flags everywhere

jeffa5 commented 2 years ago

This gets the ycsb benchmark into a state where it runs but doesn't currently output raw data to a CSV since it isn't currently implemented. I'll have a look at how difficult that would be.

We could switch to the original ycsb but we'd need to setup an etcd client which wouldn't be very nice either.

heidihoward commented 2 years ago

Just so I understand, you can get the processed results from the go-ycsb client printed to stdout but you'd like to have the raw results in an easy to process format for doing your own analysis?

heidihoward commented 2 years ago

I think it would be preferable to use go-ycsb over writing our own client, though I think we will eventually need to do the latter as well

jeffa5 commented 2 years ago

Just so I understand, you can get the processed results from the go-ycsb client printed to stdout but you'd like to have the raw results in an easy to process format for doing your own analysis?

Yes.