search

scylladb / jepsen

scylladb jepsen clone
14 stars 8 forks source link

Is scylladb jepsen testing continuous and where are the results? #5

Open aisven opened 5 years ago

aisven commented 5 years ago

We are considering to use ScyllaDB to more or less extend and therefore we are evaluating it. We thereby wanted to see results regarding tests with jepsen. It seems that the activity was here only in 2016. We have these questions:

Is there ongoing jepsen testing against nightly builds and releases of ScyllaDB?

Is there further development of the test suite as initiated in 2016?

Are jepsen test results published online?

vladzcloudius commented 5 years ago

@sourcekick Hi! Thanks for looking at Scylla. The last time I touched it was quite a while ago indeed. When we ran it Scylla was passing (we do found a few bugs in Scylla in the process though ;)).

We tried to run it regularly however we got swamped by constant issues coming from the jepsen framework itself. In particular its threads were stalling for no obvious reason. Therefore we developed a similar system of our own (Python based) which incorporated most of great Kyle's ideas. And this system is running periodically (@roydahan will be able to elaborate on this more).

@roydahan @slivne Please, comment.

roydahan commented 5 years ago

Thanks @vladzcloudius. That's correct we have scylla-cluster-tests repo that we use in our QA department for testing scylla extensively. At some point (in our queue) we may back to test with Jepsen as well.