search

cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
29.98k stars 3.79k forks source link

kv: add randomized testing of dist sender #121941

Open andrewbaptist opened 6 months ago

andrewbaptist commented 6 months ago

In 24.1 we added a lot of changes to dist sender. These fell into categories of 1) Cleaning up existing issues 2) Adding support for circuit breakers 3) Add follower routing.

Each of these has been tested in isolation, however we don't have a comprehensive test of DistSender when there are various failures in place.

We want to build a DistSender nemesis framework to stress the various failure modes that can occur and ensure it responds correctly.

Jira issue: CRDB-37633

andrewbaptist commented 5 months ago

Discussed and decided to push this to the holding pen. We have a lot of testing and bug fixes in place, and will push this to 24.2