yugabyte / yugabyte-db

YugabyteDB - the cloud native distributed SQL database for mission-critical applications.
https://www.yugabyte.com
Other
8.94k stars 1.06k forks source link

[DocDb] Using Chaos Mesh to enhance yugabyte-db's stability #5382

Open zhouqiang-cl opened 4 years ago

zhouqiang-cl commented 4 years ago

Jira Link: DB-1912 Hello, I am Chaos Mesh maintainer. Chaos Mesh is a open source chaos engineering platform for Kubernetes.

As you may have known, chaos engineering is a promising method that can guarantee system resilience in database field. We have been practicing chaos engineering for long on databases and have found many issues in various fault scernarios (for example data consistency issue caused by excessive recovery time). Some of the issue records at https://github.com/orgs/chaos-mesh/projects/1. There are also many adopters who are using Chaos Mesh to test their systems, such as PingCAP, Daily motion, Xpeng Motors, Meituan-Dianping, Apache pulsar, etc.

That said, I would like to invite you to use Chaos Mesh to enhance yugabyte-db's stability. You can directly use Chaos Mesh or integrate it with your test platform. Chaos Mesh supports rich injection methods, such as pod/container kill, network partition, network interruption, CPU/memory usage, time rollback, disk failure, etc. Welcome to use it to enhance the stability of yugabyte-db. If you have any questions, submit an issue at https://github.com/chaos-mesh/chaos-mesh, or send me an email zhouqiang@pingcap.com

Hope this helps and look forward to further communications. ❤️

rkarthik007 commented 4 years ago

Hi @zhouqiang-cl,

Thanks for bringing this to our attention, looks very promising. Will take a closer look, and come back with questions if any. If things work out, we would love to use this as a testing tool.

cc @bmatican @mbautin @schoudhury as well

zhouqiang-cl commented 4 years ago

Hi @zhouqiang-cl,

Thanks for bringing this to our attention, looks very promising. Will take a closer look, and come back with questions if any. If things work out, we would love to use this as a testing tool.

cc @bmatican @mbautin @schoudhury as well

Thank you for your interest in Chaos Mesh. If you have any problem in using Chaos Mesh, we are very pleasure if we can help

zhouqiang-cl commented 4 years ago

Hi @zhouqiang-cl,

Thanks for bringing this to our attention, looks very promising. Will take a closer look, and come back with questions if any. If things work out, we would love to use this as a testing tool.

cc @bmatican @mbautin @schoudhury as well

Hi, @rkarthik007 May I ask did you have already take a look? Is there a problem with using Chaos Mesh?

Thank you very much

rthallamko3 commented 6 months ago

@shamanthchandra-yb , @qvad , Have we considered the above in our testing? cc @rao-vasireddy