search

kiwitcms / Kiwi

open source test management system with over 2 million downloads!
https://kiwitcms.org
GNU General Public License v2.0
993 stars 297 forks source link

RFC: Interface to crowd testing platforms #1419

Open kiwitcms-bot opened 4 years ago

kiwitcms-bot commented 4 years ago

There are some companies/teams which engage in what is called crowd testing. One can also find multiple platforms which provide such services.

The idea being is that you will define your steps to reproduce (e.g. TestPlan and TestCases) and then give them to a bunch of random people for execution. An example is testing a mobile app on multiple devices which you don't have. Some open source projects that we know of expose all of their test matrix publicly for their community to test nightly builds and provide +1/-1 on them or just report more bugs.

Some possible platforms that we know about: Amazon Mechanical Turk, test.io, testbirds.com.

Since all of the necessary information is already available in Kiwi TCMS it can easily serve as an interface to such other platforms.

Opening this issue to collect more information and feedback b/c this isn't on our immediate roadmap and our team doesn't have personal experience with crowd sourced testing.

atodorov commented 4 years ago

Good list of resources here https://github.com/ligurio/awesome-software-quality/wiki/Testing-As-A-Service#crowdsource-testing