Open michael-redpanda opened 1 year ago
Spoke offline with @michael-redpanda and @BenPope A verifiable consumer and producer is needed so we can test that the internal Kafka client works in scenarios where leadership changes while there are active producers and consumers. We do not need separate services to test this however, instead we could rely on the DT orchestration node to send produce/consume REST requests over a period of time.
With this in mind, we are changing this ticket to be the following:
Create a producer and consumer which send and fetch records over a period of time. Then create a test that will change leadership for topic-partitions while these entities are running. The producer and consumer should continue working even in the face of leadership changes.
Develop a new service, somewhat akin to
KgoVerifierService
, that will exercise pandaproxy and verify that the same data that was produced was consumed.JIRA Link: CORE-1192