rollno748 / di-kafkameter

JMeter Plugin to load test Apache Kafka topics/brokers
34 stars 11 forks source link

Kafka Produce Config could not replicate distributed messages #16

Closed yichulau closed 1 year ago

yichulau commented 1 year ago

Hi is there a configuration that allows to configure such that the messages are send in distributed manner? Because when i did a load test, the messages will only send to one partition.

For example, i had a topic called 'test-topic' and 3 partition, when i run the jmeter, it will randomly choose one partition, and send all the message to the partition, instead of evenly distributed.

Illustration: Topic: test-topic Amount of message to send: 5 message

Current scenario: partition-0: 5 partition-1: 0 partition-2 : 0

Desired output (more distributed): partition-0:1 partition-1:2 partition-3: 2

Here is my config:

Screenshot 2023-06-29 132839
rollno748 commented 1 year ago

Hello @yichulau

If you want to circulate the distribution among the partitions then you need to set the logic using counter/JSR223 Preprcessor

And you need to define the partition number in Partition String (on the Producer sampler)

image

rollno748 commented 1 year ago

Hi @yichulau

Any update on this ?

rollno748 commented 1 year ago

Hey @yichulau I am closing this issue - As I don't see any response from you. Please feel free to re-open it, if still the issue persist