Open dotnwat opened 2 years ago
This probably maps pretty directly to https://github.com/vectorizedio/redpanda/issues/3409 (see comment there about the two configs we currently have related to limiting fetch bytes)
initial plan of attack:
implement more general solution based on https://github.com/redpanda-data/redpanda/pull/3420
@jcsp does that sound reasonable?
@LenaAn Exactly :ok_hand:
You may also find the new many_partitions_test.py a useful basis for testing this -- when it constructs a topic with 1024 partitions and then reads with a single consumer, that should stress the fetch size.
This probably maps pretty directly to https://github.com/redpanda-data/redpanda/issues/3409
lots of good discussion in #3409
As agreed with @piyushredpanda , this has lower priority than ci failures now
JIRA Link: CORE-832