search

marcin-krystianc / KafkaPlayground

Apache License 2.0
0 stars 0 forks source link

DeliveryReport.Error, Code = Local_MsgTimedOut when performin a rolling restart #1

Open marcin-krystianc opened 1 week ago

marcin-krystianc commented 1 week ago 
dotnet run --project  "D:\workspace\KafkaPlayground\dotnet\KafkaTool.csproj" producer --ini-file="D:\workspace\KafkaPlayground\dotnet\kafka.ini" --topics=300 --partitions=10  --replication-factor=2 --producers=100 --messages-per-second=1000
%4|1718639216.316|CONFWARN|rdkafka#producer-1| [thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer7[0] Starting producer task: 7
17:46:56 info: Producer3[0] Starting producer task: 3
17:46:56 info: Producer13[0] Starting producer task: 13
17:46:56 info: Producer1[0] Starting producer task: 1
17:46:56 info: Producer10[0] Starting producer task: 10
17:46:56 info: Producer0[0] Starting producer task: 0
17:46:56 info: Producer14[0] Starting producer task: 14
17:46:56 info: Producer8[0] Starting producer task: 8
17:46:56 info: Producer16[0] Starting producer task: 16
17:46:56 info: Producer4[0] Starting producer task: 4
17:46:56 info: Producer15[0] Starting producer task: 15
17:46:56 info: Producer18[0] Starting producer task: 18
17:46:56 info: Producer5[0] Starting producer task: 5
17:46:56 info: Producer2[0] Starting producer task: 2
17:46:56 info: Producer19[0] Starting producer task: 19
17:46:56 info: Producer12[0] Starting producer task: 12
17:46:56 info: Producer11[0] Starting producer task: 11
17:46:56 info: Producer6[0] Starting producer task: 6
17:46:56 info: Producer17[0] Starting producer task: 17
17:46:56 info: Producer9[0] Starting producer task: 9
17:46:56 info: Producer12[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer0[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer5[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer15[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer7[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer3[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer19[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer6[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer18[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer4[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer1[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer8[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer13[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer16[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer9[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer2[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer11[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer17[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer10[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer14[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer22[0] Starting producer task: 22
17:46:56 info: Producer21[0] Starting producer task: 21
17:46:56 info: Producer24[0] Starting producer task: 24
17:46:56 info: Producer23[0] Starting producer task: 23
17:46:56 info: Producer20[0] Starting producer task: 20
17:46:56 info: Producer25[0] Starting producer task: 25
17:46:56 info: Producer26[0] Starting producer task: 26
17:46:56 info: Producer28[0] Starting producer task: 28
17:46:56 info: Producer22[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer27[0] Starting producer task: 27
17:46:56 info: Producer23[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer21[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer20[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer24[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer26[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer28[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer25[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer27[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer29[0] Starting producer task: 29
17:46:56 info: Producer30[0] Starting producer task: 30
17:46:56 info: Producer38[0] Starting producer task: 38
17:46:56 info: Producer36[0] Starting producer task: 36
17:46:56 info: Producer37[0] Starting producer task: 37
17:46:56 info: Producer39[0] Starting producer task: 39
17:46:56 info: Producer34[0] Starting producer task: 34
17:46:56 info: Producer32[0] Starting producer task: 32
17:46:56 info: Producer40[0] Starting producer task: 40
17:46:56 info: Producer29[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer42[0] Starting producer task: 42
17:46:56 info: Producer47[0] Starting producer task: 47
17:46:56 info: Producer46[0] Starting producer task: 46
17:46:56 info: Producer41[0] Starting producer task: 41
17:46:56 info: Producer48[0] Starting producer task: 48
17:46:56 info: Producer43[0] Starting producer task: 43
17:46:56 info: Producer45[0] Starting producer task: 45
17:46:56 info: Producer31[0] Starting producer task: 31
17:46:56 info: Producer44[0] Starting producer task: 44
17:46:56 info: Producer33[0] Starting producer task: 33
17:46:56 info: Producer35[0] Starting producer task: 35
17:46:56 info: Producer49[0] Starting producer task: 49
17:46:56 info: Producer36[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer30[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer45[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer38[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer48[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer44[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer37[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer41[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer40[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer42[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer34[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer32[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer46[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer39[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer43[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer52[0] Starting producer task: 52
17:46:56 info: Producer35[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer47[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer53[0] Starting producer task: 53
17:46:56 info: Producer33[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer50[0] Starting producer task: 50
17:46:56 info: Producer31[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer49[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer51[0] Starting producer task: 51
17:46:56 info: Producer52[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer53[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer50[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer55[0] Starting producer task: 55
17:46:56 info: Producer56[0] Starting producer task: 56
17:46:56 info: Producer54[0] Starting producer task: 54
17:46:56 info: Producer57[0] Starting producer task: 57
17:46:56 info: Producer60[0] Starting producer task: 60
17:46:56 info: Producer58[0] Starting producer task: 58
17:46:56 info: Producer59[0] Starting producer task: 59
17:46:56 info: Producer61[0] Starting producer task: 61
17:46:56 info: Producer51[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer63[0] Starting producer task: 63
17:46:56 info: Producer62[0] Starting producer task: 62
17:46:56 info: Producer60[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer65[0] Starting producer task: 65
17:46:56 info: Producer67[0] Starting producer task: 67
17:46:56 info: Producer59[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer66[0] Starting producer task: 66
17:46:56 info: Producer68[0] Starting producer task: 68
17:46:56 info: Producer54[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer55[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer61[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer58[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer63[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer64[0] Starting producer task: 64
17:46:56 info: Producer57[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer56[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer62[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer69[0] Starting producer task: 69
17:46:56 info: Producer70[0] Starting producer task: 70
17:46:56 info: Producer67[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer65[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer71[0] Starting producer task: 71
17:46:56 info: Producer66[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer68[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer72[0] Starting producer task: 72
17:46:56 info: Producer64[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer75[0] Starting producer task: 75
17:46:56 info: Producer81[0] Starting producer task: 81
17:46:56 info: Producer73[0] Starting producer task: 73
17:46:56 info: Producer69[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer82[0] Starting producer task: 82
17:46:56 info: Producer70[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer71[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer75[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer81[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer84[0] Starting producer task: 84
17:46:56 info: Producer78[0] Starting producer task: 78
17:46:56 info: Producer76[0] Starting producer task: 76
17:46:56 info: Producer72[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer77[0] Starting producer task: 77
17:46:56 info: Producer80[0] Starting producer task: 80
17:46:56 info: Producer76[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer74[0] Starting producer task: 74
17:46:56 info: Producer78[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer82[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer84[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer83[0] Starting producer task: 83
17:46:56 info: Producer73[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer77[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer90[0] Starting producer task: 90
17:46:56 info: Producer89[0] Starting producer task: 89
17:46:56 info: Producer74[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer92[0] Starting producer task: 92
17:46:56 info: Producer93[0] Starting producer task: 93
17:46:56 info: Producer87[0] Starting producer task: 87
17:46:56 info: Producer85[0] Starting producer task: 85
17:46:56 info: Producer86[0] Starting producer task: 86
17:46:56 info: Producer83[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer88[0] Starting producer task: 88
17:46:56 info: Producer79[0] Starting producer task: 79
17:46:56 info: Producer80[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer91[0] Starting producer task: 91
17:46:56 info: Producer90[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer89[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer97[0] Starting producer task: 97
17:46:56 info: Producer85[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer93[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer79[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer86[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer96[0] Starting producer task: 96
17:46:56 info: Producer87[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer92[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer95[0] Starting producer task: 95
17:46:56 info: Producer97[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer91[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer98[0] Starting producer task: 98
17:46:56 info: Producer94[0] Starting producer task: 94
17:46:56 info: Producer88[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer99[0] Starting producer task: 99
17:46:56 info: Producer96[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer95[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer98[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer94[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:46:56 info: Producer99[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:47:06 info: Producer[0] Elapsed: 10s, 9314 (+9314) messages produced
17:47:16 info: Producer[0] Elapsed: 20s, 17971 (+8657) messages produced
17:47:26 info: Producer[0] Elapsed: 30s, 30000 (+12029) messages produced
17:47:36 info: Producer[0] Elapsed: 40s, 40000 (+10000) messages produced
17:47:46 info: Producer[0] Elapsed: 50s, 50000 (+10000) messages produced
17:47:56 info: Producer[0] Elapsed: 60s, 60000 (+10000) messages produced
17:48:06 info: Producer[0] Elapsed: 70s, 70000 (+10000) messages produced
17:48:16 info: Producer[0] Elapsed: 80s, 80000 (+10000) messages produced
17:48:26 info: Producer[0] Elapsed: 90s, 90000 (+10000) messages produced
17:48:36 info: Producer[0] Elapsed: 100s, 98007 (+8007) messages produced
17:48:46 info: Producer[0] Elapsed: 110s, 105839 (+7832) messages produced
17:48:56 info: Producer[0] Elapsed: 120s, 117848 (+12009) messages produced
17:49:06 info: Producer[0] Elapsed: 130s, 129071 (+11223) messages produced
17:49:16 info: Producer[0] Elapsed: 140s, 139000 (+9929) messages produced
17:49:26 info: Producer[0] Elapsed: 150s, 149000 (+10000) messages produced
17:49:36 info: Producer[0] Elapsed: 160s, 159000 (+10000) messages produced
17:49:46 info: Producer[0] Elapsed: 170s, 169000 (+10000) messages produced
17:49:56 info: Producer[0] Elapsed: 180s, 178277 (+9277) messages produced
17:50:06 info: Producer[0] Elapsed: 190s, 187047 (+8770) messages produced
17:50:16 info: Producer[0] Elapsed: 200s, 198112 (+11065) messages produced
17:50:26 info: Producer[0] Elapsed: 210s, 208928 (+10816) messages produced
17:50:36 info: Producer[0] Elapsed: 220s, 219000 (+10072) messages produced
17:50:46 info: Producer[0] Elapsed: 230s, 227942 (+8942) messages produced
17:50:56 info: Producer[0] Elapsed: 240s, 238433 (+10491) messages produced
17:51:06 info: Producer[0] Elapsed: 250s, 248442 (+10009) messages produced
17:51:16 info: Producer[0] Elapsed: 260s, 258004 (+9562) messages produced
17:51:26 info: Producer[0] Elapsed: 270s, 268046 (+10042) messages produced
17:51:36 info: Producer[0] Elapsed: 280s, 278000 (+9954) messages produced
17:51:46 info: Producer[0] Elapsed: 290s, 287067 (+9067) messages produced
17:51:56 info: Producer[0] Elapsed: 300s, 297960 (+10893) messages produced
17:52:06 info: Producer[0] Elapsed: 310s, 306366 (+8406) messages produced
17:52:16 info: Producer[0] Elapsed: 320s, 318000 (+11634) messages produced
%6|1718639538.828|FAIL|rdkafka#producer-1| [thrd:localhost:40003/bootstrap]: localhost:40003/3: Disconnected (after 83723ms in state UP)
%3|1718639538.830|ERROR|rdkafka#producer-1| [thrd:localhost:40003/bootstrap]: 3/3 brokers are down
%3|1718639538.831|ERROR|rdkafka#producer-1| [thrd:app]: rdkafka#producer-1: localhost:40003/3: Disconnected (after 83723ms in state UP)
17:52:26 info: Producer[0] Elapsed: 330s, 328000 (+10000) messages produced
17:52:36 info: Producer[0] Elapsed: 340s, 338000 (+10000) messages produced
17:52:46 info: Producer[0] Elapsed: 350s, 347999 (+9999) messages produced
17:52:56 info: Producer[0] Elapsed: 360s, 357308 (+9309) messages produced
17:53:06 info: Producer[0] Elapsed: 370s, 366107 (+8799) messages produced
17:53:16 info: Producer[0] Elapsed: 380s, 377906 (+11799) messages produced
17:53:26 info: Producer[0] Elapsed: 390s, 387000 (+9094) messages produced
17:53:36 info: Producer[0] Elapsed: 400s, 397052 (+10052) messages produced
17:53:46 info: Producer[0] Elapsed: 410s, 406816 (+9764) messages produced
%3|1718639629.146|ERROR|rdkafka#producer-1| [thrd:localhost:40001/bootstrap]: 3/3 brokers are down
17:53:49 info: Producer55[0] kafka-log Facility:FAIL, Message[thrd:localhost:40001/bootstrap]: localhost:40001/1: Disconnected while requesting ApiVersion: might be caused by incorrect security.protocol configuration (connecting to a SSL listener?) or broker version is < 0.10 (see api.version.request) (after 14ms in state APIVERSION_QUERY)
17:53:49 info: Producer55[0] kafka-log Facility:ERROR, Message[thrd:app]: rdkafka#producer-62: localhost:40001/1: Disconnected while requesting ApiVersion: might be caused by incorrect security.protocol configuration (connecting to a SSL listener?) or broker version is < 0.10 (see api.version.request) (after 14ms in state APIVERSION_QUERY)
17:53:49 info: Producer67[0] kafka-log Facility:FAIL, Message[thrd:localhost:40001/bootstrap]: localhost:40001/1: Disconnected while requesting ApiVersion: might be caused by incorrect security.protocol configuration (connecting to a SSL listener?) or broker version is < 0.10 (see api.version.request) (after 15ms in state APIVERSION_QUERY)
17:53:49 info: Producer67[0] kafka-log Facility:ERROR, Message[thrd:app]: rdkafka#producer-67: localhost:40001/1: Disconnected while requesting ApiVersion: might be caused by incorrect security.protocol configuration (connecting to a SSL listener?) or broker version is < 0.10 (see api.version.request) (after 15ms in state APIVERSION_QUERY)
17:53:56 info: Producer[0] Elapsed: 420s, 417000 (+10184) messages produced
17:54:06 info: Producer[0] Elapsed: 430s, 427000 (+10000) messages produced
17:54:16 info: Producer[0] Elapsed: 440s, 437000 (+10000) messages produced
17:54:24 info: Producer55[0] kafka-log Facility:FAIL, Message[thrd:localhost:40001/bootstrap]: localhost:40001/1: Disconnected while requesting ApiVersion: might be caused by incorrect security.protocol configuration (connecting to a SSL listener?) or broker version is < 0.10 (see api.version.request) (after 1ms in state APIVERSION_QUERY, 7 identical error(s) suppressed)
17:54:24 info: Producer55[0] kafka-log Facility:ERROR, Message[thrd:app]: rdkafka#producer-62: localhost:40001/1: Disconnected while requesting ApiVersion: might be caused by incorrect security.protocol configuration (connecting to a SSL listener?) or broker version is < 0.10 (see api.version.request) (after 1ms in state APIVERSION_QUERY, 7 identical error(s) suppressed)
17:54:25 info: Producer67[0] kafka-log Facility:FAIL, Message[thrd:localhost:40001/bootstrap]: localhost:40001/1: Disconnected while requesting ApiVersion: might be caused by incorrect security.protocol configuration (connecting to a SSL listener?) or broker version is < 0.10 (see api.version.request) (after 0ms in state APIVERSION_QUERY, 7 identical error(s) suppressed)
17:54:25 info: Producer67[0] kafka-log Facility:ERROR, Message[thrd:app]: rdkafka#producer-67: localhost:40001/1: Disconnected while requesting ApiVersion: might be caused by incorrect security.protocol configuration (connecting to a SSL listener?) or broker version is < 0.10 (see api.version.request) (after 0ms in state APIVERSION_QUERY, 7 identical error(s) suppressed)
17:54:26 info: Producer[0] Elapsed: 450s, 447000 (+10000) messages produced
17:54:36 info: Producer[0] Elapsed: 460s, 456127 (+9127) messages produced
17:54:46 info: Producer[0] Elapsed: 470s, 464266 (+8139) messages produced
17:54:57 info: Producer[0] Elapsed: 480s, 473992 (+9726) messages produced
17:55:03 info: Producer99[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer97[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer80[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer97[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer80[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer97[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer80[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer80[0] Exception: DeliveryReport.Error, Code = Local_MsgTimedOut, Reason = Local: Message timed out, IsFatal = False, IsError = True, IsLocalError = True, IsBrokerError = False, topic = topic126, partition = 8, partitionsCount = 10
17:55:03 info: Producer97[0] Exception: DeliveryReport.Error, Code = Local_MsgTimedOut, Reason = Local: Message timed out, IsFatal = False, IsError = True, IsLocalError = True, IsBrokerError = False, topic = topic126, partition = 8, partitionsCount = 10
17:55:03 info: Producer99[0] Exception: DeliveryReport.Error, Code = Local_MsgTimedOut, Reason = Local: Message timed out, IsFatal = False, IsError = True, IsLocalError = True, IsBrokerError = False, topic = topic126, partition = 8, partitionsCount = 10
17:55:03 info: Producer97[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer80[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer97[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer80[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer80[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer97[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer97[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer80[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer97[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer80[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer80[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer97[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer97[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer80[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer97[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer80[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer97[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer97[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer97[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer97[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer97[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer97[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer97[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer97[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer97[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer97[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer97[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer97[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer97[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer97[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer97[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer97[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer97[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
17:55:03 info: Producer97[0] kafka-log Facility:CONFWARN, Message[thrd:app]: Configuration property allow.auto.create.topics is a consumer property and will be ignored by this producer instance
Error: DeliveryReport.Error, Code = Local_MsgTimedOut, Reason = Local: Message timed out, IsFatal = False, IsError = True, IsLocalError = True, IsBrokerError = False, topic = topic126, partition = 8, partitionsCount = 10
marcin-krystianc commented 1 week ago

cluster-log | grep -i "topic126-8" -> topic126-8.txt cluster-log | tail -n 50000 -> tail.txt

marcin-krystianc commented 1 week ago

Rolling restart log:

 .\rolling-restart.ps1
2024-06-17 17:25:24  Stopping container: kafka-1
2024-06-17 17:25:24  Waiting for container to stop...
2024-06-17 17:26:16  Container has stopped.
2024-06-17 17:26:16  Starting container: kafka-1
kafka-1
2024-06-17 17:26:17  Container started. Waiting for cluster to catch-up
2024-06-17 17:26:45  Waiting 30s for cluster to rebalance
2024-06-17 17:27:15  Stopping container: kafka-2
2024-06-17 17:27:15  Waiting for container to stop...
2024-06-17 17:27:50  Container has stopped.
2024-06-17 17:27:50  Starting container: kafka-2
kafka-2
2024-06-17 17:27:51  Container started. Waiting for cluster to catch-up
2024-06-17 17:28:00  Waiting 30s for cluster to rebalance
2024-06-17 17:28:30  Stopping container: kafka-3
2024-06-17 17:28:30  Waiting for container to stop...
2024-06-17 17:28:33  Container has stopped.
2024-06-17 17:28:33  Starting container: kafka-3
kafka-3
2024-06-17 17:28:33  Container started. Waiting for cluster to catch-up
2024-06-17 17:28:46  Waiting 30s for cluster to rebalance
2024-06-17 17:29:16  Stopping container: kafka-1
2024-06-17 17:29:16  Waiting for container to stop...
2024-06-17 17:29:56  Container has stopped.
2024-06-17 17:29:56  Starting container: kafka-1
kafka-1
2024-06-17 17:29:57  Container started. Waiting for cluster to catch-up
2024-06-17 17:30:13  Waiting 30s for cluster to rebalance
2024-06-17 17:30:43  Stopping container: kafka-2
2024-06-17 17:30:43  Waiting for container to stop...
2024-06-17 17:31:15  Container has stopped.
2024-06-17 17:31:15  Starting container: kafka-2
kafka-2
2024-06-17 17:31:15  Container started. Waiting for cluster to catch-up
2024-06-17 17:31:26  Waiting 30s for cluster to rebalance
2024-06-17 17:31:56  Stopping container: kafka-3
2024-06-17 17:31:56  Waiting for container to stop...
2024-06-17 17:32:25  Container has stopped.
2024-06-17 17:32:25  Starting container: kafka-3
kafka-3
2024-06-17 17:32:25  Container started. Waiting for cluster to catch-up
2024-06-17 17:32:35  Waiting 30s for cluster to rebalance
2024-06-17 17:33:05  Stopping container: kafka-1
2024-06-17 17:33:05  Waiting for container to stop...
2024-06-17 17:33:39  Container has stopped.
2024-06-17 17:33:39  Starting container: kafka-1
kafka-1
2024-06-17 17:33:40  Container started. Waiting for cluster to catch-up
2024-06-17 17:34:04  Waiting 30s for cluster to rebalance
2024-06-17 17:34:34  Stopping container: kafka-2
2024-06-17 17:34:34  Waiting for container to stop...
2024-06-17 17:35:16  Container has stopped.
2024-06-17 17:35:16  Starting container: kafka-2
kafka-2
2024-06-17 17:35:16  Container started. Waiting for cluster to catch-up
2024-06-17 17:35:27  Waiting 30s for cluster to rebalance
2024-06-17 17:35:57  Stopping container: kafka-3
2024-06-17 17:35:58  Waiting for container to stop...
2024-06-17 17:36:35  Container has stopped.
2024-06-17 17:36:35  Starting container: kafka-3
kafka-3
2024-06-17 17:36:35  Container started. Waiting for cluster to catch-up
2024-06-17 17:36:45  Waiting 30s for cluster to rebalance
2024-06-17 17:37:15  Stopping container: kafka-1
2024-06-17 17:37:15  Waiting for container to stop...
2024-06-17 17:37:54  Container has stopped.
2024-06-17 17:37:54  Starting container: kafka-1
kafka-1
2024-06-17 17:37:55  Container started. Waiting for cluster to catch-up
2024-06-17 17:38:11  Waiting 30s for cluster to rebalance
2024-06-17 17:38:41  Stopping container: kafka-2
2024-06-17 17:38:41  Waiting for container to stop...
2024-06-17 17:39:06  Container has stopped.
2024-06-17 17:39:06  Starting container: kafka-2
kafka-2
2024-06-17 17:39:06  Container started. Waiting for cluster to catch-up
2024-06-17 17:39:16  Waiting 30s for cluster to rebalance
2024-06-17 17:39:46  Stopping container: kafka-3
2024-06-17 17:39:47  Waiting for container to stop...
2024-06-17 17:40:08  Container has stopped.
2024-06-17 17:40:08  Starting container: kafka-3
kafka-3
2024-06-17 17:40:09  Container started. Waiting for cluster to catch-up
2024-06-17 17:40:20  Waiting 30s for cluster to rebalance
2024-06-17 17:40:50  Stopping container: kafka-1
2024-06-17 17:40:50  Waiting for container to stop...
2024-06-17 17:41:17  Container has stopped.
2024-06-17 17:41:17  Starting container: kafka-1
kafka-1
2024-06-17 17:41:18  Container started. Waiting for cluster to catch-up
2024-06-17 17:41:34  Waiting 30s for cluster to rebalance
2024-06-17 17:42:04  Stopping container: kafka-2
2024-06-17 17:42:05  Waiting for container to stop...
2024-06-17 17:42:29  Container has stopped.
2024-06-17 17:42:29  Starting container: kafka-2
kafka-2
2024-06-17 17:42:29  Container started. Waiting for cluster to catch-up
2024-06-17 17:42:40  Waiting 30s for cluster to rebalance
2024-06-17 17:43:10  Stopping container: kafka-3
2024-06-17 17:43:10  Waiting for container to stop...
2024-06-17 17:43:34  Container has stopped.
2024-06-17 17:43:34  Starting container: kafka-3
kafka-3
2024-06-17 17:43:34  Container started. Waiting for cluster to catch-up
2024-06-17 17:43:45  Waiting 30s for cluster to rebalance
2024-06-17 17:44:15  Stopping container: kafka-1
2024-06-17 17:44:15  Waiting for container to stop...
2024-06-17 17:44:51  Container has stopped.
2024-06-17 17:44:51  Starting container: kafka-1
kafka-1
2024-06-17 17:44:51  Container started. Waiting for cluster to catch-up
2024-06-17 17:45:24  Waiting 30s for cluster to rebalance
2024-06-17 17:45:54  Stopping container: kafka-2
2024-06-17 17:45:54  Waiting for container to stop...
2024-06-17 17:46:27  Container has stopped.
2024-06-17 17:46:27  Starting container: kafka-2
kafka-2
2024-06-17 17:46:27  Container started. Waiting for cluster to catch-up
2024-06-17 17:46:37  Waiting 30s for cluster to rebalance
2024-06-17 17:47:07  Stopping container: kafka-3
2024-06-17 17:47:08  Waiting for container to stop...
2024-06-17 17:47:48  Container has stopped.
2024-06-17 17:47:48  Starting container: kafka-3
kafka-3
2024-06-17 17:47:48  Container started. Waiting for cluster to catch-up
2024-06-17 17:48:06  Waiting 30s for cluster to rebalance
2024-06-17 17:48:36  Stopping container: kafka-1
2024-06-17 17:48:36  Waiting for container to stop...
2024-06-17 17:49:27  Container has stopped.
2024-06-17 17:49:27  Starting container: kafka-1
kafka-1
2024-06-17 17:49:28  Container started. Waiting for cluster to catch-up
2024-06-17 17:50:06  Waiting 30s for cluster to rebalance
2024-06-17 17:50:36  Stopping container: kafka-2
2024-06-17 17:50:36  Waiting for container to stop...
2024-06-17 17:51:13  Container has stopped.
2024-06-17 17:51:13  Starting container: kafka-2
kafka-2
2024-06-17 17:51:13  Container started. Waiting for cluster to catch-up
2024-06-17 17:51:30  Waiting 30s for cluster to rebalance
2024-06-17 17:52:00  Stopping container: kafka-3
2024-06-17 17:52:00  Waiting for container to stop...
2024-06-17 17:52:41  Container has stopped.
2024-06-17 17:52:41  Starting container: kafka-3
kafka-3
2024-06-17 17:52:41  Container started. Waiting for cluster to catch-up
2024-06-17 17:53:04  Waiting 30s for cluster to rebalance
2024-06-17 17:53:34  Stopping container: kafka-1
2024-06-17 17:53:34  Waiting for container to stop...
2024-06-17 17:54:07  Container has stopped.
2024-06-17 17:54:07  Starting container: kafka-1
kafka-1
2024-06-17 17:54:08  Container started. Waiting for cluster to catch-up
2024-06-17 17:54:33  Waiting 30s for cluster to rebalance
2024-06-17 17:55:03  Stopping container: kafka-2
2024-06-17 17:55:03  Waiting for container to stop...
2024-06-17 17:56:01  Container has stopped.
2024-06-17 17:56:01  Starting container: kafka-2
marcin-krystianc commented 1 week ago

I think this is relevant ('topic126-8.txt'):

    Line   73: kafka-1  | [2024-06-17 15:30:11,495] WARN [ReplicaFetcher replicaId=1, leaderId=3, fetcherId=0] Partition topic126-8 marked as failed (kafka.server.ReplicaFetcherThread)
    Line  382: kafka-3  | [2024-06-17 15:33:05,922] WARN [ReplicaFetcher replicaId=3, leaderId=1, fetcherId=0] Partition topic126-8 marked as failed (kafka.server.ReplicaFetcherThread)
    Line  755: kafka-3  | [2024-06-17 15:37:15,831] WARN [ReplicaFetcher replicaId=3, leaderId=1, fetcherId=0] Partition topic126-8 marked as failed (kafka.server.ReplicaFetcherThread)
    Line 1083: kafka-3  | [2024-06-17 15:40:50,646] WARN [ReplicaFetcher replicaId=3, leaderId=1, fetcherId=0] Partition topic126-8 marked as failed (kafka.server.ReplicaFetcherThread)
    Line 1461: kafka-3  | [2024-06-17 15:44:16,388] WARN [ReplicaFetcher replicaId=3, leaderId=1, fetcherId=0] Partition topic126-8 marked as failed (kafka.server.ReplicaFetcherThread)
    Line 1491: kafka-1  | [2024-06-17 15:45:17,802] WARN [ReplicaFetcher replicaId=1, leaderId=3, fetcherId=0] Partition topic126-8 marked as failed (kafka.server.ReplicaFetcherThread)
    Line 1996: kafka-3  | [2024-06-17 15:48:37,050] WARN [ReplicaFetcher replicaId=3, leaderId=1, fetcherId=0] Partition topic126-8 marked as failed (kafka.server.ReplicaFetcherThread)
    Line 2170: kafka-1  | [2024-06-17 15:50:20,241] WARN [ReplicaFetcher replicaId=1, leaderId=3, fetcherId=0] Partition topic126-8 marked as failed (kafka.server.ReplicaFetcherThread)
    Line 3252: kafka-3  | [2024-06-17 15:53:35,076] WARN [ReplicaFetcher replicaId=3, leaderId=1, fetcherId=0] Partition topic126-8 marked as failed (kafka.server.ReplicaFetcherThread)
    Line 3332: kafka-1  | [2024-06-17 15:54:33,799] WARN [ReplicaFetcher replicaId=1, leaderId=3, fetcherId=0] Partition topic126-8 marked as failed (kafka.server.ReplicaFetcherThread)