mailgun / kafka-pixy

gRPC/REST proxy for Kafka
Apache License 2.0
773 stars 118 forks source link

Consumption from a topic stopped for a group #120

Closed horkhe closed 7 years ago

horkhe commented 7 years ago

Consume requests for a group started to return long polling timeout errors even though other consumer groups kept consuming messages from the same topic. Consumption resumed after Kafka-Pixy had been restarted. At the time of the incident the following records appeared in the log:

10/16/17, 16:51:37.686 Disposed of child: key=use1_user_events, left=3
10/16/17, 16:51:37.682 Topic subscription expired
10/16/17, 16:51:37.686 Topic subscription expired
10/16/17, 16:51:37.686 Disposed of child: key=use1_pipeline_events, left=2
10/16/17, 16:51:37.696 Submitted: topics=[address_verify use1_pipeline_events use1_scout_recount]
10/16/17, 16:51:37.709 Submitted: topics=[address_verify use1_scout_recount]
10/16/17, 16:51:37.906 Spawning child: key=use1_pipeline_events
10/16/17, 16:51:37.907 Spawning child: key=use1_user_events
10/16/17, 16:51:37.920 Submitted: topics=[address_verify use1_pipeline_events use1_scout_recount]
10/16/17, 16:51:38.136 Submitted: topics=[address_verify use1_pipeline_events use1_scout_recount use1_user_events]
10/16/17, 16:51:38.391 Redundant group update ignored: map[pixy_worker-n06_2017-09-08T13.59.49Z_128791:[address_verify use1_pipeline_events use1_scout_recount use1_user_events] pixy_worker-n04_2017-09-29T08.39.54Z_125653:[address_verify use1_pipeline_events use1_scout_recount use1_user_events] pixy_worker-n05_2017-09-08T13.59.48Z_40662:[address_verify use1_pipeline_events use1_scout_recount use1_user_events] pixy_worker-n02_2017-09-08T13.59.26Z_123919:[address_verify use1_pipeline_events use1_scout_recount use1_user_events] pixy_worker-n01_2017-09-29T08.37.37Z_69544:[address_verify use1_pipeline_events use1_scout_recount use1_user_events] pixy_worker-n03_2017-09-08T14.18.32Z_93190:[address_verify use1_pipeline_events use1_scout_recount use1_user_events] pixy_worker-n07_2017-09-08T14.00.12Z_99606:[address_verify use1_pipeline_events use1_scout_recount use1_user_events]]
10/16/17, 16:51:38.391 Redundant group update ignored: map[pixy_worker-n06_2017-09-08T13.59.49Z_128791:[address_verify use1_pipeline_events use1_scout_recount use1_user_events] pixy_worker-n04_2017-09-29T08.39.54Z_125653:[address_verify use1_pipeline_events use1_scout_recount use1_user_events] pixy_worker-n05_2017-09-08T13.59.48Z_40662:[address_verify use1_pipeline_events use1_scout_recount use1_user_events] pixy_worker-n02_2017-09-08T13.59.26Z_123919:[address_verify use1_pipeline_events use1_scout_recount use1_user_events] pixy_worker-n01_2017-09-29T08.37.37Z_69544:[address_verify use1_pipeline_events use1_scout_recount use1_user_events] pixy_worker-n03_2017-09-08T14.18.32Z_93190:[address_verify use1_pipeline_events use1_scout_recount use1_user_events] pixy_worker-n07_2017-09-08T14.00.12Z_99606:[address_verify use1_pipeline_events use1_scout_recount use1_user_events]]
10/16/17, 16:51:38.391 Fetched subscriptions: map[pixy_worker-n05_2017-09-08T13.59.48Z_40662:[address_verify use1_pipeline_events use1_scout_recount use1_user_events] pixy_worker-n02_2017-09-08T13.59.26Z_123919:[address_verify use1_pipeline_events use1_scout_recount use1_user_events] pixy_worker-n01_2017-09-29T08.37.37Z_69544:[address_verify use1_pipeline_events use1_scout_recount use1_user_events] pixy_worker-n03_2017-09-08T14.18.32Z_93190:[address_verify use1_pipeline_events use1_scout_recount use1_user_events] pixy_worker-n07_2017-09-08T14.00.12Z_99606:[address_verify use1_pipeline_events use1_scout_recount use1_user_events] pixy_worker-n06_2017-09-08T13.59.49Z_128791:[address_verify use1_pipeline_events use1_scout_recount use1_user_events] pixy_worker-n04_2017-09-29T08.39.54Z_125653:[address_verify use1_pipeline_events use1_scout_recount use1_user_events]]