search

benchflow / collectors

Collectors microservices utilised to collect relevant data from containers
Other
1 stars 1 forks source link

Possible Bug: Sarama Kafka interacting with Kafka #87

Open VincenzoFerme opened 8 years ago

VincenzoFerme commented 8 years ago

Refer to https://github.com/Shopify/sarama/issues/272 and monitor the cases in which this bug occurs, evaluation a possible workaround.

A possible workaround, or at least safe error detection, would be to retry and if not possible fail and manage the fails, when the following error occurs: LeaderNotAvailable (https://cwiki.apache.org/confluence/display/KAFKA/A+Guide+To+The+Kafka+Protocol), because that is the cause.

Of course, we first need to enable execution log collection: https://github.com/benchflow/collectors/issues/43

nobody4t commented 6 years ago

If this is a bug, why it is still open and this is opened in 2016????

VincenzoFerme commented 6 years ago

Dear @WandyLau, the project evolved quite a lot over time, and being limited in people working on it and time you might find cases like this one, where issues reporting possible Bugs are not updated. Sorry for that.

nobody4t commented 6 years ago

@VincenzoFerme Thanks for reply. I asked this because we may got this issue in our system. And we made some workaround. I hope this can been resolved soon or some updated will be appreciated.

VincenzoFerme commented 6 years ago

Are you using any of the BenchFlow collectors? If yes, we can discuss this issue and I might find some time to work on them according to your requirements.

nobody4t commented 6 years ago

I thought this is the root cause of Shopify/sarama#272 . We do not use this collectors. We are using sarama.

VincenzoFerme commented 5 years ago

I see, no, this issues describes how our service is affected by Shopify/sarama#272.