search

Netflix / Hystrix

Hystrix is a latency and fault tolerance library designed to isolate points of access to remote systems, services and 3rd party libraries, stop cascading failure and enable resilience in complex distributed systems where failure is inevitable.
24.15k stars 4.71k forks source link

Question: Seeing number of state changes in Hystrix #1790

Open axelg12 opened 6 years ago

axelg12 commented 6 years ago

I've recently been integrating Hystrix Circuit breakers into my application. I'm happy to say that everything has gone well and so far I've been using the Hystrix dashboard to monitor the state of the circuit. What I find missing from that is how often the circuit breaker is trip.

I'm running this in a system that has a lot of monitoring due to its nature. One of the things I wanted to monitor was to track how often the circuit breakers (like a simple counter). I've looked at Hystrix event notifier, but it doesn't give me how often the state changes. I might receive circuit open event two times in a row, but that doesn't mean that the circuit opened, closed and then opened again.

I've also looked at Hystrix Metric publisher, from which I can check if the circuit is open. From there / based on it I could increment a counter, but since it is based on time intervals, it doesn't guarantee that I will actually catch a change.

Is there any way to know how often Hystrix trips the circuit breaker? Am I misunderstanding either the event notifier or metric publisher?

TomCools commented 6 years ago

From what i have seen in the Hystrix.Stream, it will only show you the current state of the circuit breaker. I do not think you can see how many times the circuit was broken.

What is the use-case for this? Maybe we can find another way to help you find what you need.