search

graphite-project / graphite-web

A highly scalable real-time graphing system
http://graphite.readthedocs.org/
Apache License 2.0
5.88k stars 1.26k forks source link

[Q]Graphs not populating and I'm not sure why #2788

Closed itinneed2022 closed 1 year ago

itinneed2022 commented 1 year ago

Beginning at 9 am EST and ending around 12 pm EST, some metrics in the Graphite web-app do not update. There is zero commonality between the metrics that do not populate and the ones that do. I can check the carbon-cache logs and they are updating regularly. So carbon is updating. Same for the carbon-relay log. Following metricfire's blog I updated the carbon-hashing algorithm and reduced the memcached values but these changes made zero difference.

I'm not sure where to take the troubleshooting next. If the carbon daemons are working and the relay is working, it has to be the graphite-web right?

deniszh commented 1 year ago

Hi @itinneed2022

Unfortunately, Graphite is quite complex software and I'm not sure that it's possible to give you interactive troubleshooting session over github issues. You can try to give us more information though - more symptoms, configs, logs etc - maybe we can found there.

itinneed2022 commented 1 year ago

@deniszh I'm looking for more of general advice on what to look at next. Something I noticed yesterday when I restart the graphite web and carbon services (cache and relay), I suddenly received an update on all the metrics that had not been showing data. Now, at 40 minutes past the hour (so 9:40, 10:40, 11:40 am etc), I'm getting an update across every lagging metric right up to the minute.

Is there a delay that's configured somewhere intentionally?

stale[bot] commented 1 year ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.