USACE / cumulus

Cumulus project issue tracking and project planning
MIT License
3 stars 2 forks source link

[BUG REPORT]: Slower than usual Cumulus data processing in the last week #426

Closed FHanbali closed 2 months ago

FHanbali commented 2 months ago

The LRD division office is reporting slower than usual processing of a data request on the Cumulus server side. Have there been an issues with Cumulus in the last week or so that may have affected data processing performance?

adamscarberry commented 2 months ago

I can see the slowness. Enabling performance insights on the RDS instance has shown some top queries causing issues.

One of the top ones was coming from the Prometheus metrics (scraping) service. Those metrics haven't displayed correctly for a while in grafana. I turned that service off to see how performance improves.

image

I could notice the products page in the web UI loaded much faster than before.

I'll continue to monitor.

adamscarberry commented 2 months ago

image

adamscarberry commented 2 months ago

image

image

image

adamscarberry commented 2 months ago

As of 9/17/24 @ 7:25am

image

adamscarberry commented 2 months ago

As of 9/1724 @ noon eastern:

image