search

grafana / grafana

The open and composable observability and data visualization platform. Visualize metrics, logs, and traces from multiple sources like Prometheus, Loki, Elasticsearch, InfluxDB, Postgres and many more.
https://grafana.com
GNU Affero General Public License v3.0
64.99k stars 12.13k forks source link

Data Sets: Performance Issue with Large Data Sets #92044

Open yzengin opened 2 months ago

yzengin commented 2 months ago

What happened?

When using Grafana with large data sets, I've noticed that dashboards become slow, and graphs take a long time to load. This is especially noticeable when querying Prometheus as a data source. The response times for queries significantly increase, negatively impacting the user experience. Additionally, memory usage spikes when handling large volumes of data. Could there be optimizations to improve performance in such scenarios?

What did you expect to happen?

I expected the dashboards to load quickly and the graphs to be responsive even with large data sets. The performance should be consistent, regardless of the data size.

Did this work before?

Yes, previous versions of Grafana worked more smoothly with similar data sets, but I’ve noticed the slowdown with the latest version.

How do we reproduce it?

Steps to Reproduce:

  1. Create a dashboard with a large data set.
  2. Query Prometheus as the data source.
  3. Observe the query response times and memory usage.

Is the bug inside a dashboard panel?

Yes, the issue occurs within the dashboard panels where large data sets are visualized.

Environment (with versions)?

Grafana: 11.1.4 OS: Ubuntu 20.04 Browser: Google Chrome 127.0.6533.120

Grafana platform?

A package manager (APT, YUM, BREW, etc.)

Datasource(s)?

Prometheus 2.40.0

tonypowa commented 2 months ago

hello @yzengin

Could you share a minimal Git repository where the issue can be reproduced? Also please provide any error messages or logs you're seeing.

Thank you

NWRichmond commented 2 weeks ago

@yzengin a video would help us understand your experience. Is this something you can provide?