search

grafana / opensearch-datasource

Apache License 2.0
27 stars 21 forks source link

[BUG] Grafana running on GMT-3 cannot see data after index rotation happening in UTC. #478

Closed louzadod closed 4 weeks ago

louzadod commented 4 weeks ago

What happened: Grafana is set to run on GMT-3 timezone. It is the default TZ for our Grafana instance. However, OpenSearch rotates index on a daily basis and on UTC time. So, after 21 PM in my local time, the next day index is created and data is put on it until 21 PM localtime of next day.

When monitoring logs before 21:00 GMT-3, my logs appear ok.

After 21:00 GMT-3, between 21:15 and 22:15 GMT-3, for example, Grafana OpenSearch plugin says "No Data". In OpenSearch Dashboards data appears gracefully.

See video: Image

What you expected to happen: Data appers normally. The next day index be queried normally.

How to reproduce it (as minimally and precisely as possible):

  1. OpenSearch server rotating index daily in UTC time
  2. Grafana running on GMT-3 time zone
  3. Try to show data between 21:15 and 22:15 GMT-3

Anything else we need to know?:

Environment:

louzadod commented 4 weeks ago

My Grafana server was running on UTC-03 timezone. I set UTC and the issue got fixed.