geerlingguy / internet-pi

Raspberry Pi config for all things Internet.
MIT License
4.36k stars 452 forks source link

Grafana public dashboard - Internal server error #594

Open AnshumanFauzdar opened 6 months ago

AnshumanFauzdar commented 6 months ago

When I open public dashboard URL which looks like this http://PI_PUBLIC_ADDRESS:3000/public-dashboards/xxxxxxxxxxxxxxxxxxxxx, it shows up like this:

image

  1. I have tried issue #344 but still showing same thing
  2. I changed port in templates/docker-compose.yml.j2 to 3000:3000
  3. Restarted the ansible with ansible-playbook main.yml
  4. Rebooted the pi
quadespresso commented 6 months ago

Could you share the output from this command:

docker compose logs

as run from the appropriate directory (~/internet-monitoring is the likely default).

AnshumanFauzdar commented 6 months ago

@quadespresso Here is the output:

WARN[0000] /home/eir/internet-monitoring/docker-compose.yml: `version` is obsolete
speedtest-1   | level=INFO datetime=2024-04-25 07:03:24,146 Starting Speedtest-Exporter on http://localhost:9798
speedtest-1   | level=INFO datetime=2024-04-25 07:04:31,583 Starting Speedtest-Exporter on http://localhost:9798
prometheus-1  | ts=2024-04-25T07:03:23.732Z caller=main.go:617 level=info msg="Starting Prometheus Server" mode=server version="(version=2.51.2, branch=HEAD, revision=b4c0ab52c3e9b940ab803581ddae9b3d9a452337)"
speedtest-1   | ==============================================================================
speedtest-1   |
nodeexp-1     | ts=2024-04-25T07:03:22.934Z caller=node_exporter.go:193 level=info msg="Starting node_exporter" version="(version=1.8.0, branch=HEAD, revision=cadb1d1190ad95c66b951758f01ff4c94e55e6ce)"
speedtest-1   | You may only use this Speedtest software and information generated
grafana-1     | ✔ Downloaded and extracted flant-statusmap-panel v0.5.1 zip successfully to /var/lib/grafana/plugins/flant-statusmap-panel
grafana-1     |
grafana-1     | Please restart Grafana after installing or removing plugins. Refer to Grafana documentation for instructions if necessary.
grafana-1     |
grafana-1     | ✔ Downloaded and extracted ae3e-plotly-panel v0.5.0 zip successfully to /var/lib/grafana/plugins/ae3e-plotly-panel
grafana-1     |
grafana-1     | Please restart Grafana after installing or removing plugins. Refer to Grafana documentation for instructions if necessary.
grafana-1     |
grafana-1     | logger=settings t=2024-04-26T16:58:08.10964946+05:30 level=info msg="Starting Grafana" version=10.4.2 commit=701c851be7a930e04fbc6ebb1cd4254da80edd4c branch=v10.4.x compiled=2024-04-26T16:58:08+05:30
prometheus-1  | ts=2024-04-25T07:03:23.733Z caller=main.go:622 level=info build_context="(go=go1.22.2, platform=linux/arm64, user=root@b63f02a423d9, date=20240410-14:08:09, tags=netgo,builtinassets,stringlabels)"
ping-1        | ts=2024-04-25T07:03:22.972Z caller=main.go:87 level=info msg="Starting blackbox_exporter" version="(version=0.25.0, branch=HEAD, revision=ef3ff4fef195333fb8ee0039fb487b2f5007908f)"
prometheus-1  | ts=2024-04-25T07:03:23.733Z caller=main.go:623 level=info host_details="(Linux 6.6.20+rpt-rpi-v8 #1 SMP PREEMPT Debian 1:6.6.20-1+rpt1 (2024-03-07) aarch64 77205529e081 (none))"
speedtest-1   | from it for personal, non-commercial use, through a command line
speedtest-1   | interface on a personal computer. Your use of this software is subject
speedtest-1   | to the End User License Agreement, Terms of Use and Privacy Policy at
speedtest-1   | these URLs:
prometheus-1  | ts=2024-04-25T07:03:23.733Z caller=main.go:624 level=info fd_limits="(soft=1048576, hard=1048576)"
nodeexp-1     | ts=2024-04-25T07:03:22.935Z caller=node_exporter.go:194 level=info msg="Build context" build_context="(go=go1.22.2, platform=linux/arm64, user=root@587d3f12650c, date=20240424-13:16:18, tags=unknown)"
nodeexp-1     | ts=2024-04-25T07:03:22.938Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(z?ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$
nodeexp-1     | ts=2024-04-25T07:03:22.939Z caller=diskstats_linux.go:265 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data
prometheus-1  | ts=2024-04-25T07:03:23.733Z caller=main.go:625 level=info vm_limits="(soft=unlimited, hard=unlimited)"
prometheus-1  | ts=2024-04-25T07:03:23.741Z caller=web.go:568 level=info component=web msg="Start listening for connections" address=0.0.0.0:9090
prometheus-1  | ts=2024-04-25T07:03:23.742Z caller=main.go:1129 level=info msg="Starting TSDB ..."
prometheus-1  | ts=2024-04-25T07:03:23.749Z caller=tls_config.go:313 level=info component=web msg="Listening on" address=[::]:9090
prometheus-1  | ts=2024-04-25T07:03:23.749Z caller=tls_config.go:316 level=info component=web msg="TLS is disabled." http2=false address=[::]:9090
prometheus-1  | ts=2024-04-25T07:03:23.780Z caller=head.go:616 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any"
speedtest-1   |
speedtest-1   |         https://www.speedtest.net/about/eula
speedtest-1   |         https://www.speedtest.net/about/terms
ping-1        | ts=2024-04-25T07:03:22.972Z caller=main.go:88 level=info build_context="(go=go1.22.2, platform=linux/arm64, user=root@9b6755681f2e, date=20240409-12:52:48, tags=unknown)"
ping-1        | ts=2024-04-25T07:03:22.974Z caller=main.go:100 level=info msg="Loaded config file"
ping-1        | ts=2024-04-25T07:03:22.977Z caller=tls_config.go:313 level=info msg="Listening on" address=[::]:9115
ping-1        | ts=2024-04-25T07:03:22.977Z caller=tls_config.go:316 level=info msg="TLS is disabled." http2=false address=[::]:9115
nodeexp-1     | ts=2024-04-25T07:03:22.939Z caller=filesystem_common.go:94 level=warn collector=filesystem msg="--collector.filesystem.ignored-mount-points is DEPRECATED and will be removed in 2.0.0, use --collector.filesystem.mount-points-exclude"
nodeexp-1     | ts=2024-04-25T07:03:22.939Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(sys|proc|dev|host|etc|rootfs/var/lib/docker/containers|rootfs/var/lib/docker/overlay2|rootfs/run/docker/netns|rootfs/var/lib/docker/aufs)($|/)
nodeexp-1     | ts=2024-04-25T07:03:22.940Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$
nodeexp-1     | ts=2024-04-25T07:03:22.942Z caller=node_exporter.go:111 level=info msg="Enabled collectors"
nodeexp-1     | ts=2024-04-25T07:03:22.942Z caller=node_exporter.go:118 level=info collector=arp
grafana-1     | logger=settings t=2024-04-26T16:58:08.110780658+05:30 level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini
ping-1        | ts=2024-04-25T07:04:19.586Z caller=main.go:282 level=info msg="Received SIGTERM, exiting gracefully..."
grafana-1     | logger=settings t=2024-04-26T16:58:08.110849991+05:30 level=info msg="Config loaded from" file=/etc/grafana/grafana.ini
ping-1        | ts=2024-04-25T07:04:21.203Z caller=main.go:87 level=info msg="Starting blackbox_exporter" version="(version=0.25.0, branch=HEAD, revision=ef3ff4fef195333fb8ee0039fb487b2f5007908f)"
ping-1        | ts=2024-04-25T07:04:21.203Z caller=main.go:88 level=info build_context="(go=go1.22.2, platform=linux/arm64, user=root@9b6755681f2e, date=20240409-12:52:48, tags=unknown)"
ping-1        | ts=2024-04-25T07:04:21.204Z caller=main.go:100 level=info msg="Loaded config file"
ping-1        | ts=2024-04-25T07:04:21.207Z caller=tls_config.go:313 level=info msg="Listening on" address=[::]:9115
ping-1        | ts=2024-04-25T07:04:21.207Z caller=tls_config.go:316 level=info msg="TLS is disabled." http2=false address=[::]:9115
ping-1        | ts=2024-04-26T10:53:21.569Z caller=main.go:282 level=info msg="Received SIGTERM, exiting gracefully..."
ping-1        | ts=2024-04-26T10:53:22.914Z caller=main.go:87 level=info msg="Starting blackbox_exporter" version="(version=0.25.0, branch=HEAD, revision=ef3ff4fef195333fb8ee0039fb487b2f5007908f)"
ping-1        | ts=2024-04-26T10:53:22.915Z caller=main.go:88 level=info build_context="(go=go1.22.2, platform=linux/arm64, user=root@9b6755681f2e, date=20240409-12:52:48, tags=unknown)"
ping-1        | ts=2024-04-26T10:53:22.917Z caller=main.go:100 level=info msg="Loaded config file"
ping-1        | ts=2024-04-26T10:53:22.918Z caller=tls_config.go:313 level=info msg="Listening on" address=[::]:9115
ping-1        | ts=2024-04-26T10:53:22.919Z caller=tls_config.go:316 level=info msg="TLS is disabled." http2=false address=[::]:9115
ping-1        | ts=2024-04-26T11:09:56.426Z caller=main.go:282 level=info msg="Received SIGTERM, exiting gracefully..."
ping-1        | ts=2024-04-26T11:10:22.742Z caller=main.go:87 level=info msg="Starting blackbox_exporter" version="(version=0.25.0, branch=HEAD, revision=ef3ff4fef195333fb8ee0039fb487b2f5007908f)"
ping-1        | ts=2024-04-26T11:10:22.742Z caller=main.go:88 level=info build_context="(go=go1.22.2, platform=linux/arm64, user=root@9b6755681f2e, date=20240409-12:52:48, tags=unknown)"
grafana-1     | logger=settings t=2024-04-26T16:58:08.110864584+05:30 level=info msg="Config overridden from command line" arg="default.paths.data=/var/lib/grafana"
speedtest-1   |         https://www.speedtest.net/about/privacy
prometheus-1  | ts=2024-04-25T07:03:23.781Z caller=head.go:698 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=11.167µs
speedtest-1   |
speedtest-1   | ==============================================================================
speedtest-1   |
speedtest-1   | License acceptance recorded. Continuing.
speedtest-1   |
grafana-1     | logger=settings t=2024-04-26T16:58:08.110878232+05:30 level=info msg="Config overridden from command line" arg="default.paths.logs=/var/log/grafana"
grafana-1     | logger=settings t=2024-04-26T16:58:08.110890158+05:30 level=info msg="Config overridden from command line" arg="default.paths.plugins=/var/lib/grafana/plugins"
nodeexp-1     | ts=2024-04-25T07:03:22.942Z caller=node_exporter.go:118 level=info collector=bcache
nodeexp-1     | ts=2024-04-25T07:03:22.942Z caller=node_exporter.go:118 level=info collector=bonding
nodeexp-1     | ts=2024-04-25T07:03:22.942Z caller=node_exporter.go:118 level=info collector=btrfs
ping-1        | ts=2024-04-26T11:10:22.757Z caller=main.go:100 level=info msg="Loaded config file"
ping-1        | ts=2024-04-26T11:10:22.767Z caller=tls_config.go:313 level=info msg="Listening on" address=[::]:9115
ping-1        | ts=2024-04-26T11:10:22.767Z caller=tls_config.go:316 level=info msg="TLS is disabled." http2=false address=[::]:9115
nodeexp-1     | ts=2024-04-25T07:03:22.942Z caller=node_exporter.go:118 level=info collector=conntrack
nodeexp-1     | ts=2024-04-25T07:03:22.942Z caller=node_exporter.go:118 level=info collector=cpu
nodeexp-1     | ts=2024-04-25T07:03:22.942Z caller=node_exporter.go:118 level=info collector=cpufreq
nodeexp-1     | ts=2024-04-25T07:03:22.942Z caller=node_exporter.go:118 level=info collector=diskstats
grafana-1     | logger=settings t=2024-04-26T16:58:08.110901565+05:30 level=info msg="Config overridden from command line" arg="default.paths.provisioning=/etc/grafana/provisioning"
grafana-1     | logger=settings t=2024-04-26T16:58:08.110914269+05:30 level=info msg="Config overridden from command line" arg="default.log.mode=console"
nodeexp-1     | ts=2024-04-25T07:03:22.942Z caller=node_exporter.go:118 level=info collector=dmi
ping-1        | ts=2024-04-26T11:28:12.593Z caller=main.go:282 level=info msg="Received SIGTERM, exiting gracefully..."
grafana-1     | logger=settings t=2024-04-26T16:58:08.11093638+05:30 level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana"
nodeexp-1     | ts=2024-04-25T07:03:22.942Z caller=node_exporter.go:118 level=info collector=edac
nodeexp-1     | ts=2024-04-25T07:03:22.942Z caller=node_exporter.go:118 level=info collector=entropy
nodeexp-1     | ts=2024-04-25T07:03:22.942Z caller=node_exporter.go:118 level=info collector=fibrechannel
nodeexp-1     | ts=2024-04-25T07:03:22.942Z caller=node_exporter.go:118 level=info collector=filefd
speedtest-1   | level=INFO datetime=2024-04-25 07:07:31,501 Server=22796 Jitter=0.208ms Ping=3.119ms Download=74.81Mbps Upload=38.88Mbps
speedtest-1   | level=INFO datetime=2024-04-25 08:07:14,405 Server=11562 Jitter=0.179ms Ping=2.763ms Download=85.41Mbps Upload=91.27Mbps
speedtest-1   | level=INFO datetime=2024-04-25 09:07:27,150 Server=22796 Jitter=1.314ms Ping=11.636ms Download=59.11Mbps Upload=42.41Mbps
speedtest-1   | level=INFO datetime=2024-04-25 10:07:36,944 Server=51948 Jitter=2.015ms Ping=7.961ms Download=81.76Mbps Upload=54.91Mbps
grafana-1     | logger=settings t=2024-04-26T16:58:08.110949824+05:30 level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana"
speedtest-1   | level=INFO datetime=2024-04-25 11:07:36,705 Server=51948 Jitter=8.769ms Ping=54.041ms Download=57.04Mbps Upload=32.29Mbps
speedtest-1   | level=INFO datetime=2024-04-25 12:07:26,478 Server=22796 Jitter=0.922ms Ping=3.888ms Download=75.36Mbps Upload=63.93Mbps
speedtest-1   | level=INFO datetime=2024-04-25 13:07:25,651 Server=37352 Jitter=0.145ms Ping=2.54ms Download=76.32Mbps Upload=89.27Mbps
speedtest-1   | level=INFO datetime=2024-04-25 14:07:26,624 Server=37352 Jitter=0.102ms Ping=2.173ms Download=86.76Mbps Upload=91.9Mbps
speedtest-1   | level=INFO datetime=2024-04-25 15:07:20,623 Server=37352 Jitter=0.277ms Ping=2.204ms Download=87.86Mbps Upload=92.9Mbps
speedtest-1   | level=INFO datetime=2024-04-25 16:07:12,815 Server=37352 Jitter=0.442ms Ping=2.174ms Download=91.77Mbps Upload=92.72Mbps
prometheus-1  | ts=2024-04-25T07:03:23.781Z caller=head.go:706 level=info component=tsdb msg="Replaying WAL, this may take a while"
prometheus-1  | ts=2024-04-25T07:03:23.784Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0
ping-1        | ts=2024-04-26T11:28:14.055Z caller=main.go:87 level=info msg="Starting blackbox_exporter" version="(version=0.25.0, branch=HEAD, revision=ef3ff4fef195333fb8ee0039fb487b2f5007908f)"
ping-1        | ts=2024-04-26T11:28:14.055Z caller=main.go:88 level=info build_context="(go=go1.22.2, platform=linux/arm64, user=root@9b6755681f2e, date=20240409-12:52:48, tags=unknown)"
prometheus-1  | ts=2024-04-25T07:03:23.784Z caller=head.go:815 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=317.597µs wal_replay_duration=2.724222ms wbl_replay_duration=463ns total_replay_duration=3.137894ms
prometheus-1  | ts=2024-04-25T07:03:23.804Z caller=main.go:1150 level=info fs_type=EXT4_SUPER_MAGIC
prometheus-1  | ts=2024-04-25T07:03:23.804Z caller=main.go:1153 level=info msg="TSDB started"
prometheus-1  | ts=2024-04-25T07:03:23.804Z caller=main.go:1335 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml
speedtest-1   | level=INFO datetime=2024-04-25 17:07:17,397 Server=12285 Jitter=0.254ms Ping=2.497ms Download=92.33Mbps Upload=93.14Mbps
speedtest-1   | level=INFO datetime=2024-04-25 18:07:14,537 Server=22796 Jitter=0.35ms Ping=2.356ms Download=92.61Mbps Upload=93.35Mbps
speedtest-1   | level=INFO datetime=2024-04-25 19:07:26,053 Server=11562 Jitter=0.206ms Ping=2.495ms Download=92.66Mbps Upload=93.23Mbps
speedtest-1   | level=INFO datetime=2024-04-25 20:07:17,882 Server=37352 Jitter=0.136ms Ping=2.346ms Download=92.81Mbps Upload=93.23Mbps
speedtest-1   | level=INFO datetime=2024-04-25 21:07:12,048 Server=37352 Jitter=0.38ms Ping=2.468ms Download=93.51Mbps Upload=93.4Mbps
speedtest-1   | level=INFO datetime=2024-04-25 22:07:12,564 Server=37352 Jitter=0.132ms Ping=2.319ms Download=93.57Mbps Upload=93.32Mbps
speedtest-1   | level=INFO datetime=2024-04-25 23:07:13,206 Server=37352 Jitter=0.277ms Ping=2.425ms Download=90.77Mbps Upload=93.48Mbps
speedtest-1   | level=INFO datetime=2024-04-26 00:07:14,134 Server=37352 Jitter=0.21ms Ping=2.333ms Download=93.52Mbps Upload=93.42Mbps
speedtest-1   | level=INFO datetime=2024-04-26 01:07:13,076 Server=37352 Jitter=0.184ms Ping=2.342ms Download=92.62Mbps Upload=93.34Mbps
speedtest-1   | level=INFO datetime=2024-04-26 02:07:13,153 Server=37352 Jitter=0.321ms Ping=2.157ms Download=93.49Mbps Upload=93.38Mbps
speedtest-1   | level=INFO datetime=2024-04-26 03:07:19,957 Server=11562 Jitter=0.242ms Ping=2.576ms Download=93.27Mbps Upload=93.01Mbps
speedtest-1   | level=INFO datetime=2024-04-26 04:07:31,503 Server=12285 Jitter=12.116ms Ping=42.943ms Download=59.77Mbps Upload=67.47Mbps
speedtest-1   | level=INFO datetime=2024-04-26 05:07:22,755 Server=51948 Jitter=3.334ms Ping=22.637ms Download=78.39Mbps Upload=66.42Mbps
speedtest-1   | level=INFO datetime=2024-04-26 06:07:25,607 Server=37352 Jitter=0.373ms Ping=2.369ms Download=68.01Mbps Upload=87.22Mbps
speedtest-1   | level=INFO datetime=2024-04-26 07:07:36,178 Server=37352 Jitter=6.653ms Ping=22.313ms Download=72.2Mbps Upload=77.7Mbps
speedtest-1   | level=INFO datetime=2024-04-26 08:07:19,632 Server=37352 Jitter=0.151ms Ping=2.151ms Download=91.05Mbps Upload=91.79Mbps
speedtest-1   | level=INFO datetime=2024-04-26 09:07:19,920 Server=11562 Jitter=1.268ms Ping=10.334ms Download=35.83Mbps Upload=89.57Mbps
speedtest-1   | level=INFO datetime=2024-04-26 10:07:27,905 Server=12285 Jitter=3.304ms Ping=16.394ms Download=30.91Mbps Upload=77.01Mbps
speedtest-1   | level=INFO datetime=2024-04-26 10:53:33,615 Starting Speedtest-Exporter on http://localhost:9798
speedtest-1   | level=INFO datetime=2024-04-26 11:10:24,930 Starting Speedtest-Exporter on http://localhost:9798
speedtest-1   | level=INFO datetime=2024-04-26 11:28:24,410 Starting Speedtest-Exporter on http://localhost:9798
speedtest-1   | level=INFO datetime=2024-04-26 12:07:15,098 Server=11562 Jitter=0.752ms Ping=2.975ms Download=84.38Mbps Upload=81.85Mbps
speedtest-1   | level=INFO datetime=2024-04-26 13:07:30,952 Server=37352 Jitter=0.281ms Ping=2.434ms Download=79.78Mbps Upload=41.73Mbps
speedtest-1   | level=INFO datetime=2024-04-26 14:07:30,770 Server=37352 Jitter=0.308ms Ping=5.101ms Download=82.15Mbps Upload=91.7Mbps
speedtest-1   | level=INFO datetime=2024-04-26 15:07:19,570 Server=37352 Jitter=2.242ms Ping=3.593ms Download=88.56Mbps Upload=90.49Mbps
speedtest-1   | level=INFO datetime=2024-04-26 16:07:13,808 Server=37352 Jitter=0.142ms Ping=2.122ms Download=92.9Mbps Upload=93.28Mbps
speedtest-1   | level=INFO datetime=2024-04-26 17:07:15,339 Server=37352 Jitter=1.814ms Ping=2.547ms Download=89.83Mbps Upload=92.84Mbps
speedtest-1   | level=INFO datetime=2024-04-26 18:07:15,392 Server=37352 Jitter=0.116ms Ping=2.165ms Download=89.18Mbps Upload=93.14Mbps
speedtest-1   | level=INFO datetime=2024-04-26 19:07:12,627 Server=37352 Jitter=0.171ms Ping=2.23ms Download=90.06Mbps Upload=92.61Mbps
speedtest-1   | level=INFO datetime=2024-04-26 20:07:15,324 Server=37352 Jitter=0.063ms Ping=2.098ms Download=92.89Mbps Upload=93.34Mbps
speedtest-1   | level=INFO datetime=2024-04-26 21:07:12,404 Server=37352 Jitter=0.301ms Ping=2.351ms Download=93.61Mbps Upload=93.22Mbps
speedtest-1   | level=INFO datetime=2024-04-26 22:07:13,247 Server=37352 Jitter=0.134ms Ping=2.126ms Download=93.68Mbps Upload=93.41Mbps
speedtest-1   | level=INFO datetime=2024-04-26 23:07:18,848 Server=37352 Jitter=0.199ms Ping=2.54ms Download=93.17Mbps Upload=93.47Mbps
speedtest-1   | level=INFO datetime=2024-04-27 00:07:20,393 Server=11562 Jitter=0.239ms Ping=2.518ms Download=93.26Mbps Upload=93.43Mbps
speedtest-1   | level=INFO datetime=2024-04-27 01:07:12,210 Server=37352 Jitter=0.13ms Ping=2.248ms Download=93.51Mbps Upload=93.38Mbps
speedtest-1   | level=INFO datetime=2024-04-27 02:07:16,993 Server=11562 Jitter=0.367ms Ping=2.357ms Download=93.0Mbps Upload=93.31Mbps
speedtest-1   | level=INFO datetime=2024-04-27 03:07:12,941 Server=37352 Jitter=1.061ms Ping=2.312ms Download=93.51Mbps Upload=93.33Mbps
speedtest-1   | level=INFO datetime=2024-04-27 04:07:15,286 Server=11562 Jitter=0.222ms Ping=2.493ms Download=92.65Mbps Upload=93.54Mbps
nodeexp-1     | ts=2024-04-25T07:03:22.942Z caller=node_exporter.go:118 level=info collector=filesystem
prometheus-1  | ts=2024-04-25T07:03:23.809Z caller=main.go:1372 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=5.421757ms db_storage=4.778µs remote_storage=4.167µs web_handler=1.926µs query_engine=4.204µs scrape=943.754µs scrape_sd=269.615µs notify=9.203µs notify_sd=4.574µs rules=2.442847ms tracing=33.908µs
prometheus-1  | ts=2024-04-25T07:03:23.809Z caller=main.go:1114 level=info msg="Server is ready to receive web requests."
nodeexp-1     | ts=2024-04-25T07:03:22.942Z caller=node_exporter.go:118 level=info collector=hwmon
nodeexp-1     | ts=2024-04-25T07:03:22.942Z caller=node_exporter.go:118 level=info collector=infiniband
grafana-1     | logger=settings t=2024-04-26T16:58:08.110961657+05:30 level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins"
grafana-1     | logger=settings t=2024-04-26T16:58:08.110978602+05:30 level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning"
prometheus-1  | ts=2024-04-25T07:03:23.810Z caller=manager.go:163 level=info component="rule manager" msg="Starting rule manager..."
prometheus-1  | ts=2024-04-25T07:04:30.574Z caller=main.go:964 level=warn msg="Received SIGTERM, exiting gracefully..."
nodeexp-1     | ts=2024-04-25T07:03:22.942Z caller=node_exporter.go:118 level=info collector=ipvs
nodeexp-1     | ts=2024-04-25T07:03:22.942Z caller=node_exporter.go:118 level=info collector=loadavg
nodeexp-1     | ts=2024-04-25T07:03:22.942Z caller=node_exporter.go:118 level=info collector=mdadm
nodeexp-1     | ts=2024-04-25T07:03:22.942Z caller=node_exporter.go:118 level=info collector=meminfo
prometheus-1  | ts=2024-04-25T07:04:30.574Z caller=main.go:988 level=info msg="Stopping scrape discovery manager..."
prometheus-1  | ts=2024-04-25T07:04:30.574Z caller=main.go:1002 level=info msg="Stopping notify discovery manager..."
prometheus-1  | ts=2024-04-25T07:04:30.574Z caller=manager.go:177 level=info component="rule manager" msg="Stopping rule manager..."
prometheus-1  | ts=2024-04-25T07:04:30.575Z caller=main.go:984 level=info msg="Scrape discovery manager stopped"
prometheus-1  | ts=2024-04-25T07:04:30.575Z caller=main.go:998 level=info msg="Notify discovery manager stopped"
prometheus-1  | ts=2024-04-25T07:04:30.574Z caller=manager.go:187 level=info component="rule manager" msg="Rule manager stopped"
prometheus-1  | ts=2024-04-25T07:04:30.575Z caller=main.go:1039 level=info msg="Stopping scrape manager..."
prometheus-1  | ts=2024-04-25T07:04:30.579Z caller=main.go:1031 level=info msg="Scrape manager stopped"
prometheus-1  | ts=2024-04-25T07:04:30.586Z caller=notifier.go:623 level=info component=notifier msg="Stopping notification manager..."
prometheus-1  | ts=2024-04-25T07:04:30.586Z caller=main.go:1261 level=info msg="Notifier manager stopped"
prometheus-1  | ts=2024-04-25T07:04:30.586Z caller=main.go:1273 level=info msg="See you next time!"
prometheus-1  | ts=2024-04-25T07:04:31.579Z caller=main.go:617 level=info msg="Starting Prometheus Server" mode=server version="(version=2.51.2, branch=HEAD, revision=b4c0ab52c3e9b940ab803581ddae9b3d9a452337)"
prometheus-1  | ts=2024-04-25T07:04:31.579Z caller=main.go:622 level=info build_context="(go=go1.22.2, platform=linux/arm64, user=root@b63f02a423d9, date=20240410-14:08:09, tags=netgo,builtinassets,stringlabels)"
ping-1        | ts=2024-04-26T11:28:14.059Z caller=main.go:100 level=info msg="Loaded config file"
ping-1        | ts=2024-04-26T11:28:14.062Z caller=tls_config.go:313 level=info msg="Listening on" address=[::]:9115
ping-1        | ts=2024-04-26T11:28:14.063Z caller=tls_config.go:316 level=info msg="TLS is disabled." http2=false address=[::]:9115
grafana-1     | logger=settings t=2024-04-26T16:58:08.110990194+05:30 level=info msg="Config overridden from Environment variable" var="GF_SECURITY_ADMIN_PASSWORD=*********"
grafana-1     | logger=settings t=2024-04-26T16:58:08.111001842+05:30 level=info msg="Config overridden from Environment variable" var="GF_USERS_ALLOW_SIGN_UP=false"
grafana-1     | logger=settings t=2024-04-26T16:58:08.111013046+05:30 level=info msg="Config overridden from Environment variable" var="GF_AUTH_ANONYMOUS_ENABLED=true"
grafana-1     | logger=settings t=2024-04-26T16:58:08.111026453+05:30 level=info msg=Target target=[all]
grafana-1     | logger=settings t=2024-04-26T16:58:08.111063194+05:30 level=info msg="Path Home" path=/usr/share/grafana
grafana-1     | logger=settings t=2024-04-26T16:58:08.111080157+05:30 level=info msg="Path Data" path=/var/lib/grafana
grafana-1     | logger=settings t=2024-04-26T16:58:08.111094045+05:30 level=info msg="Path Logs" path=/var/log/grafana
grafana-1     | logger=settings t=2024-04-26T16:58:08.11110586+05:30 level=info msg="Path Plugins" path=/var/lib/grafana/plugins
grafana-1     | logger=settings t=2024-04-26T16:58:08.11113436+05:30 level=info msg="Path Provisioning" path=/etc/grafana/provisioning
grafana-1     | logger=settings t=2024-04-26T16:58:08.111148619+05:30 level=info msg="App mode production"
grafana-1     | logger=sqlstore t=2024-04-26T16:58:08.112716037+05:30 level=info msg="Connecting to DB" dbtype=sqlite3
grafana-1     | logger=migrator t=2024-04-26T16:58:08.115118877+05:30 level=info msg="Starting DB migrations"
grafana-1     | logger=migrator t=2024-04-26T16:58:08.224720152+05:30 level=info msg="migrations completed" performed=0 skipped=548 duration=2.15286ms
grafana-1     | logger=secrets t=2024-04-26T16:58:08.23430153+05:30 level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1
grafana-1     | logger=plugin.store t=2024-04-26T16:58:08.306693229+05:30 level=info msg="Loading plugins..."
grafana-1     | logger=local.finder t=2024-04-26T16:58:08.467546713+05:30 level=warn msg="Skipping finding plugins as directory does not exist" path=/usr/share/grafana/plugins-bundled
grafana-1     | logger=plugins.registration t=2024-04-26T16:58:09.310575739+05:30 level=info msg="Plugin registered" pluginId=ae3e-plotly-panel
nodeexp-1     | ts=2024-04-25T07:03:22.942Z caller=node_exporter.go:118 level=info collector=netclass
grafana-1     | logger=plugins.registration t=2024-04-26T16:58:09.359716793+05:30 level=info msg="Plugin registered" pluginId=flant-statusmap-panel
grafana-1     | logger=plugin.store t=2024-04-26T16:58:09.359877292+05:30 level=info msg="Plugins loaded" count=57 duration=1.053188637s
grafana-1     | logger=query_data t=2024-04-26T16:58:09.370924497+05:30 level=info msg="Query Service initialization"
nodeexp-1     | ts=2024-04-25T07:03:22.942Z caller=node_exporter.go:118 level=info collector=netdev
nodeexp-1     | ts=2024-04-25T07:03:22.942Z caller=node_exporter.go:118 level=info collector=netstat
nodeexp-1     | ts=2024-04-25T07:03:22.942Z caller=node_exporter.go:118 level=info collector=nfs
prometheus-1  | ts=2024-04-25T07:04:31.580Z caller=main.go:623 level=info host_details="(Linux 6.6.20+rpt-rpi-v8 #1 SMP PREEMPT Debian 1:6.6.20-1+rpt1 (2024-03-07) aarch64 77205529e081 (none))"
prometheus-1  | ts=2024-04-25T07:04:31.580Z caller=main.go:624 level=info fd_limits="(soft=1048576, hard=1048576)"
prometheus-1  | ts=2024-04-25T07:04:31.581Z caller=main.go:625 level=info vm_limits="(soft=unlimited, hard=unlimited)"
prometheus-1  | ts=2024-04-25T07:04:31.593Z caller=web.go:568 level=info component=web msg="Start listening for connections" address=0.0.0.0:9090
prometheus-1  | ts=2024-04-25T07:04:31.595Z caller=main.go:1129 level=info msg="Starting TSDB ..."
prometheus-1  | ts=2024-04-25T07:04:31.602Z caller=tls_config.go:313 level=info component=web msg="Listening on" address=[::]:9090
prometheus-1  | ts=2024-04-25T07:04:31.603Z caller=tls_config.go:316 level=info component=web msg="TLS is disabled." http2=false address=[::]:9090
prometheus-1  | ts=2024-04-25T07:04:31.612Z caller=head.go:616 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any"
prometheus-1  | ts=2024-04-25T07:04:31.613Z caller=head.go:698 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=15.704µs
prometheus-1  | ts=2024-04-25T07:04:31.613Z caller=head.go:706 level=info component=tsdb msg="Replaying WAL, this may take a while"
prometheus-1  | ts=2024-04-25T07:04:31.629Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1
prometheus-1  | ts=2024-04-25T07:04:31.630Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1
prometheus-1  | ts=2024-04-25T07:04:31.631Z caller=head.go:815 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=188.966µs wal_replay_duration=17.228011ms wbl_replay_duration=426ns total_replay_duration=17.765685ms
prometheus-1  | ts=2024-04-25T07:04:31.641Z caller=main.go:1150 level=info fs_type=EXT4_SUPER_MAGIC
prometheus-1  | ts=2024-04-25T07:04:31.641Z caller=main.go:1153 level=info msg="TSDB started"
prometheus-1  | ts=2024-04-25T07:04:31.641Z caller=main.go:1335 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml
prometheus-1  | ts=2024-04-25T07:04:31.646Z caller=main.go:1372 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=4.60215ms db_storage=4.649µs remote_storage=4.055µs web_handler=2.13µs query_engine=2.463µs scrape=870.826µs scrape_sd=264.725µs notify=5.093µs notify_sd=2.481µs rules=1.916209ms tracing=24.037µs
prometheus-1  | ts=2024-04-25T07:04:31.646Z caller=main.go:1114 level=info msg="Server is ready to receive web requests."
prometheus-1  | ts=2024-04-25T07:04:31.646Z caller=manager.go:163 level=info component="rule manager" msg="Starting rule manager..."
prometheus-1  | ts=2024-04-25T10:03:33.034Z caller=compact.go:572 level=info component=tsdb msg="write block" mint=1714028609837 maxt=1714032000000 ulid=01HWABBP5EP85115547XECYAQ9 duration=124.147853ms
prometheus-1  | ts=2024-04-25T10:03:33.050Z caller=head.go:1338 level=info component=tsdb msg="Head GC completed" caller=truncateMemory duration=13.563177ms
prometheus-1  | ts=2024-04-25T11:00:03.358Z caller=compact.go:572 level=info component=tsdb msg="write block" mint=1714032002487 maxt=1714039200000 ulid=01HWAEK514JYQXA7T6QGFB4EEE duration=121.24817ms
prometheus-1  | ts=2024-04-25T11:00:03.368Z caller=head.go:1338 level=info component=tsdb msg="Head GC completed" caller=truncateMemory duration=8.929916ms
prometheus-1  | ts=2024-04-25T13:00:03.281Z caller=compact.go:572 level=info component=tsdb msg="write block" mint=1714039202487 maxt=1714046400000 ulid=01HWANEW70EEX430G3CAJ39QV7 duration=112.715949ms
prometheus-1  | ts=2024-04-25T13:00:03.292Z caller=head.go:1338 level=info component=tsdb msg="Head GC completed" caller=truncateMemory duration=9.313459ms
prometheus-1  | ts=2024-04-25T13:00:03.293Z caller=checkpoint.go:101 level=info component=tsdb msg="Creating checkpoint" from_segment=0 to_segment=1 mint=1714046400000
prometheus-1  | ts=2024-04-25T13:00:03.372Z caller=head.go:1300 level=info component=tsdb msg="WAL checkpoint complete" first=0 last=1 duration=79.913698ms
prometheus-1  | ts=2024-04-25T15:00:03.332Z caller=compact.go:572 level=info component=tsdb msg="write block" mint=1714046402487 maxt=1714053600000 ulid=01HWAWAKG9H7CSQDPS5RX0087Y duration=123.413678ms
prometheus-1  | ts=2024-04-25T15:00:03.342Z caller=head.go:1338 level=info component=tsdb msg="Head GC completed" caller=truncateMemory duration=8.726128ms
prometheus-1  | ts=2024-04-25T17:00:03.283Z caller=compact.go:572 level=info component=tsdb msg="write block" mint=1714053602487 maxt=1714060800000 ulid=01HWB36APZYAE5HN61B8J3RARV duration=116.320502ms
prometheus-1  | ts=2024-04-25T17:00:03.294Z caller=head.go:1338 level=info component=tsdb msg="Head GC completed" caller=truncateMemory duration=8.947487ms
prometheus-1  | ts=2024-04-25T17:00:03.295Z caller=checkpoint.go:101 level=info component=tsdb msg="Creating checkpoint" from_segment=2 to_segment=3 mint=1714060800000
prometheus-1  | ts=2024-04-25T17:00:03.371Z caller=head.go:1300 level=info component=tsdb msg="WAL checkpoint complete" first=2 last=3 duration=76.434238ms
prometheus-1  | ts=2024-04-25T17:00:03.507Z caller=compact.go:513 level=info component=tsdb msg="compact blocks" count=3 mint=1714028609837 maxt=1714046400000 ulid=01HWB36AXCH2VJ30RVQYB381H7 sources="[01HWABBP5EP85115547XECYAQ9 01HWAEK514JYQXA7T6QGFB4EEE 01HWANEW70EEX430G3CAJ39QV7]" duration=134.897743ms
prometheus-1  | ts=2024-04-25T17:00:03.511Z caller=db.go:1684 level=info component=tsdb msg="Deleting obsolete block" block=01HWABBP5EP85115547XECYAQ9
prometheus-1  | ts=2024-04-25T17:00:03.514Z caller=db.go:1684 level=info component=tsdb msg="Deleting obsolete block" block=01HWAEK514JYQXA7T6QGFB4EEE
prometheus-1  | ts=2024-04-25T17:00:03.517Z caller=db.go:1684 level=info component=tsdb msg="Deleting obsolete block" block=01HWANEW70EEX430G3CAJ39QV7
prometheus-1  | ts=2024-04-25T19:00:03.422Z caller=compact.go:572 level=info component=tsdb msg="write block" mint=1714060802487 maxt=1714068000000 ulid=01HWBA2238Q3YTJ5MM7XEBT8DC duration=118.253958ms
prometheus-1  | ts=2024-04-25T19:00:03.432Z caller=head.go:1338 level=info component=tsdb msg="Head GC completed" caller=truncateMemory duration=8.754944ms
prometheus-1  | ts=2024-04-25T21:00:03.263Z caller=compact.go:572 level=info component=tsdb msg="write block" mint=1714068002487 maxt=1714075200000 ulid=01HWBGXS6E5TT7AZKMHGKE9CSQ duration=113.883976ms
prometheus-1  | ts=2024-04-25T21:00:03.274Z caller=head.go:1338 level=info component=tsdb msg="Head GC completed" caller=truncateMemory duration=8.940556ms
prometheus-1  | ts=2024-04-25T21:00:03.275Z caller=checkpoint.go:101 level=info component=tsdb msg="Creating checkpoint" from_segment=4 to_segment=5 mint=1714075200000
prometheus-1  | ts=2024-04-25T21:00:03.373Z caller=head.go:1300 level=info component=tsdb msg="WAL checkpoint complete" first=4 last=5 duration=97.972271ms
prometheus-1  | ts=2024-04-25T23:00:03.279Z caller=compact.go:572 level=info component=tsdb msg="write block" mint=1714075202487 maxt=1714082400000 ulid=01HWBQSGEH13WKEFNHXC0ZNT8D duration=126.727782ms
prometheus-1  | ts=2024-04-25T23:00:03.290Z caller=head.go:1338 level=info component=tsdb msg="Head GC completed" caller=truncateMemory duration=8.786325ms
prometheus-1  | ts=2024-04-25T23:00:03.452Z caller=compact.go:513 level=info component=tsdb msg="compact blocks" count=3 mint=1714046402487 maxt=1714068000000 ulid=01HWBQSGJW7G4EHYP6ZC5E61CG sources="[01HWAWAKG9H7CSQDPS5RX0087Y 01HWB36APZYAE5HN61B8J3RARV 01HWBA2238Q3YTJ5MM7XEBT8DC]" duration=161.017803ms
prometheus-1  | ts=2024-04-25T23:00:03.457Z caller=db.go:1684 level=info component=tsdb msg="Deleting obsolete block" block=01HWAWAKG9H7CSQDPS5RX0087Y
prometheus-1  | ts=2024-04-25T23:00:03.460Z caller=db.go:1684 level=info component=tsdb msg="Deleting obsolete block" block=01HWB36APZYAE5HN61B8J3RARV
prometheus-1  | ts=2024-04-25T23:00:03.465Z caller=db.go:1684 level=info component=tsdb msg="Deleting obsolete block" block=01HWBA2238Q3YTJ5MM7XEBT8DC
prometheus-1  | ts=2024-04-26T01:00:03.240Z caller=compact.go:572 level=info component=tsdb msg="write block" mint=1714082402487 maxt=1714089600000 ulid=01HWBYN7NKBS85R9YT7D53FVS6 duration=116.822245ms
prometheus-1  | ts=2024-04-26T01:00:03.251Z caller=head.go:1338 level=info component=tsdb msg="Head GC completed" caller=truncateMemory duration=9.147896ms
prometheus-1  | ts=2024-04-26T01:00:03.252Z caller=checkpoint.go:101 level=info component=tsdb msg="Creating checkpoint" from_segment=6 to_segment=7 mint=1714089600000
prometheus-1  | ts=2024-04-26T01:00:03.353Z caller=head.go:1300 level=info component=tsdb msg="WAL checkpoint complete" first=6 last=7 duration=101.821336ms
prometheus-1  | ts=2024-04-26T03:00:03.784Z caller=compact.go:572 level=info component=tsdb msg="write block" mint=1714089602487 maxt=1714096800000 ulid=01HWC5GZDWHH5DJETP9E0BMW2X duration=139.715077ms
prometheus-1  | ts=2024-04-26T03:00:03.794Z caller=head.go:1338 level=info component=tsdb msg="Head GC completed" caller=truncateMemory duration=9.036142ms
prometheus-1  | ts=2024-04-26T05:00:03.429Z caller=compact.go:572 level=info component=tsdb msg="write block" mint=1714096802487 maxt=1714104000000 ulid=01HWCCCPAWMG2YTE6SEA8PC8JM duration=137.179108ms
prometheus-1  | ts=2024-04-26T05:00:03.440Z caller=head.go:1338 level=info component=tsdb msg="Head GC completed" caller=truncateMemory duration=9.49491ms
prometheus-1  | ts=2024-04-26T05:00:03.442Z caller=checkpoint.go:101 level=info component=tsdb msg="Creating checkpoint" from_segment=8 to_segment=9 mint=1714104000000
prometheus-1  | ts=2024-04-26T05:00:03.541Z caller=head.go:1300 level=info component=tsdb msg="WAL checkpoint complete" first=8 last=9 duration=99.298096ms
prometheus-1  | ts=2024-04-26T05:00:03.709Z caller=compact.go:513 level=info component=tsdb msg="compact blocks" count=3 mint=1714068002487 maxt=1714089600000 ulid=01HWCCCPJPWKGXW9F7GGEBTBBD sources="[01HWBGXS6E5TT7AZKMHGKE9CSQ 01HWBQSGEH13WKEFNHXC0ZNT8D 01HWBYN7NKBS85R9YT7D53FVS6]" duration=167.607545ms
prometheus-1  | ts=2024-04-26T05:00:03.713Z caller=db.go:1684 level=info component=tsdb msg="Deleting obsolete block" block=01HWBQSGEH13WKEFNHXC0ZNT8D
prometheus-1  | ts=2024-04-26T05:00:03.717Z caller=db.go:1684 level=info component=tsdb msg="Deleting obsolete block" block=01HWBGXS6E5TT7AZKMHGKE9CSQ
prometheus-1  | ts=2024-04-26T05:00:03.722Z caller=db.go:1684 level=info component=tsdb msg="Deleting obsolete block" block=01HWBYN7NKBS85R9YT7D53FVS6
prometheus-1  | ts=2024-04-26T05:00:04.007Z caller=compact.go:513 level=info component=tsdb msg="compact blocks" count=3 mint=1714028609837 maxt=1714089600000 ulid=01HWCCCPRBYTSEFXT8NFGX3J8N sources="[01HWB36AXCH2VJ30RVQYB381H7 01HWBQSGJW7G4EHYP6ZC5E61CG 01HWCCCPJPWKGXW9F7GGEBTBBD]" duration=284.292451ms
prometheus-1  | ts=2024-04-26T05:00:04.012Z caller=db.go:1684 level=info component=tsdb msg="Deleting obsolete block" block=01HWB36AXCH2VJ30RVQYB381H7
prometheus-1  | ts=2024-04-26T05:00:04.016Z caller=db.go:1684 level=info component=tsdb msg="Deleting obsolete block" block=01HWBQSGJW7G4EHYP6ZC5E61CG
prometheus-1  | ts=2024-04-26T05:00:04.022Z caller=db.go:1684 level=info component=tsdb msg="Deleting obsolete block" block=01HWCCCPJPWKGXW9F7GGEBTBBD
prometheus-1  | ts=2024-04-26T07:00:03.459Z caller=compact.go:572 level=info component=tsdb msg="write block" mint=1714104002487 maxt=1714111200000 ulid=01HWCK8DM8PS0FSVV3HFVMJ0HN duration=123.589592ms
prometheus-1  | ts=2024-04-26T07:00:03.470Z caller=head.go:1338 level=info component=tsdb msg="Head GC completed" caller=truncateMemory duration=9.070465ms
prometheus-1  | ts=2024-04-26T09:00:03.403Z caller=compact.go:572 level=info component=tsdb msg="write block" mint=1714111202487 maxt=1714118400000 ulid=01HWCT44SA97A1XF66Z9WRS194 duration=161.214689ms
prometheus-1  | ts=2024-04-26T09:00:03.413Z caller=head.go:1338 level=info component=tsdb msg="Head GC completed" caller=truncateMemory duration=8.870004ms
prometheus-1  | ts=2024-04-26T09:00:03.414Z caller=checkpoint.go:101 level=info component=tsdb msg="Creating checkpoint" from_segment=10 to_segment=11 mint=1714118400000
prometheus-1  | ts=2024-04-26T09:00:03.514Z caller=head.go:1300 level=info component=tsdb msg="WAL checkpoint complete" first=10 last=11 duration=99.595021ms
prometheus-1  | ts=2024-04-26T10:53:32.611Z caller=main.go:964 level=warn msg="Received SIGTERM, exiting gracefully..."
prometheus-1  | ts=2024-04-26T10:53:32.611Z caller=main.go:988 level=info msg="Stopping scrape discovery manager..."
prometheus-1  | ts=2024-04-26T10:53:32.611Z caller=main.go:1002 level=info msg="Stopping notify discovery manager..."
prometheus-1  | ts=2024-04-26T10:53:32.611Z caller=manager.go:177 level=info component="rule manager" msg="Stopping rule manager..."
prometheus-1  | ts=2024-04-26T10:53:32.611Z caller=manager.go:187 level=info component="rule manager" msg="Rule manager stopped"
prometheus-1  | ts=2024-04-26T10:53:32.611Z caller=main.go:1039 level=info msg="Stopping scrape manager..."
prometheus-1  | ts=2024-04-26T10:53:32.611Z caller=main.go:984 level=info msg="Scrape discovery manager stopped"
prometheus-1  | ts=2024-04-26T10:53:32.613Z caller=main.go:998 level=info msg="Notify discovery manager stopped"
prometheus-1  | ts=2024-04-26T10:53:32.617Z caller=main.go:1031 level=info msg="Scrape manager stopped"
prometheus-1  | ts=2024-04-26T10:53:32.646Z caller=notifier.go:623 level=info component=notifier msg="Stopping notification manager..."
grafana-1     | logger=live.push_http t=2024-04-26T16:58:09.382114923+05:30 level=info msg="Live Push Gateway initialization"
grafana-1     | logger=ngalert.migration t=2024-04-26T16:58:09.399440042+05:30 level=info msg=Starting
grafana-1     | logger=ngalert.state.manager t=2024-04-26T16:58:09.450339087+05:30 level=info msg="Running in alternative execution of Error/NoData mode"
grafana-1     | logger=infra.usagestats.collector t=2024-04-26T16:58:09.457465811+05:30 level=info msg="registering usage stat providers" usageStatsProvidersLen=2
grafana-1     | logger=provisioning.datasources t=2024-04-26T16:58:09.48060916+05:30 level=info msg="deleted datasource based on configuration" name=prometheus
grafana-1     | logger=provisioning.datasources t=2024-04-26T16:58:09.483832811+05:30 level=info msg="inserting datasource from configuration" name=prometheus uid=P1809F7CD0C75ACF3
prometheus-1  | ts=2024-04-26T10:53:32.646Z caller=main.go:1261 level=info msg="Notifier manager stopped"
grafana-1     | logger=provisioning.plugins t=2024-04-26T16:58:09.676436824+05:30 level=error msg="Failed to read plugin provisioning files from directory" path=/etc/grafana/provisioning/plugins error="open /etc/grafana/provisioning/plugins: no such file or directory"
prometheus-1  | ts=2024-04-26T10:53:32.646Z caller=main.go:1273 level=info msg="See you next time!"
grafana-1     | logger=provisioning.notifiers t=2024-04-26T16:58:09.676552934+05:30 level=error msg="Can't read alert notification provisioning files from directory" path=/etc/grafana/provisioning/notifiers error="open /etc/grafana/provisioning/notifiers: no such file or directory"
nodeexp-1     | ts=2024-04-25T07:03:22.942Z caller=node_exporter.go:118 level=info collector=nfsd
grafana-1     | logger=provisioning.alerting t=2024-04-26T16:58:09.67665136+05:30 level=error msg="can't read alerting provisioning files from directory" path=/etc/grafana/provisioning/alerting error="open /etc/grafana/provisioning/alerting: no such file or directory"
nodeexp-1     | ts=2024-04-25T07:03:22.942Z caller=node_exporter.go:118 level=info collector=nvme
nodeexp-1     | ts=2024-04-25T07:03:22.942Z caller=node_exporter.go:118 level=info collector=os
nodeexp-1     | ts=2024-04-25T07:03:22.942Z caller=node_exporter.go:118 level=info collector=powersupplyclass
prometheus-1  | ts=2024-04-26T10:53:33.733Z caller=main.go:617 level=info msg="Starting Prometheus Server" mode=server version="(version=2.51.2, branch=HEAD, revision=b4c0ab52c3e9b940ab803581ddae9b3d9a452337)"
prometheus-1  | ts=2024-04-26T10:53:33.733Z caller=main.go:622 level=info build_context="(go=go1.22.2, platform=linux/arm64, user=root@b63f02a423d9, date=20240410-14:08:09, tags=netgo,builtinassets,stringlabels)"
prometheus-1  | ts=2024-04-26T10:53:33.733Z caller=main.go:623 level=info host_details="(Linux 6.6.20+rpt-rpi-v8 #1 SMP PREEMPT Debian 1:6.6.20-1+rpt1 (2024-03-07) aarch64 77205529e081 (none))"
prometheus-1  | ts=2024-04-26T10:53:33.733Z caller=main.go:624 level=info fd_limits="(soft=1048576, hard=1048576)"
prometheus-1  | ts=2024-04-26T10:53:33.733Z caller=main.go:625 level=info vm_limits="(soft=unlimited, hard=unlimited)"
prometheus-1  | ts=2024-04-26T10:53:33.743Z caller=web.go:568 level=info component=web msg="Start listening for connections" address=0.0.0.0:9090
prometheus-1  | ts=2024-04-26T10:53:33.745Z caller=main.go:1129 level=info msg="Starting TSDB ..."
prometheus-1  | ts=2024-04-26T10:53:33.747Z caller=repair.go:56 level=info component=tsdb msg="Found healthy block" mint=1714089602487 maxt=1714096800000 ulid=01HWC5GZDWHH5DJETP9E0BMW2X
prometheus-1  | ts=2024-04-26T10:53:33.748Z caller=repair.go:56 level=info component=tsdb msg="Found healthy block" mint=1714096802487 maxt=1714104000000 ulid=01HWCCCPAWMG2YTE6SEA8PC8JM
prometheus-1  | ts=2024-04-26T10:53:33.749Z caller=repair.go:56 level=info component=tsdb msg="Found healthy block" mint=1714028609837 maxt=1714089600000 ulid=01HWCCCPRBYTSEFXT8NFGX3J8N
prometheus-1  | ts=2024-04-26T10:53:33.750Z caller=repair.go:56 level=info component=tsdb msg="Found healthy block" mint=1714104002487 maxt=1714111200000 ulid=01HWCK8DM8PS0FSVV3HFVMJ0HN
prometheus-1  | ts=2024-04-26T10:53:33.751Z caller=tls_config.go:313 level=info component=web msg="Listening on" address=[::]:9090
prometheus-1  | ts=2024-04-26T10:53:33.751Z caller=tls_config.go:316 level=info component=web msg="TLS is disabled." http2=false address=[::]:9090
prometheus-1  | ts=2024-04-26T10:53:33.751Z caller=repair.go:56 level=info component=tsdb msg="Found healthy block" mint=1714111202487 maxt=1714118400000 ulid=01HWCT44SA97A1XF66Z9WRS194
prometheus-1  | ts=2024-04-26T10:53:33.780Z caller=head.go:616 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any"
prometheus-1  | ts=2024-04-26T10:53:33.789Z caller=head.go:698 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=8.295381ms
prometheus-1  | ts=2024-04-26T10:53:33.789Z caller=head.go:706 level=info component=tsdb msg="Replaying WAL, this may take a while"
prometheus-1  | ts=2024-04-26T10:53:33.802Z caller=head.go:743 level=info component=tsdb msg="WAL checkpoint loaded"
prometheus-1  | ts=2024-04-26T10:53:33.874Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=12 maxSegment=15
prometheus-1  | ts=2024-04-26T10:53:34.009Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=13 maxSegment=15
prometheus-1  | ts=2024-04-26T10:53:34.174Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=14 maxSegment=15
prometheus-1  | ts=2024-04-26T10:53:34.175Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=15 maxSegment=15
prometheus-1  | ts=2024-04-26T10:53:34.175Z caller=head.go:815 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=12.852521ms wal_replay_duration=373.42821ms wbl_replay_duration=278ns total_replay_duration=394.828849ms
prometheus-1  | ts=2024-04-26T10:53:34.194Z caller=main.go:1150 level=info fs_type=EXT4_SUPER_MAGIC
prometheus-1  | ts=2024-04-26T10:53:34.195Z caller=main.go:1153 level=info msg="TSDB started"
prometheus-1  | ts=2024-04-26T10:53:34.195Z caller=main.go:1335 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml
prometheus-1  | ts=2024-04-26T10:53:34.199Z caller=main.go:1372 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=4.198199ms db_storage=4.278µs remote_storage=3.648µs web_handler=2.259µs query_engine=2.13µs scrape=852.229µs scrape_sd=185.683µs notify=2.87µs notify_sd=2.611µs rules=1.736549ms tracing=20.852µs
prometheus-1  | ts=2024-04-26T10:53:34.199Z caller=main.go:1114 level=info msg="Server is ready to receive web requests."
prometheus-1  | ts=2024-04-26T10:53:34.199Z caller=manager.go:163 level=info component="rule manager" msg="Starting rule manager..."
nodeexp-1     | ts=2024-04-25T07:03:22.943Z caller=node_exporter.go:118 level=info collector=pressure
nodeexp-1     | ts=2024-04-25T07:03:22.943Z caller=node_exporter.go:118 level=info collector=rapl
nodeexp-1     | ts=2024-04-25T07:03:22.943Z caller=node_exporter.go:118 level=info collector=schedstat
nodeexp-1     | ts=2024-04-25T07:03:22.943Z caller=node_exporter.go:118 level=info collector=selinux
nodeexp-1     | ts=2024-04-25T07:03:22.943Z caller=node_exporter.go:118 level=info collector=sockstat
nodeexp-1     | ts=2024-04-25T07:03:22.943Z caller=node_exporter.go:118 level=info collector=softnet
nodeexp-1     | ts=2024-04-25T07:03:22.943Z caller=node_exporter.go:118 level=info collector=stat
prometheus-1  | ts=2024-04-26T11:00:04.822Z caller=compact.go:572 level=info component=tsdb msg="write block" mint=1714118400000 maxt=1714125600000 ulid=01HWD0ZXFX414JQ5MJV880ZHSS duration=89.526138ms
prometheus-1  | ts=2024-04-26T11:00:04.832Z caller=head.go:1338 level=info component=tsdb msg="Head GC completed" caller=truncateMemory duration=8.524182ms
prometheus-1  | ts=2024-04-26T11:00:04.833Z caller=checkpoint.go:101 level=info component=tsdb msg="Creating checkpoint" from_segment=12 to_segment=13 mint=1714125600000
prometheus-1  | ts=2024-04-26T11:00:04.929Z caller=head.go:1300 level=info component=tsdb msg="WAL checkpoint complete" first=12 last=13 duration=95.755152ms
prometheus-1  | ts=2024-04-26T11:00:05.098Z caller=compact.go:513 level=info component=tsdb msg="compact blocks" count=3 mint=1714089602487 maxt=1714111200000 ulid=01HWD0ZXP267VM4C29KYX0ADVN sources="[01HWC5GZDWHH5DJETP9E0BMW2X 01HWCCCPAWMG2YTE6SEA8PC8JM 01HWCK8DM8PS0FSVV3HFVMJ0HN]" duration=168.778567ms
prometheus-1  | ts=2024-04-26T11:00:05.103Z caller=db.go:1684 level=info component=tsdb msg="Deleting obsolete block" block=01HWC5GZDWHH5DJETP9E0BMW2X
grafana-1     | logger=provisioning.alerting t=2024-04-26T16:58:09.676677175+05:30 level=info msg="starting to provision alerting"
grafana-1     | logger=provisioning.alerting t=2024-04-26T16:58:09.676705971+05:30 level=info msg="finished to provision alerting"
grafana-1     | logger=grafanaStorageLogger t=2024-04-26T16:58:09.677239672+05:30 level=info msg="Storage starting"
grafana-1     | logger=ngalert.state.manager t=2024-04-26T16:58:09.698106069+05:30 level=info msg="Warming state cache for startup"
grafana-1     | logger=ngalert.multiorg.alertmanager t=2024-04-26T16:58:09.699703894+05:30 level=info msg="Starting MultiOrg Alertmanager"
grafana-1     | logger=http.server t=2024-04-26T16:58:09.719600407+05:30 level=info msg="HTTP Server Listen" address=[::]:3000 protocol=http subUrl= socket=
grafana-1     | logger=ngalert.state.manager t=2024-04-26T16:58:10.005980551+05:30 level=info msg="State cache has been initialized" states=0 duration=307.853204ms
grafana-1     | logger=ngalert.scheduler t=2024-04-26T16:58:10.006144976+05:30 level=info msg="Starting scheduler" tickInterval=10s maxAttempts=1
grafana-1     | logger=ticker t=2024-04-26T16:58:10.006333086+05:30 level=info msg=starting first_tick=2024-04-26T16:58:20+05:30
grafana-1     | logger=provisioning.dashboard t=2024-04-26T16:58:10.008965518+05:30 level=info msg="starting to provision dashboards"
grafana-1     | logger=provisioning.dashboard t=2024-04-26T16:58:10.040134734+05:30 level=info msg="finished to provision dashboards"
grafana-1     | logger=grafana.update.checker t=2024-04-26T16:58:10.194921453+05:30 level=info msg="Update check succeeded" duration=491.123838ms
prometheus-1  | ts=2024-04-26T11:00:05.109Z caller=db.go:1684 level=info component=tsdb msg="Deleting obsolete block" block=01HWCCCPAWMG2YTE6SEA8PC8JM
prometheus-1  | ts=2024-04-26T11:00:05.113Z caller=db.go:1684 level=info component=tsdb msg="Deleting obsolete block" block=01HWCK8DM8PS0FSVV3HFVMJ0HN
prometheus-1  | ts=2024-04-26T11:09:56.305Z caller=main.go:964 level=warn msg="Received SIGTERM, exiting gracefully..."
grafana-1     | logger=plugins.update.checker t=2024-04-26T16:58:10.194903361+05:30 level=info msg="Update check succeeded" duration=487.762929ms
nodeexp-1     | ts=2024-04-25T07:03:22.943Z caller=node_exporter.go:118 level=info collector=tapestats
grafana-1     | logger=grafana-apiserver t=2024-04-26T16:58:11.892147889+05:30 level=info msg="Adding GroupVersion playlist.grafana.app v0alpha1 to ResourceManager"
prometheus-1  | ts=2024-04-26T11:09:56.305Z caller=main.go:988 level=info msg="Stopping scrape discovery manager..."
prometheus-1  | ts=2024-04-26T11:09:56.306Z caller=main.go:1002 level=info msg="Stopping notify discovery manager..."
prometheus-1  | ts=2024-04-26T11:09:56.307Z caller=manager.go:177 level=info component="rule manager" msg="Stopping rule manager..."
prometheus-1  | ts=2024-04-26T11:09:56.307Z caller=manager.go:187 level=info component="rule manager" msg="Rule manager stopped"
prometheus-1  | ts=2024-04-26T11:09:56.307Z caller=main.go:1039 level=info msg="Stopping scrape manager..."
prometheus-1  | ts=2024-04-26T11:09:56.306Z caller=main.go:984 level=info msg="Scrape discovery manager stopped"
prometheus-1  | ts=2024-04-26T11:09:56.307Z caller=main.go:998 level=info msg="Notify discovery manager stopped"
prometheus-1  | ts=2024-04-26T11:09:56.309Z caller=main.go:1031 level=info msg="Scrape manager stopped"
prometheus-1  | ts=2024-04-26T11:09:56.372Z caller=notifier.go:623 level=info component=notifier msg="Stopping notification manager..."
prometheus-1  | ts=2024-04-26T11:09:56.372Z caller=main.go:1261 level=info msg="Notifier manager stopped"
prometheus-1  | ts=2024-04-26T11:09:56.373Z caller=main.go:1273 level=info msg="See you next time!"
prometheus-1  | ts=2024-04-26T11:10:23.942Z caller=main.go:617 level=info msg="Starting Prometheus Server" mode=server version="(version=2.51.2, branch=HEAD, revision=b4c0ab52c3e9b940ab803581ddae9b3d9a452337)"
prometheus-1  | ts=2024-04-26T11:10:23.942Z caller=main.go:622 level=info build_context="(go=go1.22.2, platform=linux/arm64, user=root@b63f02a423d9, date=20240410-14:08:09, tags=netgo,builtinassets,stringlabels)"
prometheus-1  | ts=2024-04-26T11:10:23.942Z caller=main.go:623 level=info host_details="(Linux 6.6.20+rpt-rpi-v8 #1 SMP PREEMPT Debian 1:6.6.20-1+rpt1 (2024-03-07) aarch64 77205529e081 (none))"
prometheus-1  | ts=2024-04-26T11:10:23.943Z caller=main.go:624 level=info fd_limits="(soft=1048576, hard=1048576)"
prometheus-1  | ts=2024-04-26T11:10:23.943Z caller=main.go:625 level=info vm_limits="(soft=unlimited, hard=unlimited)"
prometheus-1  | ts=2024-04-26T11:10:23.990Z caller=web.go:568 level=info component=web msg="Start listening for connections" address=0.0.0.0:9090
prometheus-1  | ts=2024-04-26T11:10:23.996Z caller=main.go:1129 level=info msg="Starting TSDB ..."
prometheus-1  | ts=2024-04-26T11:10:24.014Z caller=repair.go:56 level=info component=tsdb msg="Found healthy block" mint=1714028609837 maxt=1714089600000 ulid=01HWCCCPRBYTSEFXT8NFGX3J8N
prometheus-1  | ts=2024-04-26T11:10:24.026Z caller=repair.go:56 level=info component=tsdb msg="Found healthy block" mint=1714111202487 maxt=1714118400000 ulid=01HWCT44SA97A1XF66Z9WRS194
prometheus-1  | ts=2024-04-26T11:10:24.022Z caller=tls_config.go:313 level=info component=web msg="Listening on" address=[::]:9090
prometheus-1  | ts=2024-04-26T11:10:24.028Z caller=tls_config.go:316 level=info component=web msg="TLS is disabled." http2=false address=[::]:9090
prometheus-1  | ts=2024-04-26T11:10:24.033Z caller=repair.go:56 level=info component=tsdb msg="Found healthy block" mint=1714118400000 maxt=1714125600000 ulid=01HWD0ZXFX414JQ5MJV880ZHSS
prometheus-1  | ts=2024-04-26T11:10:24.038Z caller=repair.go:56 level=info component=tsdb msg="Found healthy block" mint=1714089602487 maxt=1714111200000 ulid=01HWD0ZXP267VM4C29KYX0ADVN
prometheus-1  | ts=2024-04-26T11:10:24.130Z caller=head.go:616 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any"
prometheus-1  | ts=2024-04-26T11:10:24.154Z caller=head.go:698 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=23.417871ms
prometheus-1  | ts=2024-04-26T11:10:24.154Z caller=head.go:706 level=info component=tsdb msg="Replaying WAL, this may take a while"
prometheus-1  | ts=2024-04-26T11:10:24.171Z caller=head.go:743 level=info component=tsdb msg="WAL checkpoint loaded"
prometheus-1  | ts=2024-04-26T11:10:24.291Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=14 maxSegment=17
prometheus-1  | ts=2024-04-26T11:10:24.310Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=15 maxSegment=17
prometheus-1  | ts=2024-04-26T11:10:24.333Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=16 maxSegment=17
nodeexp-1     | ts=2024-04-25T07:03:22.943Z caller=node_exporter.go:118 level=info collector=textfile
nodeexp-1     | ts=2024-04-25T07:03:22.943Z caller=node_exporter.go:118 level=info collector=thermal_zone
prometheus-1  | ts=2024-04-26T11:10:24.334Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=17 maxSegment=17
nodeexp-1     | ts=2024-04-25T07:03:22.943Z caller=node_exporter.go:118 level=info collector=time
nodeexp-1     | ts=2024-04-25T07:03:22.943Z caller=node_exporter.go:118 level=info collector=timex
prometheus-1  | ts=2024-04-26T11:10:24.334Z caller=head.go:815 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=19.127111ms wal_replay_duration=161.297851ms wbl_replay_duration=241ns total_replay_duration=204.011222ms
grafana-1     | logger=grafana-apiserver t=2024-04-26T16:58:11.894286674+05:30 level=info msg="Adding GroupVersion featuretoggle.grafana.app v0alpha1 to ResourceManager"
grafana-1     | logger=server t=2024-04-26T16:58:12.597393195+05:30 level=info msg="Shutdown started" reason="System signal: terminated"
grafana-1     | logger=ticker t=2024-04-26T16:58:12.599271723+05:30 level=info msg=stopped last_tick=2024-04-26T16:58:10+05:30
grafana-1     | logger=grafana-apiserver t=2024-04-26T16:58:12.599788776+05:30 level=info msg="StorageObjectCountTracker pruner is exiting"
grafana-1     | logger=tracing t=2024-04-26T16:58:12.598591115+05:30 level=info msg="Closing tracing"
prometheus-1  | ts=2024-04-26T11:10:24.345Z caller=main.go:1150 level=info fs_type=EXT4_SUPER_MAGIC
prometheus-1  | ts=2024-04-26T11:10:24.345Z caller=main.go:1153 level=info msg="TSDB started"
prometheus-1  | ts=2024-04-26T11:10:24.345Z caller=main.go:1335 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml
nodeexp-1     | ts=2024-04-25T07:03:22.943Z caller=node_exporter.go:118 level=info collector=udp_queues
nodeexp-1     | ts=2024-04-25T07:03:22.943Z caller=node_exporter.go:118 level=info collector=uname
nodeexp-1     | ts=2024-04-25T07:03:22.943Z caller=node_exporter.go:118 level=info collector=vmstat
nodeexp-1     | ts=2024-04-25T07:03:22.943Z caller=node_exporter.go:118 level=info collector=watchdog
grafana-1     | ✔ Downloaded and extracted flant-statusmap-panel v0.5.1 zip successfully to /var/lib/grafana/plugins/flant-statusmap-panel
nodeexp-1     | ts=2024-04-25T07:03:22.943Z caller=node_exporter.go:118 level=info collector=xfs
prometheus-1  | ts=2024-04-26T11:10:24.363Z caller=main.go:1372 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=18.13013ms db_storage=3.889µs remote_storage=4.13µs web_handler=2.186µs query_engine=2.759µs scrape=8.212111ms scrape_sd=219.204µs notify=2.907µs notify_sd=2.37µs rules=4.863167ms tracing=21.815µs
prometheus-1  | ts=2024-04-26T11:10:24.363Z caller=main.go:1114 level=info msg="Server is ready to receive web requests."
nodeexp-1     | ts=2024-04-25T07:03:22.943Z caller=node_exporter.go:118 level=info collector=zfs
nodeexp-1     | ts=2024-04-25T07:03:22.945Z caller=tls_config.go:313 level=info msg="Listening on" address=[::]:9100
nodeexp-1     | ts=2024-04-25T07:03:22.945Z caller=tls_config.go:316 level=info msg="TLS is disabled." http2=false address=[::]:9100
nodeexp-1     | ts=2024-04-25T07:04:21.382Z caller=node_exporter.go:193 level=info msg="Starting node_exporter" version="(version=1.8.0, branch=HEAD, revision=cadb1d1190ad95c66b951758f01ff4c94e55e6ce)"
nodeexp-1     | ts=2024-04-25T07:04:21.383Z caller=node_exporter.go:194 level=info msg="Build context" build_context="(go=go1.22.2, platform=linux/arm64, user=root@587d3f12650c, date=20240424-13:16:18, tags=unknown)"
nodeexp-1     | ts=2024-04-25T07:04:21.384Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(z?ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$
nodeexp-1     | ts=2024-04-25T07:04:21.385Z caller=diskstats_linux.go:265 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data
prometheus-1  | ts=2024-04-26T11:10:24.363Z caller=manager.go:163 level=info component="rule manager" msg="Starting rule manager..."
nodeexp-1     | ts=2024-04-25T07:04:21.385Z caller=filesystem_common.go:94 level=warn collector=filesystem msg="--collector.filesystem.ignored-mount-points is DEPRECATED and will be removed in 2.0.0, use --collector.filesystem.mount-points-exclude"
nodeexp-1     | ts=2024-04-25T07:04:21.385Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(sys|proc|dev|host|etc|rootfs/var/lib/docker/containers|rootfs/var/lib/docker/overlay2|rootfs/run/docker/netns|rootfs/var/lib/docker/aufs)($|/)
nodeexp-1     | ts=2024-04-25T07:04:21.385Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$
prometheus-1  | ts=2024-04-26T11:28:23.447Z caller=main.go:964 level=warn msg="Received SIGTERM, exiting gracefully..."
prometheus-1  | ts=2024-04-26T11:28:23.448Z caller=main.go:988 level=info msg="Stopping scrape discovery manager..."
prometheus-1  | ts=2024-04-26T11:28:23.448Z caller=main.go:1002 level=info msg="Stopping notify discovery manager..."
nodeexp-1     | ts=2024-04-25T07:04:21.387Z caller=node_exporter.go:111 level=info msg="Enabled collectors"
prometheus-1  | ts=2024-04-26T11:28:23.448Z caller=manager.go:177 level=info component="rule manager" msg="Stopping rule manager..."
prometheus-1  | ts=2024-04-26T11:28:23.448Z caller=main.go:984 level=info msg="Scrape discovery manager stopped"
prometheus-1  | ts=2024-04-26T11:28:23.448Z caller=manager.go:187 level=info component="rule manager" msg="Rule manager stopped"
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=arp
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=bcache
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=bonding
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=btrfs
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=conntrack
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=cpu
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=cpufreq
prometheus-1  | ts=2024-04-26T11:28:23.448Z caller=main.go:1039 level=info msg="Stopping scrape manager..."
prometheus-1  | ts=2024-04-26T11:28:23.448Z caller=main.go:998 level=info msg="Notify discovery manager stopped"
prometheus-1  | ts=2024-04-26T11:28:23.450Z caller=main.go:1031 level=info msg="Scrape manager stopped"
grafana-1     |
prometheus-1  | ts=2024-04-26T11:28:23.463Z caller=notifier.go:623 level=info component=notifier msg="Stopping notification manager..."
grafana-1     | Please restart Grafana after installing or removing plugins. Refer to Grafana documentation for instructions if necessary.
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=diskstats
grafana-1     |
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=dmi
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=edac
grafana-1     | ✔ Downloaded and extracted ae3e-plotly-panel v0.5.0 zip successfully to /var/lib/grafana/plugins/ae3e-plotly-panel
grafana-1     |
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=entropy
prometheus-1  | ts=2024-04-26T11:28:23.463Z caller=main.go:1261 level=info msg="Notifier manager stopped"
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=fibrechannel
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=filefd
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=filesystem
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=hwmon
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=infiniband
prometheus-1  | ts=2024-04-26T11:28:23.463Z caller=main.go:1273 level=info msg="See you next time!"
prometheus-1  | ts=2024-04-26T11:28:24.451Z caller=main.go:617 level=info msg="Starting Prometheus Server" mode=server version="(version=2.51.2, branch=HEAD, revision=b4c0ab52c3e9b940ab803581ddae9b3d9a452337)"
prometheus-1  | ts=2024-04-26T11:28:24.452Z caller=main.go:622 level=info build_context="(go=go1.22.2, platform=linux/arm64, user=root@b63f02a423d9, date=20240410-14:08:09, tags=netgo,builtinassets,stringlabels)"
prometheus-1  | ts=2024-04-26T11:28:24.452Z caller=main.go:623 level=info host_details="(Linux 6.6.20+rpt-rpi-v8 #1 SMP PREEMPT Debian 1:6.6.20-1+rpt1 (2024-03-07) aarch64 77205529e081 (none))"
grafana-1     | Please restart Grafana after installing or removing plugins. Refer to Grafana documentation for instructions if necessary.
grafana-1     |
prometheus-1  | ts=2024-04-26T11:28:24.452Z caller=main.go:624 level=info fd_limits="(soft=1048576, hard=1048576)"
prometheus-1  | ts=2024-04-26T11:28:24.452Z caller=main.go:625 level=info vm_limits="(soft=unlimited, hard=unlimited)"
prometheus-1  | ts=2024-04-26T11:28:24.461Z caller=web.go:568 level=info component=web msg="Start listening for connections" address=0.0.0.0:9090
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=ipvs
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=loadavg
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=mdadm
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=meminfo
grafana-1     | logger=settings t=2024-04-26T16:58:18.706898723+05:30 level=info msg="Starting Grafana" version=10.4.2 commit=701c851be7a930e04fbc6ebb1cd4254da80edd4c branch=v10.4.x compiled=2024-04-26T16:58:18+05:30
grafana-1     | logger=settings t=2024-04-26T16:58:18.707940792+05:30 level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini
grafana-1     | logger=settings t=2024-04-26T16:58:18.708085755+05:30 level=info msg="Config loaded from" file=/etc/grafana/grafana.ini
grafana-1     | logger=settings t=2024-04-26T16:58:18.708107551+05:30 level=info msg="Config overridden from command line" arg="default.paths.data=/var/lib/grafana"
prometheus-1  | ts=2024-04-26T11:28:24.462Z caller=main.go:1129 level=info msg="Starting TSDB ..."
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=netclass
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=netdev
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=netstat
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=nfs
prometheus-1  | ts=2024-04-26T11:28:24.464Z caller=repair.go:56 level=info component=tsdb msg="Found healthy block" mint=1714028609837 maxt=1714089600000 ulid=01HWCCCPRBYTSEFXT8NFGX3J8N
prometheus-1  | ts=2024-04-26T11:28:24.464Z caller=repair.go:56 level=info component=tsdb msg="Found healthy block" mint=1714111202487 maxt=1714118400000 ulid=01HWCT44SA97A1XF66Z9WRS194
prometheus-1  | ts=2024-04-26T11:28:24.465Z caller=repair.go:56 level=info component=tsdb msg="Found healthy block" mint=1714118400000 maxt=1714125600000 ulid=01HWD0ZXFX414JQ5MJV880ZHSS
prometheus-1  | ts=2024-04-26T11:28:24.465Z caller=repair.go:56 level=info component=tsdb msg="Found healthy block" mint=1714089602487 maxt=1714111200000 ulid=01HWD0ZXP267VM4C29KYX0ADVN
prometheus-1  | ts=2024-04-26T11:28:24.478Z caller=tls_config.go:313 level=info component=web msg="Listening on" address=[::]:9090
prometheus-1  | ts=2024-04-26T11:28:24.478Z caller=tls_config.go:316 level=info component=web msg="TLS is disabled." http2=false address=[::]:9090
prometheus-1  | ts=2024-04-26T11:28:24.494Z caller=head.go:616 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any"
prometheus-1  | ts=2024-04-26T11:28:24.499Z caller=head.go:698 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=4.416497ms
prometheus-1  | ts=2024-04-26T11:28:24.499Z caller=head.go:706 level=info component=tsdb msg="Replaying WAL, this may take a while"
grafana-1     | logger=settings t=2024-04-26T16:58:18.708122606+05:30 level=info msg="Config overridden from command line" arg="default.paths.logs=/var/log/grafana"
grafana-1     | logger=settings t=2024-04-26T16:58:18.708150106+05:30 level=info msg="Config overridden from command line" arg="default.paths.plugins=/var/lib/grafana/plugins"
grafana-1     | logger=settings t=2024-04-26T16:58:18.708161773+05:30 level=info msg="Config overridden from command line" arg="default.paths.provisioning=/etc/grafana/provisioning"
grafana-1     | logger=settings t=2024-04-26T16:58:18.708173236+05:30 level=info msg="Config overridden from command line" arg="default.log.mode=console"
prometheus-1  | ts=2024-04-26T11:28:24.508Z caller=head.go:743 level=info component=tsdb msg="WAL checkpoint loaded"
grafana-1     | logger=settings t=2024-04-26T16:58:18.708185532+05:30 level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana"
prometheus-1  | ts=2024-04-26T11:28:24.609Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=14 maxSegment=18
prometheus-1  | ts=2024-04-26T11:28:24.621Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=15 maxSegment=18
prometheus-1  | ts=2024-04-26T11:28:24.626Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=16 maxSegment=18
prometheus-1  | ts=2024-04-26T11:28:24.670Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=17 maxSegment=18
prometheus-1  | ts=2024-04-26T11:28:24.672Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=18 maxSegment=18
prometheus-1  | ts=2024-04-26T11:28:24.672Z caller=head.go:815 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=9.164215ms wal_replay_duration=164.045754ms wbl_replay_duration=315ns total_replay_duration=177.803798ms
prometheus-1  | ts=2024-04-26T11:28:24.683Z caller=main.go:1150 level=info fs_type=EXT4_SUPER_MAGIC
grafana-1     | logger=settings t=2024-04-26T16:58:18.708197569+05:30 level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana"
grafana-1     | logger=settings t=2024-04-26T16:58:18.708216624+05:30 level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins"
grafana-1     | logger=settings t=2024-04-26T16:58:18.708230624+05:30 level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning"
grafana-1     | logger=settings t=2024-04-26T16:58:18.70824205+05:30 level=info msg="Config overridden from Environment variable" var="GF_SECURITY_ADMIN_PASSWORD=*********"
grafana-1     | logger=settings t=2024-04-26T16:58:18.70825318+05:30 level=info msg="Config overridden from Environment variable" var="GF_USERS_ALLOW_SIGN_UP=false"
grafana-1     | logger=settings t=2024-04-26T16:58:18.70826392+05:30 level=info msg="Config overridden from Environment variable" var="GF_AUTH_ANONYMOUS_ENABLED=true"
grafana-1     | logger=settings t=2024-04-26T16:58:18.708275624+05:30 level=info msg=Target target=[all]
grafana-1     | logger=settings t=2024-04-26T16:58:18.708306902+05:30 level=info msg="Path Home" path=/usr/share/grafana
grafana-1     | logger=settings t=2024-04-26T16:58:18.70831805+05:30 level=info msg="Path Data" path=/var/lib/grafana
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=nfsd
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=nvme
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=os
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=powersupplyclass
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=pressure
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=rapl
prometheus-1  | ts=2024-04-26T11:28:24.683Z caller=main.go:1153 level=info msg="TSDB started"
grafana-1     | logger=settings t=2024-04-26T16:58:18.708336827+05:30 level=info msg="Path Logs" path=/var/log/grafana
grafana-1     | logger=settings t=2024-04-26T16:58:18.708349327+05:30 level=info msg="Path Plugins" path=/var/lib/grafana/plugins
grafana-1     | logger=settings t=2024-04-26T16:58:18.70836079+05:30 level=info msg="Path Provisioning" path=/etc/grafana/provisioning
grafana-1     | logger=settings t=2024-04-26T16:58:18.708372068+05:30 level=info msg="App mode production"
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=schedstat
grafana-1     | logger=sqlstore t=2024-04-26T16:58:18.70944434+05:30 level=info msg="Connecting to DB" dbtype=sqlite3
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=selinux
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=sockstat
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=softnet
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=stat
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=tapestats
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=textfile
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=thermal_zone
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=time
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=timex
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=udp_queues
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=uname
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=vmstat
nodeexp-1     | ts=2024-04-25T07:04:21.388Z caller=node_exporter.go:118 level=info collector=watchdog
nodeexp-1     | ts=2024-04-25T07:04:21.389Z caller=node_exporter.go:118 level=info collector=xfs
nodeexp-1     | ts=2024-04-25T07:04:21.389Z caller=node_exporter.go:118 level=info collector=zfs
nodeexp-1     | ts=2024-04-25T07:04:21.390Z caller=tls_config.go:313 level=info msg="Listening on" address=[::]:9100
nodeexp-1     | ts=2024-04-25T07:04:21.390Z caller=tls_config.go:316 level=info msg="TLS is disabled." http2=false address=[::]:9100
nodeexp-1     | ts=2024-04-26T10:53:22.850Z caller=node_exporter.go:193 level=info msg="Starting node_exporter" version="(version=1.8.0, branch=HEAD, revision=cadb1d1190ad95c66b951758f01ff4c94e55e6ce)"
nodeexp-1     | ts=2024-04-26T10:53:22.851Z caller=node_exporter.go:194 level=info msg="Build context" build_context="(go=go1.22.2, platform=linux/arm64, user=root@587d3f12650c, date=20240424-13:16:18, tags=unknown)"
grafana-1     | logger=migrator t=2024-04-26T16:58:18.711467423+05:30 level=info msg="Starting DB migrations"
grafana-1     | logger=migrator t=2024-04-26T16:58:18.801474648+05:30 level=info msg="migrations completed" performed=0 skipped=548 duration=3.684427ms
nodeexp-1     | ts=2024-04-26T10:53:22.852Z caller=filesystem_common.go:94 level=warn collector=filesystem msg="--collector.filesystem.ignored-mount-points is DEPRECATED and will be removed in 2.0.0, use --collector.filesystem.mount-points-exclude"
grafana-1     | logger=secrets t=2024-04-26T16:58:18.810033144+05:30 level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1
nodeexp-1     | ts=2024-04-26T10:53:22.852Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(sys|proc|dev|host|etc|rootfs/var/lib/docker/containers|rootfs/var/lib/docker/overlay2|rootfs/run/docker/netns|rootfs/var/lib/docker/aufs)($|/)
nodeexp-1     | ts=2024-04-26T10:53:22.853Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$
nodeexp-1     | ts=2024-04-26T10:53:22.854Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(z?ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$
prometheus-1  | ts=2024-04-26T11:28:24.683Z caller=main.go:1335 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml
nodeexp-1     | ts=2024-04-26T10:53:22.855Z caller=diskstats_linux.go:265 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data
nodeexp-1     | ts=2024-04-26T10:53:22.856Z caller=node_exporter.go:111 level=info msg="Enabled collectors"
nodeexp-1     | ts=2024-04-26T10:53:22.856Z caller=node_exporter.go:118 level=info collector=arp
grafana-1     | logger=plugin.store t=2024-04-26T16:58:18.874637123+05:30 level=info msg="Loading plugins..."
prometheus-1  | ts=2024-04-26T11:28:24.689Z caller=main.go:1372 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=5.469029ms db_storage=4.148µs remote_storage=5.241µs web_handler=2.388µs query_engine=2.963µs scrape=1.460696ms scrape_sd=229.128µs notify=3.5µs notify_sd=2.092µs rules=2.293211ms tracing=21.259µs
prometheus-1  | ts=2024-04-26T11:28:24.689Z caller=main.go:1114 level=info msg="Server is ready to receive web requests."
prometheus-1  | ts=2024-04-26T11:28:24.689Z caller=manager.go:163 level=info component="rule manager" msg="Starting rule manager..."
prometheus-1  | ts=2024-04-26T13:00:02.817Z caller=compact.go:572 level=info component=tsdb msg="write block" mint=1714125600000 maxt=1714132800000 ulid=01HWD7VJQ3CN5DCMV98DD57X9K duration=157.455923ms
prometheus-1  | ts=2024-04-26T13:00:02.829Z caller=head.go:1338 level=info component=tsdb msg="Head GC completed" caller=truncateMemory duration=10.40466ms
grafana-1     | logger=local.finder t=2024-04-26T16:58:18.993500466+05:30 level=warn msg="Skipping finding plugins as directory does not exist" path=/usr/share/grafana/plugins-bundled
grafana-1     | logger=plugins.registration t=2024-04-26T16:58:19.818477553+05:30 level=info msg="Plugin registered" pluginId=ae3e-plotly-panel
grafana-1     | logger=plugins.registration t=2024-04-26T16:58:19.865107084+05:30 level=info msg="Plugin registered" pluginId=flant-statusmap-panel
grafana-1     | logger=plugin.store t=2024-04-26T16:58:19.86521112+05:30 level=info msg="Plugins loaded" count=57 duration=990.577238ms
prometheus-1  | ts=2024-04-26T13:00:02.830Z caller=checkpoint.go:101 level=info component=tsdb msg="Creating checkpoint" from_segment=14 to_segment=16 mint=1714132800000
prometheus-1  | ts=2024-04-26T13:00:02.885Z caller=head.go:1300 level=info component=tsdb msg="WAL checkpoint complete" first=14 last=16 duration=55.288347ms
prometheus-1  | ts=2024-04-26T15:00:02.830Z caller=compact.go:572 level=info component=tsdb msg="write block" mint=1714132802486 maxt=1714140000000 ulid=01HWDEQA0PVX7M1NFD2MD2S1DN duration=119.548584ms
prometheus-1  | ts=2024-04-26T15:00:02.840Z caller=head.go:1338 level=info component=tsdb msg="Head GC completed" caller=truncateMemory duration=8.443072ms
prometheus-1  | ts=2024-04-26T17:00:03.286Z caller=compact.go:572 level=info component=tsdb msg="write block" mint=1714140002486 maxt=1714147200000 ulid=01HWDNK1Q3FGCF6PQYARQ62KJW duration=115.229564ms
prometheus-1  | ts=2024-04-26T17:00:03.297Z caller=head.go:1338 level=info component=tsdb msg="Head GC completed" caller=truncateMemory duration=8.900099ms
prometheus-1  | ts=2024-04-26T17:00:03.298Z caller=checkpoint.go:101 level=info component=tsdb msg="Creating checkpoint" from_segment=17 to_segment=18 mint=1714147200000
prometheus-1  | ts=2024-04-26T17:00:03.349Z caller=head.go:1300 level=info component=tsdb msg="WAL checkpoint complete" first=17 last=18 duration=51.523864ms
prometheus-1  | ts=2024-04-26T17:00:03.507Z caller=compact.go:513 level=info component=tsdb msg="compact blocks" count=3 mint=1714111202487 maxt=1714132800000 ulid=01HWDNK1WQC1DABVSDRVN6M2ZA sources="[01HWCT44SA97A1XF66Z9WRS194 01HWD0ZXFX414JQ5MJV880ZHSS 01HWD7VJQ3CN5DCMV98DD57X9K]" duration=156.574483ms
prometheus-1  | ts=2024-04-26T17:00:03.512Z caller=db.go:1684 level=info component=tsdb msg="Deleting obsolete block" block=01HWCT44SA97A1XF66Z9WRS194
prometheus-1  | ts=2024-04-26T17:00:03.517Z caller=db.go:1684 level=info component=tsdb msg="Deleting obsolete block" block=01HWD0ZXFX414JQ5MJV880ZHSS
nodeexp-1     | ts=2024-04-26T10:53:22.856Z caller=node_exporter.go:118 level=info collector=bcache
prometheus-1  | ts=2024-04-26T17:00:03.521Z caller=db.go:1684 level=info component=tsdb msg="Deleting obsolete block" block=01HWD7VJQ3CN5DCMV98DD57X9K
prometheus-1  | ts=2024-04-26T19:00:03.320Z caller=compact.go:572 level=info component=tsdb msg="write block" mint=1714147202488 maxt=1714154400000 ulid=01HWDWERZ2MAFZHZMWSV3KWRJ8 duration=150.186149ms
prometheus-1  | ts=2024-04-26T19:00:03.331Z caller=head.go:1338 level=info component=tsdb msg="Head GC completed" caller=truncateMemory duration=8.905285ms
nodeexp-1     | ts=2024-04-26T10:53:22.857Z caller=node_exporter.go:118 level=info collector=bonding
prometheus-1  | ts=2024-04-26T21:00:03.289Z caller=compact.go:572 level=info component=tsdb msg="write block" mint=1714154402486 maxt=1714161600000 ulid=01HWE3AG6TXYT4TGSKDFS32RC2 duration=126.926894ms
nodeexp-1     | ts=2024-04-26T10:53:22.857Z caller=node_exporter.go:118 level=info collector=btrfs
nodeexp-1     | ts=2024-04-26T10:53:22.857Z caller=node_exporter.go:118 level=info collector=conntrack
nodeexp-1     | ts=2024-04-26T10:53:22.857Z caller=node_exporter.go:118 level=info collector=cpu
nodeexp-1     | ts=2024-04-26T10:53:22.857Z caller=node_exporter.go:118 level=info collector=cpufreq
grafana-1     | logger=query_data t=2024-04-26T16:58:19.873364432+05:30 level=info msg="Query Service initialization"
grafana-1     | logger=live.push_http t=2024-04-26T16:58:19.88267259+05:30 level=info msg="Live Push Gateway initialization"
grafana-1     | logger=ngalert.migration t=2024-04-26T16:58:19.893015225+05:30 level=info msg=Starting
grafana-1     | logger=ngalert.state.manager t=2024-04-26T16:58:19.933344731+05:30 level=info msg="Running in alternative execution of Error/NoData mode"
grafana-1     | logger=infra.usagestats.collector t=2024-04-26T16:58:19.939760255+05:30 level=info msg="registering usage stat providers" usageStatsProvidersLen=2
grafana-1     | logger=provisioning.datasources t=2024-04-26T16:58:19.95897955+05:30 level=info msg="deleted datasource based on configuration" name=prometheus
grafana-1     | logger=provisioning.datasources t=2024-04-26T16:58:19.961023892+05:30 level=info msg="inserting datasource from configuration" name=prometheus uid=P1809F7CD0C75ACF3
prometheus-1  | ts=2024-04-26T21:00:03.299Z caller=head.go:1338 level=info component=tsdb msg="Head GC completed" caller=truncateMemory duration=8.68401ms
prometheus-1  | ts=2024-04-26T21:00:03.300Z caller=checkpoint.go:101 level=info component=tsdb msg="Creating checkpoint" from_segment=19 to_segment=20 mint=1714161600000
prometheus-1  | ts=2024-04-26T21:00:03.399Z caller=head.go:1300 level=info component=tsdb msg="WAL checkpoint complete" first=19 last=20 duration=99.118026ms
prometheus-1  | ts=2024-04-26T23:00:03.303Z caller=compact.go:572 level=info component=tsdb msg="write block" mint=1714161602486 maxt=1714168800000 ulid=01HWEA67ENGNXNM38HRXQ5RX7N duration=145.948221ms
prometheus-1  | ts=2024-04-26T23:00:03.314Z caller=head.go:1338 level=info component=tsdb msg="Head GC completed" caller=truncateMemory duration=9.053617ms
prometheus-1  | ts=2024-04-26T23:00:03.661Z caller=compact.go:513 level=info component=tsdb msg="compact blocks" count=3 mint=1714132802486 maxt=1714154400000 ulid=01HWEA67KMV96VPQ75JFZ466BA sources="[01HWDEQA0PVX7M1NFD2MD2S1DN 01HWDNK1Q3FGCF6PQYARQ62KJW 01HWDWERZ2MAFZHZMWSV3KWRJ8]" duration=345.255641ms
prometheus-1  | ts=2024-04-26T23:00:03.666Z caller=db.go:1684 level=info component=tsdb msg="Deleting obsolete block" block=01HWDWERZ2MAFZHZMWSV3KWRJ8
nodeexp-1     | ts=2024-04-26T10:53:22.857Z caller=node_exporter.go:118 level=info collector=diskstats
nodeexp-1     | ts=2024-04-26T10:53:22.857Z caller=node_exporter.go:118 level=info collector=dmi
nodeexp-1     | ts=2024-04-26T10:53:22.857Z caller=node_exporter.go:118 level=info collector=edac
nodeexp-1     | ts=2024-04-26T10:53:22.857Z caller=node_exporter.go:118 level=info collector=entropy
prometheus-1  | ts=2024-04-26T23:00:03.669Z caller=db.go:1684 level=info component=tsdb msg="Deleting obsolete block" block=01HWDEQA0PVX7M1NFD2MD2S1DN
prometheus-1  | ts=2024-04-26T23:00:03.673Z caller=db.go:1684 level=info component=tsdb msg="Deleting obsolete block" block=01HWDNK1Q3FGCF6PQYARQ62KJW
prometheus-1  | ts=2024-04-26T23:00:03.946Z caller=compact.go:513 level=info component=tsdb msg="compact blocks" count=3 mint=1714089602487 maxt=1714154400000 ulid=01HWEA67YTVFMSCPSY9QS9RXRE sources="[01HWD0ZXP267VM4C29KYX0ADVN 01HWDNK1WQC1DABVSDRVN6M2ZA 01HWEA67KMV96VPQ75JFZ466BA]" duration=271.908945ms
prometheus-1  | ts=2024-04-26T23:00:03.950Z caller=db.go:1684 level=info component=tsdb msg="Deleting obsolete block" block=01HWEA67KMV96VPQ75JFZ466BA
prometheus-1  | ts=2024-04-26T23:00:03.955Z caller=db.go:1684 level=info component=tsdb msg="Deleting obsolete block" block=01HWDNK1WQC1DABVSDRVN6M2ZA
prometheus-1  | ts=2024-04-26T23:00:03.960Z caller=db.go:1684 level=info component=tsdb msg="Deleting obsolete block" block=01HWD0ZXP267VM4C29KYX0ADVN
prometheus-1  | ts=2024-04-27T01:00:03.269Z caller=compact.go:572 level=info component=tsdb msg="write block" mint=1714168802486 maxt=1714176000000 ulid=01HWEH1YPE4KJMN0MQJWAANV5J duration=118.618851ms
prometheus-1  | ts=2024-04-27T01:00:03.279Z caller=head.go:1338 level=info component=tsdb msg="Head GC completed" caller=truncateMemory duration=8.743918ms
prometheus-1  | ts=2024-04-27T01:00:03.280Z caller=checkpoint.go:101 level=info component=tsdb msg="Creating checkpoint" from_segment=21 to_segment=22 mint=1714176000000
prometheus-1  | ts=2024-04-27T01:00:03.379Z caller=head.go:1300 level=info component=tsdb msg="WAL checkpoint complete" first=21 last=22 duration=99.403692ms
prometheus-1  | ts=2024-04-27T03:00:03.834Z caller=compact.go:572 level=info component=tsdb msg="write block" mint=1714176002486 maxt=1714183200000 ulid=01HWEQXPF4WZT10MF7G29TARQC duration=150.302753ms
prometheus-1  | ts=2024-04-27T03:00:03.845Z caller=head.go:1338 level=info component=tsdb msg="Head GC completed" caller=truncateMemory duration=8.904801ms
nodeexp-1     | ts=2024-04-26T10:53:22.857Z caller=node_exporter.go:118 level=info collector=fibrechannel
nodeexp-1     | ts=2024-04-26T10:53:22.857Z caller=node_exporter.go:118 level=info collector=filefd
nodeexp-1     | ts=2024-04-26T10:53:22.857Z caller=node_exporter.go:118 level=info collector=filesystem
nodeexp-1     | ts=2024-04-26T10:53:22.857Z caller=node_exporter.go:118 level=info collector=hwmon
nodeexp-1     | ts=2024-04-26T10:53:22.857Z caller=node_exporter.go:118 level=info collector=infiniband
nodeexp-1     | ts=2024-04-26T10:53:22.857Z caller=node_exporter.go:118 level=info collector=ipvs
nodeexp-1     | ts=2024-04-26T10:53:22.857Z caller=node_exporter.go:118 level=info collector=loadavg
nodeexp-1     | ts=2024-04-26T10:53:22.857Z caller=node_exporter.go:118 level=info collector=mdadm
nodeexp-1     | ts=2024-04-26T10:53:22.857Z caller=node_exporter.go:118 level=info collector=meminfo
grafana-1     | logger=provisioning.plugins t=2024-04-26T16:58:20.147009796+05:30 level=error msg="Failed to read plugin provisioning files from directory" path=/etc/grafana/provisioning/plugins error="open /etc/grafana/provisioning/plugins: no such file or directory"
grafana-1     | logger=provisioning.notifiers t=2024-04-26T16:58:20.147106128+05:30 level=error msg="Can't read alert notification provisioning files from directory" path=/etc/grafana/provisioning/notifiers error="open /etc/grafana/provisioning/notifiers: no such file or directory"
nodeexp-1     | ts=2024-04-26T10:53:22.857Z caller=node_exporter.go:118 level=info collector=netclass
nodeexp-1     | ts=2024-04-26T10:53:22.857Z caller=node_exporter.go:118 level=info collector=netdev
grafana-1     | logger=provisioning.alerting t=2024-04-26T16:58:20.147187647+05:30 level=error msg="can't read alerting provisioning files from directory" path=/etc/grafana/provisioning/alerting error="open /etc/grafana/provisioning/alerting: no such file or directory"
nodeexp-1     | ts=2024-04-26T10:53:22.857Z caller=node_exporter.go:118 level=info collector=netstat
nodeexp-1     | ts=2024-04-26T10:53:22.857Z caller=node_exporter.go:118 level=info collector=nfs
nodeexp-1     | ts=2024-04-26T10:53:22.857Z caller=node_exporter.go:118 level=info collector=nfsd
nodeexp-1     | ts=2024-04-26T10:53:22.858Z caller=node_exporter.go:118 level=info collector=nvme
nodeexp-1     | ts=2024-04-26T10:53:22.858Z caller=node_exporter.go:118 level=info collector=os
nodeexp-1     | ts=2024-04-26T10:53:22.858Z caller=node_exporter.go:118 level=info collector=powersupplyclass
nodeexp-1     | ts=2024-04-26T10:53:22.858Z caller=node_exporter.go:118 level=info collector=pressure
nodeexp-1     | ts=2024-04-26T10:53:22.858Z caller=node_exporter.go:118 level=info collector=rapl
nodeexp-1     | ts=2024-04-26T10:53:22.858Z caller=node_exporter.go:118 level=info collector=schedstat
nodeexp-1     | ts=2024-04-26T10:53:22.858Z caller=node_exporter.go:118 level=info collector=selinux
nodeexp-1     | ts=2024-04-26T10:53:22.858Z caller=node_exporter.go:118 level=info collector=sockstat
nodeexp-1     | ts=2024-04-26T10:53:22.858Z caller=node_exporter.go:118 level=info collector=softnet
nodeexp-1     | ts=2024-04-26T10:53:22.858Z caller=node_exporter.go:118 level=info collector=stat
nodeexp-1     | ts=2024-04-26T10:53:22.858Z caller=node_exporter.go:118 level=info collector=tapestats
nodeexp-1     | ts=2024-04-26T10:53:22.858Z caller=node_exporter.go:118 level=info collector=textfile
grafana-1     | logger=provisioning.alerting t=2024-04-26T16:58:20.147209258+05:30 level=info msg="starting to provision alerting"
grafana-1     | logger=provisioning.alerting t=2024-04-26T16:58:20.147239961+05:30 level=info msg="finished to provision alerting"
grafana-1     | logger=grafanaStorageLogger t=2024-04-26T16:58:20.147664885+05:30 level=info msg="Storage starting"
grafana-1     | logger=ngalert.state.manager t=2024-04-26T16:58:20.147807255+05:30 level=info msg="Warming state cache for startup"
grafana-1     | logger=ngalert.state.manager t=2024-04-26T16:58:20.149515672+05:30 level=info msg="State cache has been initialized" states=0 duration=1.702159ms
grafana-1     | logger=ngalert.multiorg.alertmanager t=2024-04-26T16:58:20.149687282+05:30 level=info msg="Starting MultiOrg Alertmanager"
grafana-1     | logger=ngalert.scheduler t=2024-04-26T16:58:20.149789652+05:30 level=info msg="Starting scheduler" tickInterval=10s maxAttempts=1
grafana-1     | logger=ticker t=2024-04-26T16:58:20.14989093+05:30 level=info msg=starting first_tick=2024-04-26T16:58:30+05:30
grafana-1     | logger=http.server t=2024-04-26T16:58:20.154252112+05:30 level=info msg="HTTP Server Listen" address=[::]:3000 protocol=http subUrl= socket=
nodeexp-1     | ts=2024-04-26T10:53:22.858Z caller=node_exporter.go:118 level=info collector=thermal_zone
nodeexp-1     | ts=2024-04-26T10:53:22.858Z caller=node_exporter.go:118 level=info collector=time
nodeexp-1     | ts=2024-04-26T10:53:22.858Z caller=node_exporter.go:118 level=info collector=timex
nodeexp-1     | ts=2024-04-26T10:53:22.858Z caller=node_exporter.go:118 level=info collector=udp_queues
nodeexp-1     | ts=2024-04-26T10:53:22.858Z caller=node_exporter.go:118 level=info collector=uname
nodeexp-1     | ts=2024-04-26T10:53:22.859Z caller=node_exporter.go:118 level=info collector=vmstat
nodeexp-1     | ts=2024-04-26T10:53:22.859Z caller=node_exporter.go:118 level=info collector=watchdog
nodeexp-1     | ts=2024-04-26T10:53:22.859Z caller=node_exporter.go:118 level=info collector=xfs
nodeexp-1     | ts=2024-04-26T10:53:22.859Z caller=node_exporter.go:118 level=info collector=zfs
nodeexp-1     | ts=2024-04-26T10:53:22.860Z caller=tls_config.go:313 level=info msg="Listening on" address=[::]:9100
nodeexp-1     | ts=2024-04-26T10:53:22.861Z caller=tls_config.go:316 level=info msg="TLS is disabled." http2=false address=[::]:9100
nodeexp-1     | ts=2024-04-26T11:10:22.428Z caller=node_exporter.go:193 level=info msg="Starting node_exporter" version="(version=1.8.0, branch=HEAD, revision=cadb1d1190ad95c66b951758f01ff4c94e55e6ce)"
nodeexp-1     | ts=2024-04-26T11:10:22.432Z caller=node_exporter.go:194 level=info msg="Build context" build_context="(go=go1.22.2, platform=linux/arm64, user=root@587d3f12650c, date=20240424-13:16:18, tags=unknown)"
nodeexp-1     | ts=2024-04-26T11:10:22.455Z caller=filesystem_common.go:94 level=warn collector=filesystem msg="--collector.filesystem.ignored-mount-points is DEPRECATED and will be removed in 2.0.0, use --collector.filesystem.mount-points-exclude"
nodeexp-1     | ts=2024-04-26T11:10:22.455Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(sys|proc|dev|host|etc|rootfs/var/lib/docker/containers|rootfs/var/lib/docker/overlay2|rootfs/run/docker/netns|rootfs/var/lib/docker/aufs)($|/)
nodeexp-1     | ts=2024-04-26T11:10:22.455Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$
nodeexp-1     | ts=2024-04-26T11:10:22.456Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(z?ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$
grafana-1     | logger=provisioning.dashboard t=2024-04-26T16:58:20.372254378+05:30 level=info msg="starting to provision dashboards"
grafana-1     | logger=provisioning.dashboard t=2024-04-26T16:58:20.40233986+05:30 level=info msg="finished to provision dashboards"
grafana-1     | logger=plugins.update.checker t=2024-04-26T16:58:20.522790474+05:30 level=info msg="Update check succeeded" duration=358.642207ms
grafana-1     | logger=grafana.update.checker t=2024-04-26T16:58:20.527192878+05:30 level=info msg="Update check succeeded" duration=361.414397ms
nodeexp-1     | ts=2024-04-26T11:10:22.457Z caller=diskstats_linux.go:265 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data
nodeexp-1     | ts=2024-04-26T11:10:22.457Z caller=node_exporter.go:111 level=info msg="Enabled collectors"
nodeexp-1     | ts=2024-04-26T11:10:22.457Z caller=node_exporter.go:118 level=info collector=arp
nodeexp-1     | ts=2024-04-26T11:10:22.457Z caller=node_exporter.go:118 level=info collector=bcache
nodeexp-1     | ts=2024-04-26T11:10:22.457Z caller=node_exporter.go:118 level=info collector=bonding
nodeexp-1     | ts=2024-04-26T11:10:22.457Z caller=node_exporter.go:118 level=info collector=btrfs
nodeexp-1     | ts=2024-04-26T11:10:22.457Z caller=node_exporter.go:118 level=info collector=conntrack
nodeexp-1     | ts=2024-04-26T11:10:22.457Z caller=node_exporter.go:118 level=info collector=cpu
nodeexp-1     | ts=2024-04-26T11:10:22.457Z caller=node_exporter.go:118 level=info collector=cpufreq
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=diskstats
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=dmi
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=edac
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=entropy
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=fibrechannel
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=filefd
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=filesystem
grafana-1     | logger=grafana-apiserver t=2024-04-26T16:58:22.410510864+05:30 level=info msg="Adding GroupVersion playlist.grafana.app v0alpha1 to ResourceManager"
grafana-1     | logger=grafana-apiserver t=2024-04-26T16:58:22.41239067+05:30 level=info msg="Adding GroupVersion featuretoggle.grafana.app v0alpha1 to ResourceManager"
grafana-1     | logger=infra.usagestats t=2024-04-26T16:59:33.218531358+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T16:59:43.581890785+05:30 level=info msg="Request Completed" method=GET path=/api/live/ws status=-1 remote_addr=192.168.100.81 time_ms=7 duration=7.267706ms size=0 referer= handler=/api/live/ws status_source=server
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=hwmon
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=infiniband
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=ipvs
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=loadavg
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=mdadm
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=meminfo
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=netclass
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=netdev
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=netstat
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=nfs
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=nfsd
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=nvme
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=os
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=powersupplyclass
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=pressure
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=rapl
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=schedstat
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=selinux
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=sockstat
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=softnet
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=stat
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=tapestats
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=textfile
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=thermal_zone
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=time
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=timex
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=udp_queues
grafana-1     | logger=live t=2024-04-26T16:59:45.339438903+05:30 level=info msg="Initialized channel handler" channel=grafana/dashboard/uid/o9mIe_Aik address=grafana/dashboard/uid/o9mIe_Aik
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T16:59:57.966632049+05:30 level=info msg="Request Completed" method=GET path=/api/live/ws status=-1 remote_addr=192.168.100.81 time_ms=6 duration=6.753005ms size=0 referer= handler=/api/live/ws status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T16:59:58.360632403+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T16:59:58.36085829+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T16:59:58.361018364+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e0c2d78d651341d99787b05dd941c2cc/panels/8/query status=500 remote_addr=192.168.100.81 time_ms=11 duration=11.741481ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e0c2d78d651341d99787b05dd941c2cc?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=uname
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=vmstat
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=watchdog
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=xfs
nodeexp-1     | ts=2024-04-26T11:10:22.458Z caller=node_exporter.go:118 level=info collector=zfs
nodeexp-1     | ts=2024-04-26T11:10:22.471Z caller=tls_config.go:313 level=info msg="Listening on" address=[::]:9100
nodeexp-1     | ts=2024-04-26T11:10:22.471Z caller=tls_config.go:316 level=info msg="TLS is disabled." http2=false address=[::]:9100
nodeexp-1     | ts=2024-04-26T11:28:13.887Z caller=node_exporter.go:193 level=info msg="Starting node_exporter" version="(version=1.8.0, branch=HEAD, revision=cadb1d1190ad95c66b951758f01ff4c94e55e6ce)"
nodeexp-1     | ts=2024-04-26T11:28:13.887Z caller=node_exporter.go:194 level=info msg="Build context" build_context="(go=go1.22.2, platform=linux/arm64, user=root@587d3f12650c, date=20240424-13:16:18, tags=unknown)"
grafana-1     | logger=publicdashboards.service t=2024-04-26T16:59:58.363568352+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T16:59:58.363804647+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
nodeexp-1     | ts=2024-04-26T11:28:13.889Z caller=filesystem_common.go:94 level=warn collector=filesystem msg="--collector.filesystem.ignored-mount-points is DEPRECATED and will be removed in 2.0.0, use --collector.filesystem.mount-points-exclude"
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T16:59:58.363978961+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e0c2d78d651341d99787b05dd941c2cc/panels/6/query status=500 remote_addr=192.168.100.81 time_ms=11 duration=11.635575ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e0c2d78d651341d99787b05dd941c2cc?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
nodeexp-1     | ts=2024-04-26T11:28:13.889Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(sys|proc|dev|host|etc|rootfs/var/lib/docker/containers|rootfs/var/lib/docker/overlay2|rootfs/run/docker/netns|rootfs/var/lib/docker/aufs)($|/)
nodeexp-1     | ts=2024-04-26T11:28:13.890Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$
nodeexp-1     | ts=2024-04-26T11:28:13.891Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(z?ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$
nodeexp-1     | ts=2024-04-26T11:28:13.891Z caller=diskstats_linux.go:265 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data
nodeexp-1     | ts=2024-04-26T11:28:13.891Z caller=node_exporter.go:111 level=info msg="Enabled collectors"
nodeexp-1     | ts=2024-04-26T11:28:13.891Z caller=node_exporter.go:118 level=info collector=arp
nodeexp-1     | ts=2024-04-26T11:28:13.891Z caller=node_exporter.go:118 level=info collector=bcache
nodeexp-1     | ts=2024-04-26T11:28:13.891Z caller=node_exporter.go:118 level=info collector=bonding
nodeexp-1     | ts=2024-04-26T11:28:13.891Z caller=node_exporter.go:118 level=info collector=btrfs
grafana-1     | logger=publicdashboards.service t=2024-04-26T16:59:58.378405449+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T16:59:58.378702021+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T16:59:58.378926817+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e0c2d78d651341d99787b05dd941c2cc/panels/14/query status=500 remote_addr=192.168.100.81 time_ms=10 duration=10.989374ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e0c2d78d651341d99787b05dd941c2cc?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T16:59:58.422635352+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T16:59:58.423143998+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T16:59:58.423292664+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e0c2d78d651341d99787b05dd941c2cc/panels/4/query status=500 remote_addr=192.168.100.81 time_ms=72 duration=72.155273ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e0c2d78d651341d99787b05dd941c2cc?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T16:59:58.42517947+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T16:59:58.425495505+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T16:59:58.425672634+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e0c2d78d651341d99787b05dd941c2cc/panels/10/query status=500 remote_addr=192.168.100.81 time_ms=76 duration=76.115327ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e0c2d78d651341d99787b05dd941c2cc?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T16:59:58.430469426+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T16:59:58.430656981+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T16:59:58.430775888+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e0c2d78d651341d99787b05dd941c2cc/panels/12/query status=500 remote_addr=192.168.100.81 time_ms=81 duration=81.385006ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e0c2d78d651341d99787b05dd941c2cc?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T16:59:59.392894092+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T16:59:59.393215627+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T16:59:59.393436978+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e0c2d78d651341d99787b05dd941c2cc/panels/20/query status=500 remote_addr=192.168.100.81 time_ms=21 duration=21.255141ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e0c2d78d651341d99787b05dd941c2cc?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
nodeexp-1     | ts=2024-04-26T11:28:13.891Z caller=node_exporter.go:118 level=info collector=conntrack
nodeexp-1     | ts=2024-04-26T11:28:13.891Z caller=node_exporter.go:118 level=info collector=cpu
nodeexp-1     | ts=2024-04-26T11:28:13.891Z caller=node_exporter.go:118 level=info collector=cpufreq
nodeexp-1     | ts=2024-04-26T11:28:13.891Z caller=node_exporter.go:118 level=info collector=diskstats
nodeexp-1     | ts=2024-04-26T11:28:13.891Z caller=node_exporter.go:118 level=info collector=dmi
nodeexp-1     | ts=2024-04-26T11:28:13.891Z caller=node_exporter.go:118 level=info collector=edac
nodeexp-1     | ts=2024-04-26T11:28:13.891Z caller=node_exporter.go:118 level=info collector=entropy
nodeexp-1     | ts=2024-04-26T11:28:13.891Z caller=node_exporter.go:118 level=info collector=fibrechannel
nodeexp-1     | ts=2024-04-26T11:28:13.891Z caller=node_exporter.go:118 level=info collector=filefd
nodeexp-1     | ts=2024-04-26T11:28:13.891Z caller=node_exporter.go:118 level=info collector=filesystem
nodeexp-1     | ts=2024-04-26T11:28:13.891Z caller=node_exporter.go:118 level=info collector=hwmon
nodeexp-1     | ts=2024-04-26T11:28:13.891Z caller=node_exporter.go:118 level=info collector=infiniband
nodeexp-1     | ts=2024-04-26T11:28:13.891Z caller=node_exporter.go:118 level=info collector=ipvs
nodeexp-1     | ts=2024-04-26T11:28:13.891Z caller=node_exporter.go:118 level=info collector=loadavg
nodeexp-1     | ts=2024-04-26T11:28:13.891Z caller=node_exporter.go:118 level=info collector=mdadm
nodeexp-1     | ts=2024-04-26T11:28:13.891Z caller=node_exporter.go:118 level=info collector=meminfo
nodeexp-1     | ts=2024-04-26T11:28:13.891Z caller=node_exporter.go:118 level=info collector=netclass
nodeexp-1     | ts=2024-04-26T11:28:13.892Z caller=node_exporter.go:118 level=info collector=netdev
nodeexp-1     | ts=2024-04-26T11:28:13.892Z caller=node_exporter.go:118 level=info collector=netstat
nodeexp-1     | ts=2024-04-26T11:28:13.892Z caller=node_exporter.go:118 level=info collector=nfs
nodeexp-1     | ts=2024-04-26T11:28:13.892Z caller=node_exporter.go:118 level=info collector=nfsd
nodeexp-1     | ts=2024-04-26T11:28:13.892Z caller=node_exporter.go:118 level=info collector=nvme
nodeexp-1     | ts=2024-04-26T11:28:13.892Z caller=node_exporter.go:118 level=info collector=os
nodeexp-1     | ts=2024-04-26T11:28:13.892Z caller=node_exporter.go:118 level=info collector=powersupplyclass
nodeexp-1     | ts=2024-04-26T11:28:13.892Z caller=node_exporter.go:118 level=info collector=pressure
nodeexp-1     | ts=2024-04-26T11:28:13.892Z caller=node_exporter.go:118 level=info collector=rapl
nodeexp-1     | ts=2024-04-26T11:28:13.892Z caller=node_exporter.go:118 level=info collector=schedstat
nodeexp-1     | ts=2024-04-26T11:28:13.892Z caller=node_exporter.go:118 level=info collector=selinux
nodeexp-1     | ts=2024-04-26T11:28:13.892Z caller=node_exporter.go:118 level=info collector=sockstat
nodeexp-1     | ts=2024-04-26T11:28:13.892Z caller=node_exporter.go:118 level=info collector=softnet
nodeexp-1     | ts=2024-04-26T11:28:13.892Z caller=node_exporter.go:118 level=info collector=stat
nodeexp-1     | ts=2024-04-26T11:28:13.892Z caller=node_exporter.go:118 level=info collector=tapestats
grafana-1     | logger=publicdashboards.service t=2024-04-26T16:59:59.42599577+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T16:59:59.426318417+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T16:59:59.426515471+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e0c2d78d651341d99787b05dd941c2cc/panels/18/query status=500 remote_addr=192.168.100.81 time_ms=18 duration=18.980578ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e0c2d78d651341d99787b05dd941c2cc?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T16:59:59.459762759+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T16:59:59.460517978+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T16:59:59.460790755+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e0c2d78d651341d99787b05dd941c2cc/panels/17/query status=500 remote_addr=192.168.100.81 time_ms=19 duration=19.43602ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e0c2d78d651341d99787b05dd941c2cc?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T16:59:59.495216741+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T16:59:59.495500499+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T16:59:59.495698869+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e0c2d78d651341d99787b05dd941c2cc/panels/16/query status=500 remote_addr=192.168.100.81 time_ms=17 duration=17.825397ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e0c2d78d651341d99787b05dd941c2cc?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T16:59:59.517570858+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T16:59:59.517824987+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T16:59:59.517993505+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e0c2d78d651341d99787b05dd941c2cc/panels/15/query status=500 remote_addr=192.168.100.81 time_ms=15 duration=15.345243ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e0c2d78d651341d99787b05dd941c2cc?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T16:59:59.543332275+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T16:59:59.543597477+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T16:59:59.543784865+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e0c2d78d651341d99787b05dd941c2cc/panels/19/query status=500 remote_addr=192.168.100.81 time_ms=15 duration=15.183318ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e0c2d78d651341d99787b05dd941c2cc?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:00:19.794247232+05:30 level=info msg="Request Completed" method=GET path=/api/live/ws status=-1 remote_addr=192.168.100.81 time_ms=6 duration=6.503748ms size=0 referer= handler=/api/live/ws status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T17:00:19.932904214+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:00:19.933103084+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:00:19.933228306+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e0c2d78d651341d99787b05dd941c2cc/panels/4/query status=500 remote_addr=192.168.100.81 time_ms=10 duration=10.97406ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e0c2d78d651341d99787b05dd941c2cc?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T17:00:19.940647326+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:00:19.940840807+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:00:19.941545378+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e0c2d78d651341d99787b05dd941c2cc/panels/8/query status=500 remote_addr=192.168.100.81 time_ms=21 duration=21.083476ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e0c2d78d651341d99787b05dd941c2cc?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T17:00:19.980551714+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:00:19.981252322+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
nodeexp-1     | ts=2024-04-26T11:28:13.892Z caller=node_exporter.go:118 level=info collector=textfile
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:00:19.981769986+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e0c2d78d651341d99787b05dd941c2cc/panels/14/query status=500 remote_addr=192.168.100.81 time_ms=13 duration=13.3844ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e0c2d78d651341d99787b05dd941c2cc?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T17:00:19.988012902+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:00:19.988218734+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:00:19.988357807+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e0c2d78d651341d99787b05dd941c2cc/panels/6/query status=500 remote_addr=192.168.100.81 time_ms=66 duration=66.100543ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e0c2d78d651341d99787b05dd941c2cc?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T17:00:19.996159826+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
nodeexp-1     | ts=2024-04-26T11:28:13.892Z caller=node_exporter.go:118 level=info collector=thermal_zone
nodeexp-1     | ts=2024-04-26T11:28:13.892Z caller=node_exporter.go:118 level=info collector=time
nodeexp-1     | ts=2024-04-26T11:28:13.892Z caller=node_exporter.go:118 level=info collector=timex
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:00:19.996352974+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:00:19.99647614+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e0c2d78d651341d99787b05dd941c2cc/panels/12/query status=500 remote_addr=192.168.100.81 time_ms=74 duration=74.221912ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e0c2d78d651341d99787b05dd941c2cc?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T17:00:19.997212044+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:00:19.997413043+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:00:19.997567172+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e0c2d78d651341d99787b05dd941c2cc/panels/10/query status=500 remote_addr=192.168.100.81 time_ms=75 duration=75.055575ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e0c2d78d651341d99787b05dd941c2cc?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:00:41.617738522+05:30 level=info msg="Not found" error="[publicdashboards.notFound] FindByDashboardUid: Public dashboard not found by orgId: 1 and dashboardUid: o9mIe_Aik" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:00:41.617899614+05:30 level=info msg="Request Completed" method=GET path=/api/dashboards/uid/o9mIe_Aik/public-dashboards status=404 remote_addr=192.168.100.81 time_ms=4 duration=4.900811ms size=110 referer="http://192.168.100.154:3000/d/o9mIe_Aik/internet-connection?orgId=1&refresh=5m&shareView=link" handler=/api/dashboards/uid/:dashboardUid/public-dashboards status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T17:00:44.560221075+05:30 level=info msg="Public dashboard enabled" publicDashboardUid=bdjw7rtoehb0gd dashboardUid=o9mIe_Aik user=admin
grafana-1     | logger=context userId=0 orgId=1 uname= t=2024-04-26T17:01:02.388626402+05:30 level=info msg="Request Completed" method=GET path=/api/live/ws status=-1 remote_addr=192.168.100.81 time_ms=8 duration=8.16519ms size=0 referer= handler=/api/live/ws status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T17:01:02.935503165+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
nodeexp-1     | ts=2024-04-26T11:28:13.892Z caller=node_exporter.go:118 level=info collector=udp_queues
grafana-1     | logger=context userId=0 orgId=1 uname= t=2024-04-26T17:01:02.935725954+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
nodeexp-1     | ts=2024-04-26T11:28:13.892Z caller=node_exporter.go:118 level=info collector=uname
nodeexp-1     | ts=2024-04-26T11:28:13.892Z caller=node_exporter.go:118 level=info collector=vmstat
nodeexp-1     | ts=2024-04-26T11:28:13.892Z caller=node_exporter.go:118 level=info collector=watchdog
nodeexp-1     | ts=2024-04-26T11:28:13.892Z caller=node_exporter.go:118 level=info collector=xfs
nodeexp-1     | ts=2024-04-26T11:28:13.892Z caller=node_exporter.go:118 level=info collector=zfs
nodeexp-1     | ts=2024-04-26T11:28:13.893Z caller=tls_config.go:313 level=info msg="Listening on" address=[::]:9100
nodeexp-1     | ts=2024-04-26T11:28:13.893Z caller=tls_config.go:316 level=info msg="TLS is disabled." http2=false address=[::]:9100
grafana-1     | logger=context userId=0 orgId=1 uname= t=2024-04-26T17:01:02.935863986+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e22f9e768c9142ebb31982710306de14/panels/12/query status=500 remote_addr=192.168.100.81 time_ms=16 duration=16.76744ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e22f9e768c9142ebb31982710306de14?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T17:01:02.939273909+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=0 orgId=1 uname= t=2024-04-26T17:01:02.939789485+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=0 orgId=1 uname= t=2024-04-26T17:01:02.940077364+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e22f9e768c9142ebb31982710306de14/panels/8/query status=500 remote_addr=192.168.100.81 time_ms=22 duration=22.311681ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e22f9e768c9142ebb31982710306de14?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T17:01:02.989312313+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=0 orgId=1 uname= t=2024-04-26T17:01:02.989608636+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=0 orgId=1 uname= t=2024-04-26T17:01:02.989854665+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e22f9e768c9142ebb31982710306de14/panels/20/query status=500 remote_addr=192.168.100.81 time_ms=23 duration=23.062527ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e22f9e768c9142ebb31982710306de14?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T17:01:02.99958097+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=0 orgId=1 uname= t=2024-04-26T17:01:02.999783371+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=0 orgId=1 uname= t=2024-04-26T17:01:02.999998549+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e22f9e768c9142ebb31982710306de14/panels/6/query status=500 remote_addr=192.168.100.81 time_ms=78 duration=78.966808ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e22f9e768c9142ebb31982710306de14?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T17:01:03.004877534+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=0 orgId=1 uname= t=2024-04-26T17:01:03.005077176+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=0 orgId=1 uname= t=2024-04-26T17:01:03.005245578+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e22f9e768c9142ebb31982710306de14/panels/4/query status=500 remote_addr=192.168.100.81 time_ms=83 duration=83.726353ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e22f9e768c9142ebb31982710306de14?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T17:01:03.042512226+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=0 orgId=1 uname= t=2024-04-26T17:01:03.042914676+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=0 orgId=1 uname= t=2024-04-26T17:01:03.043218814+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e22f9e768c9142ebb31982710306de14/panels/10/query status=500 remote_addr=192.168.100.81 time_ms=124 duration=124.103972ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e22f9e768c9142ebb31982710306de14?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T17:01:03.114057049+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=0 orgId=1 uname= t=2024-04-26T17:01:03.114532237+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=0 orgId=1 uname= t=2024-04-26T17:01:03.11469499+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e22f9e768c9142ebb31982710306de14/panels/14/query status=500 remote_addr=192.168.100.81 time_ms=15 duration=15.965617ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e22f9e768c9142ebb31982710306de14?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:01:18.855384243+05:30 level=info msg="Request Completed" method=GET path=/api/live/ws status=-1 remote_addr=192.168.100.81 time_ms=13 duration=13.462034ms size=0 referer= handler=/api/live/ws status_source=server
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:01:19.075302971+05:30 level=info msg="Not found" error="[publicdashboards.notFound] FindByAccessToken: Public dashboard not found accessToken: e0c2d78d651341d99787b05dd941c2cc" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:01:19.076140889+05:30 level=info msg="Request Completed" method=GET path=/api/public/dashboards/e0c2d78d651341d99787b05dd941c2cc status=404 remote_addr=192.168.100.81 time_ms=16 duration=16.220781ms size=110 referer="http://192.168.100.154:3000/public-dashboards/e0c2d78d651341d99787b05dd941c2cc?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/ status_source=server
grafana-1     | logger=live t=2024-04-26T17:01:19.090926457+05:30 level=info msg="Error subscribing: wrong orgId" user=1 client=57f81317-7d4c-4065-ab9d-51ddec49bc8c channel="0/grafana/dashboard/uid/Public Dashboard Not found"
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:01:19.107470691+05:30 level=info msg="Not found" error="[publicdashboards.notFound] FindByAccessToken: Public dashboard not found accessToken: e0c2d78d651341d99787b05dd941c2cc" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:01:19.107794496+05:30 level=info msg="Request Completed" method=GET path=/api/public/dashboards/e0c2d78d651341d99787b05dd941c2cc/annotations status=404 remote_addr=192.168.100.81 time_ms=16 duration=16.444108ms size=110 referer="http://192.168.100.154:3000/public-dashboards/e0c2d78d651341d99787b05dd941c2cc?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/annotations status_source=server
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:01:33.242847792+05:30 level=info msg="Request Completed" method=GET path=/api/live/ws status=-1 remote_addr=192.168.100.81 time_ms=6 duration=6.537097ms size=0 referer= handler=/api/live/ws status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T17:01:33.452869913+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:01:33.453071925+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=publicdashboards.service t=2024-04-26T17:01:33.455514647+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:01:33.45552561+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e22f9e768c9142ebb31982710306de14/panels/8/query status=500 remote_addr=192.168.100.81 time_ms=13 duration=13.263948ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e22f9e768c9142ebb31982710306de14?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:01:33.455716122+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:01:33.456422305+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e22f9e768c9142ebb31982710306de14/panels/12/query status=500 remote_addr=192.168.100.81 time_ms=11 duration=11.229362ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e22f9e768c9142ebb31982710306de14?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T17:01:33.504107278+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:01:33.504559227+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:01:33.504852144+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e22f9e768c9142ebb31982710306de14/panels/14/query status=500 remote_addr=192.168.100.81 time_ms=15 duration=15.442233ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e22f9e768c9142ebb31982710306de14?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T17:01:33.508368+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:01:33.508614215+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:01:33.508758118+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e22f9e768c9142ebb31982710306de14/panels/10/query status=500 remote_addr=192.168.100.81 time_ms=63 duration=63.787872ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e22f9e768c9142ebb31982710306de14?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T17:01:33.509564963+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:01:33.509941526+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:01:33.510081522+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e22f9e768c9142ebb31982710306de14/panels/6/query status=500 remote_addr=192.168.100.81 time_ms=64 duration=64.77286ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e22f9e768c9142ebb31982710306de14?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T17:01:33.515967657+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:01:33.516257963+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:01:33.516428069+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e22f9e768c9142ebb31982710306de14/panels/4/query status=500 remote_addr=192.168.100.81 time_ms=71 duration=71.128814ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e22f9e768c9142ebb31982710306de14?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:02:21.359857909+05:30 level=info msg="Request Completed" method=GET path=/api/live/ws status=-1 remote_addr=192.168.100.81 time_ms=6 duration=6.554419ms size=0 referer= handler=/api/live/ws status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T17:02:21.615175769+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:02:21.615385208+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:02:21.615516353+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e22f9e768c9142ebb31982710306de14/panels/8/query status=500 remote_addr=192.168.100.81 time_ms=11 duration=11.05815ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e22f9e768c9142ebb31982710306de14?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T17:02:21.617196456+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:02:21.61749543+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:02:21.617692406+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e22f9e768c9142ebb31982710306de14/panels/6/query status=500 remote_addr=192.168.100.81 time_ms=11 duration=11.396234ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e22f9e768c9142ebb31982710306de14?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T17:02:21.654695218+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:02:21.655009469+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:02:21.655167558+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e22f9e768c9142ebb31982710306de14/panels/14/query status=500 remote_addr=192.168.100.81 time_ms=14 duration=14.784625ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e22f9e768c9142ebb31982710306de14?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T17:02:21.666921893+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:02:21.667297383+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:02:21.667447861+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e22f9e768c9142ebb31982710306de14/panels/4/query status=500 remote_addr=192.168.100.81 time_ms=61 duration=61.177225ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e22f9e768c9142ebb31982710306de14?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T17:02:21.672295713+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:02:21.67256791+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:02:21.672756349+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e22f9e768c9142ebb31982710306de14/panels/10/query status=500 remote_addr=192.168.100.81 time_ms=66 duration=66.257054ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e22f9e768c9142ebb31982710306de14?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=publicdashboards.service t=2024-04-26T17:02:21.674039037+05:30 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[]
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:02:21.674266383+05:30 level=error msg= error="unexpected error type [*errors.errorString]: data source not found" remote_addr=192.168.100.81 traceID=
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:02:21.674399991+05:30 level=error msg="Request Completed" method=POST path=/api/public/dashboards/e22f9e768c9142ebb31982710306de14/panels/12/query status=500 remote_addr=192.168.100.81 time_ms=66 duration=66.067614ms size=48 referer="http://192.168.100.154:3000/public-dashboards/e22f9e768c9142ebb31982710306de14?orgId=1&refresh=5m" handler=/api/public/dashboards/:accessToken/panels/:panelId/query status_source=server
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:06:17.245828332+05:30 level=info msg="Request Completed" method=GET path=/api/live/ws status=-1 remote_addr=192.168.100.81 time_ms=6 duration=6.542696ms size=0 referer= handler=/api/live/ws status_source=server
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:06:35.884324948+05:30 level=info msg="Request Completed" method=GET path=/api/live/ws status=-1 remote_addr=192.168.100.81 time_ms=6 duration=6.596477ms size=0 referer= handler=/api/live/ws status_source=server
grafana-1     | logger=cleanup t=2024-04-26T17:08:20.311267313+05:30 level=info msg="Completed cleanup jobs" duration=163.431318ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T17:08:20.806354523+05:30 level=info msg="Update check succeeded" duration=283.248865ms
grafana-1     | logger=cleanup t=2024-04-26T17:18:20.272189744+05:30 level=info msg="Completed cleanup jobs" duration=124.336044ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T17:18:20.791849825+05:30 level=info msg="Update check succeeded" duration=268.771577ms
grafana-1     | logger=cleanup t=2024-04-26T17:28:20.268581818+05:30 level=info msg="Completed cleanup jobs" duration=120.609239ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T17:28:20.786231096+05:30 level=info msg="Update check succeeded" duration=262.28436ms
grafana-1     | logger=infra.usagestats t=2024-04-26T17:29:33.248009251+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-26T17:38:20.277217689+05:30 level=info msg="Completed cleanup jobs" duration=128.895513ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T17:38:20.857904489+05:30 level=info msg="Update check succeeded" duration=333.966825ms
grafana-1     | logger=context userId=0 orgId=0 uname= t=2024-04-26T17:39:10.262805031+05:30 level=info msg="Request Completed" method=GET path=/ status=302 remote_addr=192.168.100.81 time_ms=2 duration=2.618783ms size=47 referer= handler=/ status_source=server
grafana-1     | logger=context userId=0 orgId=0 uname= t=2024-04-26T17:39:10.281250551+05:30 level=info msg="Request Completed" method=GET path=/user/auth-tokens/rotate status=302 remote_addr=192.168.100.81 time_ms=11 duration=11.5524ms size=24 referer= handler=/user/auth-tokens/rotate status_source=server
grafana-1     | logger=context userId=1 orgId=1 uname=admin t=2024-04-26T17:39:10.581207358+05:30 level=info msg="Request Completed" method=GET path=/api/live/ws status=-1 remote_addr=192.168.100.81 time_ms=6 duration=6.735142ms size=0 referer= handler=/api/live/ws status_source=server
grafana-1     | logger=cleanup t=2024-04-26T17:48:20.276532751+05:30 level=info msg="Completed cleanup jobs" duration=127.837999ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T17:48:20.792312646+05:30 level=info msg="Update check succeeded" duration=268.913077ms
grafana-1     | logger=cleanup t=2024-04-26T17:58:20.263217666+05:30 level=info msg="Completed cleanup jobs" duration=115.191355ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T17:58:20.83343893+05:30 level=info msg="Update check succeeded" duration=310.408465ms
grafana-1     | logger=infra.usagestats t=2024-04-26T17:59:33.266261106+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-26T18:08:20.280674936+05:30 level=info msg="Completed cleanup jobs" duration=132.240901ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T18:08:20.901980102+05:30 level=info msg="Update check succeeded" duration=378.755958ms
grafana-1     | logger=cleanup t=2024-04-26T18:18:20.256635194+05:30 level=info msg="Completed cleanup jobs" duration=108.509284ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T18:18:20.805857418+05:30 level=info msg="Update check succeeded" duration=282.524653ms
grafana-1     | logger=cleanup t=2024-04-26T18:28:20.218183426+05:30 level=info msg="Completed cleanup jobs" duration=69.9234ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T18:28:20.783090346+05:30 level=info msg="Update check succeeded" duration=260.12184ms
grafana-1     | logger=infra.usagestats t=2024-04-26T18:29:33.272353155+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-26T18:38:20.199836111+05:30 level=info msg="Completed cleanup jobs" duration=51.200623ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T18:38:20.790317249+05:30 level=info msg="Update check succeeded" duration=266.833234ms
grafana-1     | logger=cleanup t=2024-04-26T18:48:20.262464978+05:30 level=info msg="Completed cleanup jobs" duration=114.502581ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T18:48:20.784931051+05:30 level=info msg="Update check succeeded" duration=262.018886ms
grafana-1     | logger=cleanup t=2024-04-26T18:58:20.352378462+05:30 level=info msg="Completed cleanup jobs" duration=203.866569ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T18:58:20.851267762+05:30 level=info msg="Update check succeeded" duration=327.432411ms
grafana-1     | logger=infra.usagestats t=2024-04-26T18:59:33.247493375+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-26T19:08:20.274747935+05:30 level=info msg="Completed cleanup jobs" duration=126.764951ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T19:08:20.802376671+05:30 level=info msg="Update check succeeded" duration=278.651512ms
grafana-1     | logger=cleanup t=2024-04-26T19:18:20.258054495+05:30 level=info msg="Completed cleanup jobs" duration=109.536098ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T19:18:20.785689102+05:30 level=info msg="Update check succeeded" duration=262.444657ms
grafana-1     | logger=cleanup t=2024-04-26T19:28:20.277514856+05:30 level=info msg="Completed cleanup jobs" duration=128.850106ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T19:28:20.788979371+05:30 level=info msg="Update check succeeded" duration=265.767468ms
grafana-1     | logger=infra.usagestats t=2024-04-26T19:29:33.248021688+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-26T19:38:20.281129667+05:30 level=info msg="Completed cleanup jobs" duration=133.189458ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T19:38:20.802927152+05:30 level=info msg="Update check succeeded" duration=279.69859ms
grafana-1     | logger=cleanup t=2024-04-26T19:48:20.250853004+05:30 level=info msg="Completed cleanup jobs" duration=102.74496ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T19:48:20.816339145+05:30 level=info msg="Update check succeeded" duration=293.431603ms
grafana-1     | logger=cleanup t=2024-04-26T19:58:20.25928794+05:30 level=info msg="Completed cleanup jobs" duration=110.986341ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T19:58:20.800762959+05:30 level=info msg="Update check succeeded" duration=276.932557ms
grafana-1     | logger=infra.usagestats t=2024-04-26T19:59:33.278220011+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-26T20:08:20.198881851+05:30 level=info msg="Completed cleanup jobs" duration=50.438009ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T20:08:20.794689092+05:30 level=info msg="Update check succeeded" duration=271.519517ms
grafana-1     | logger=cleanup t=2024-04-26T20:18:20.274534286+05:30 level=info msg="Completed cleanup jobs" duration=126.574935ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T20:18:20.789161327+05:30 level=info msg="Update check succeeded" duration=265.912573ms
grafana-1     | logger=cleanup t=2024-04-26T20:28:20.276340925+05:30 level=info msg="Completed cleanup jobs" duration=128.070842ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T20:28:20.789795436+05:30 level=info msg="Update check succeeded" duration=266.549758ms
grafana-1     | logger=infra.usagestats t=2024-04-26T20:29:33.247800889+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-26T20:38:20.217869592+05:30 level=info msg="Completed cleanup jobs" duration=69.403509ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T20:38:20.791261598+05:30 level=info msg="Update check succeeded" duration=268.129185ms
grafana-1     | logger=cleanup t=2024-04-26T20:48:20.259048658+05:30 level=info msg="Completed cleanup jobs" duration=110.585051ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T20:48:20.944027847+05:30 level=info msg="Update check succeeded" duration=420.387067ms
grafana-1     | logger=cleanup t=2024-04-26T20:58:20.29954091+05:30 level=info msg="Completed cleanup jobs" duration=151.077543ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T20:58:20.818558675+05:30 level=info msg="Update check succeeded" duration=295.438222ms
grafana-1     | logger=infra.usagestats t=2024-04-26T20:59:33.268531682+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-26T21:08:20.260477103+05:30 level=info msg="Completed cleanup jobs" duration=112.519105ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T21:08:20.786169503+05:30 level=info msg="Update check succeeded" duration=262.579881ms
grafana-1     | logger=cleanup t=2024-04-26T21:18:20.263373544+05:30 level=info msg="Completed cleanup jobs" duration=112.757936ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T21:18:20.792385069+05:30 level=info msg="Update check succeeded" duration=268.653945ms
grafana-1     | logger=cleanup t=2024-04-26T21:28:20.299970182+05:30 level=info msg="Completed cleanup jobs" duration=151.537531ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T21:28:20.828710425+05:30 level=info msg="Update check succeeded" duration=305.339893ms
grafana-1     | logger=infra.usagestats t=2024-04-26T21:29:33.246954587+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-26T21:38:20.220357327+05:30 level=info msg="Completed cleanup jobs" duration=71.58587ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T21:38:20.796317193+05:30 level=info msg="Update check succeeded" duration=272.468395ms
grafana-1     | logger=cleanup t=2024-04-26T21:48:20.276054752+05:30 level=info msg="Completed cleanup jobs" duration=127.33614ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T21:48:20.788216596+05:30 level=info msg="Update check succeeded" duration=265.251851ms
grafana-1     | logger=cleanup t=2024-04-26T21:58:20.261083469+05:30 level=info msg="Completed cleanup jobs" duration=112.815871ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T21:58:20.844353555+05:30 level=info msg="Update check succeeded" duration=320.958153ms
grafana-1     | logger=infra.usagestats t=2024-04-26T21:59:33.247612882+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-26T22:08:20.277069428+05:30 level=info msg="Completed cleanup jobs" duration=125.904023ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T22:08:20.785495953+05:30 level=info msg="Update check succeeded" duration=261.938365ms
grafana-1     | logger=cleanup t=2024-04-26T22:18:20.280082758+05:30 level=info msg="Completed cleanup jobs" duration=131.49341ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T22:18:20.794485717+05:30 level=info msg="Update check succeeded" duration=270.742979ms
grafana-1     | logger=cleanup t=2024-04-26T22:28:20.219515141+05:30 level=info msg="Completed cleanup jobs" duration=71.650923ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T22:28:20.794519586+05:30 level=info msg="Update check succeeded" duration=271.189213ms
grafana-1     | logger=infra.usagestats t=2024-04-26T22:29:33.247640458+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-26T22:38:20.219494528+05:30 level=info msg="Completed cleanup jobs" duration=71.020928ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T22:38:20.788568306+05:30 level=info msg="Update check succeeded" duration=264.615543ms
grafana-1     | logger=cleanup t=2024-04-26T22:48:20.275425088+05:30 level=info msg="Completed cleanup jobs" duration=125.154795ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T22:48:20.78227162+05:30 level=info msg="Update check succeeded" duration=259.047379ms
grafana-1     | logger=cleanup t=2024-04-26T22:58:20.301769568+05:30 level=info msg="Completed cleanup jobs" duration=153.10063ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T22:58:20.785766185+05:30 level=info msg="Update check succeeded" duration=261.983997ms
grafana-1     | logger=infra.usagestats t=2024-04-26T22:59:33.249754016+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-26T23:08:20.19916711+05:30 level=info msg="Completed cleanup jobs" duration=50.625347ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T23:08:20.792591586+05:30 level=info msg="Update check succeeded" duration=268.753233ms
grafana-1     | logger=cleanup t=2024-04-26T23:18:20.219507412+05:30 level=info msg="Completed cleanup jobs" duration=70.821117ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T23:18:20.785181309+05:30 level=info msg="Update check succeeded" duration=261.842353ms
grafana-1     | logger=cleanup t=2024-04-26T23:28:20.275059266+05:30 level=info msg="Completed cleanup jobs" duration=126.460639ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T23:28:20.792190229+05:30 level=info msg="Update check succeeded" duration=268.250298ms
grafana-1     | logger=infra.usagestats t=2024-04-26T23:29:33.247607671+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-26T23:38:20.277059468+05:30 level=info msg="Completed cleanup jobs" duration=128.902914ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T23:38:20.804317695+05:30 level=info msg="Update check succeeded" duration=280.765531ms
grafana-1     | logger=cleanup t=2024-04-26T23:48:20.260859399+05:30 level=info msg="Completed cleanup jobs" duration=112.253977ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T23:48:20.804668576+05:30 level=info msg="Update check succeeded" duration=281.219329ms
grafana-1     | logger=cleanup t=2024-04-26T23:58:20.275705513+05:30 level=info msg="Completed cleanup jobs" duration=127.844287ms
grafana-1     | logger=plugins.update.checker t=2024-04-26T23:58:20.813879422+05:30 level=info msg="Update check succeeded" duration=290.044848ms
grafana-1     | logger=infra.usagestats t=2024-04-26T23:59:33.247409775+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-27T00:08:20.276974218+05:30 level=info msg="Completed cleanup jobs" duration=128.701957ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T00:08:20.812519066+05:30 level=info msg="Update check succeeded" duration=289.524954ms
grafana-1     | logger=cleanup t=2024-04-27T00:18:20.270757872+05:30 level=info msg="Completed cleanup jobs" duration=122.560091ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T00:18:20.792274864+05:30 level=info msg="Update check succeeded" duration=268.965201ms
grafana-1     | logger=cleanup t=2024-04-27T00:28:20.219844262+05:30 level=info msg="Completed cleanup jobs" duration=71.582054ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T00:28:20.792812245+05:30 level=info msg="Update check succeeded" duration=269.574275ms
grafana-1     | logger=infra.usagestats t=2024-04-27T00:29:33.268450436+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-27T00:38:20.22009097+05:30 level=info msg="Completed cleanup jobs" duration=71.527629ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T00:38:20.795858842+05:30 level=info msg="Update check succeeded" duration=272.735124ms
grafana-1     | logger=cleanup t=2024-04-27T00:48:20.27658783+05:30 level=info msg="Completed cleanup jobs" duration=128.526201ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T00:48:20.788480878+05:30 level=info msg="Update check succeeded" duration=265.464677ms
grafana-1     | logger=cleanup t=2024-04-27T00:58:20.281172534+05:30 level=info msg="Completed cleanup jobs" duration=133.062945ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T00:58:20.816640404+05:30 level=info msg="Update check succeeded" duration=293.204458ms
grafana-1     | logger=infra.usagestats t=2024-04-27T00:59:33.247806325+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-27T01:08:20.300416114+05:30 level=info msg="Completed cleanup jobs" duration=152.159032ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T01:08:20.793557347+05:30 level=info msg="Update check succeeded" duration=270.582686ms
grafana-1     | logger=cleanup t=2024-04-27T01:18:20.262978247+05:30 level=info msg="Completed cleanup jobs" duration=114.792685ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T01:18:20.826800787+05:30 level=info msg="Update check succeeded" duration=303.539905ms
grafana-1     | logger=cleanup t=2024-04-27T01:28:20.276143515+05:30 level=info msg="Completed cleanup jobs" duration=127.500253ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T01:28:20.937874971+05:30 level=info msg="Update check succeeded" duration=414.39694ms
grafana-1     | logger=infra.usagestats t=2024-04-27T01:29:33.247702177+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-27T01:38:20.281829515+05:30 level=info msg="Completed cleanup jobs" duration=133.623583ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T01:38:20.787515237+05:30 level=info msg="Update check succeeded" duration=264.304348ms
grafana-1     | logger=cleanup t=2024-04-27T01:48:20.276134846+05:30 level=info msg="Completed cleanup jobs" duration=127.84758ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T01:48:20.80452499+05:30 level=info msg="Update check succeeded" duration=281.596804ms
grafana-1     | logger=cleanup t=2024-04-27T01:58:20.265573417+05:30 level=info msg="Completed cleanup jobs" duration=117.769224ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T01:58:20.793503444+05:30 level=info msg="Update check succeeded" duration=270.078118ms
grafana-1     | logger=infra.usagestats t=2024-04-27T01:59:33.246217961+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-27T02:08:20.279640401+05:30 level=info msg="Completed cleanup jobs" duration=131.510045ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T02:08:20.801465895+05:30 level=info msg="Update check succeeded" duration=278.496517ms
grafana-1     | logger=cleanup t=2024-04-27T02:18:20.219180535+05:30 level=info msg="Completed cleanup jobs" duration=70.726994ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T02:18:20.789875969+05:30 level=info msg="Update check succeeded" duration=266.209939ms
grafana-1     | logger=cleanup t=2024-04-27T02:28:20.199062773+05:30 level=info msg="Completed cleanup jobs" duration=50.406922ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T02:28:20.805313149+05:30 level=info msg="Update check succeeded" duration=282.288324ms
grafana-1     | logger=infra.usagestats t=2024-04-27T02:29:33.266038132+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-27T02:38:20.219977258+05:30 level=info msg="Completed cleanup jobs" duration=71.659026ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T02:38:20.786689785+05:30 level=info msg="Update check succeeded" duration=262.988991ms
grafana-1     | logger=cleanup t=2024-04-27T02:48:20.262491914+05:30 level=info msg="Completed cleanup jobs" duration=114.063729ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T02:48:20.78741915+05:30 level=info msg="Update check succeeded" duration=264.014887ms
grafana-1     | logger=cleanup t=2024-04-27T02:58:20.280058621+05:30 level=info msg="Completed cleanup jobs" duration=131.631019ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T02:58:20.792093407+05:30 level=info msg="Update check succeeded" duration=269.166108ms
grafana-1     | logger=infra.usagestats t=2024-04-27T02:59:33.247074659+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-27T03:08:20.275859566+05:30 level=info msg="Completed cleanup jobs" duration=127.526965ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T03:08:20.7923174+05:30 level=info msg="Update check succeeded" duration=269.35122ms
grafana-1     | logger=cleanup t=2024-04-27T03:18:20.279240015+05:30 level=info msg="Completed cleanup jobs" duration=131.123105ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T03:18:20.785571561+05:30 level=info msg="Update check succeeded" duration=262.671849ms
grafana-1     | logger=cleanup t=2024-04-27T03:28:20.276500945+05:30 level=info msg="Completed cleanup jobs" duration=128.180263ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T03:28:20.786011573+05:30 level=info msg="Update check succeeded" duration=262.767743ms
grafana-1     | logger=infra.usagestats t=2024-04-27T03:29:33.247626846+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-27T03:38:20.275464376+05:30 level=info msg="Completed cleanup jobs" duration=127.663125ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T03:38:20.788484726+05:30 level=info msg="Update check succeeded" duration=265.358194ms
grafana-1     | logger=cleanup t=2024-04-27T03:48:20.218494724+05:30 level=info msg="Completed cleanup jobs" duration=70.509771ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T03:48:20.786951521+05:30 level=info msg="Update check succeeded" duration=263.454945ms
grafana-1     | logger=cleanup t=2024-04-27T03:58:20.261702165+05:30 level=info msg="Completed cleanup jobs" duration=113.149614ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T03:58:20.791783495+05:30 level=info msg="Update check succeeded" duration=268.496132ms
grafana-1     | logger=infra.usagestats t=2024-04-27T03:59:33.247655125+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-27T04:08:20.28064729+05:30 level=info msg="Completed cleanup jobs" duration=130.033842ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T04:08:20.790778468+05:30 level=info msg="Update check succeeded" duration=266.830564ms
grafana-1     | logger=cleanup t=2024-04-27T04:18:20.261054752+05:30 level=info msg="Completed cleanup jobs" duration=113.10145ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T04:18:20.793695532+05:30 level=info msg="Update check succeeded" duration=269.942733ms
grafana-1     | logger=cleanup t=2024-04-27T04:28:20.19956112+05:30 level=info msg="Completed cleanup jobs" duration=51.149609ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T04:28:20.792445841+05:30 level=info msg="Update check succeeded" duration=269.476229ms
grafana-1     | logger=infra.usagestats t=2024-04-27T04:29:33.247837481+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-27T04:38:20.259440836+05:30 level=info msg="Completed cleanup jobs" duration=110.987769ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T04:38:20.788971002+05:30 level=info msg="Update check succeeded" duration=265.066828ms
grafana-1     | logger=cleanup t=2024-04-27T04:48:20.274969074+05:30 level=info msg="Completed cleanup jobs" duration=126.457698ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T04:48:20.786625333+05:30 level=info msg="Update check succeeded" duration=262.725568ms
grafana-1     | logger=cleanup t=2024-04-27T04:58:20.313562906+05:30 level=info msg="Completed cleanup jobs" duration=165.729251ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T04:58:20.784606631+05:30 level=info msg="Update check succeeded" duration=261.239954ms
grafana-1     | logger=infra.usagestats t=2024-04-27T04:59:33.265945884+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-27T05:08:20.276716886+05:30 level=info msg="Completed cleanup jobs" duration=128.520546ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T05:08:20.784103559+05:30 level=info msg="Update check succeeded" duration=260.998817ms
grafana-1     | logger=cleanup t=2024-04-27T05:18:20.219665892+05:30 level=info msg="Completed cleanup jobs" duration=71.230413ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T05:18:20.849360146+05:30 level=info msg="Update check succeeded" duration=325.860624ms
grafana-1     | logger=cleanup t=2024-04-27T05:28:20.218731418+05:30 level=info msg="Completed cleanup jobs" duration=70.500443ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T05:28:20.791207699+05:30 level=info msg="Update check succeeded" duration=268.018133ms
grafana-1     | logger=infra.usagestats t=2024-04-27T05:29:33.250231424+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-27T05:38:20.21900855+05:30 level=info msg="Completed cleanup jobs" duration=70.630644ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T05:38:20.806754738+05:30 level=info msg="Update check succeeded" duration=283.198062ms
grafana-1     | logger=cleanup t=2024-04-27T05:48:20.272003861+05:30 level=info msg="Completed cleanup jobs" duration=123.61677ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T05:48:20.788378269+05:30 level=info msg="Update check succeeded" duration=265.443342ms
grafana-1     | logger=cleanup t=2024-04-27T05:58:20.278607523+05:30 level=info msg="Completed cleanup jobs" duration=129.991324ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T05:58:20.787119765+05:30 level=info msg="Update check succeeded" duration=263.671453ms
grafana-1     | logger=infra.usagestats t=2024-04-27T05:59:33.248384507+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-27T06:08:20.278907583+05:30 level=info msg="Completed cleanup jobs" duration=130.835197ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T06:08:20.804539663+05:30 level=info msg="Update check succeeded" duration=280.934475ms
grafana-1     | logger=cleanup t=2024-04-27T06:18:20.22058969+05:30 level=info msg="Completed cleanup jobs" duration=72.003342ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T06:18:20.805677317+05:30 level=info msg="Update check succeeded" duration=282.112249ms
grafana-1     | logger=cleanup t=2024-04-27T06:28:20.218055245+05:30 level=info msg="Completed cleanup jobs" duration=70.272378ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T06:28:20.787853437+05:30 level=info msg="Update check succeeded" duration=263.995616ms
grafana-1     | logger=infra.usagestats t=2024-04-27T06:29:33.247737766+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-27T06:38:20.277248587+05:30 level=info msg="Completed cleanup jobs" duration=129.213953ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T06:38:20.805118535+05:30 level=info msg="Update check succeeded" duration=282.149186ms
grafana-1     | logger=cleanup t=2024-04-27T06:48:20.219452164+05:30 level=info msg="Completed cleanup jobs" duration=70.722144ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T06:48:20.814937859+05:30 level=info msg="Update check succeeded" duration=291.80875ms
grafana-1     | logger=cleanup t=2024-04-27T06:58:20.219377551+05:30 level=info msg="Completed cleanup jobs" duration=70.698864ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T06:58:20.786777094+05:30 level=info msg="Update check succeeded" duration=263.476038ms
grafana-1     | logger=infra.usagestats t=2024-04-27T06:59:33.261807699+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-27T07:08:20.300703937+05:30 level=info msg="Completed cleanup jobs" duration=152.383116ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T07:08:20.781144214+05:30 level=info msg="Update check succeeded" duration=258.171525ms
grafana-1     | logger=cleanup t=2024-04-27T07:18:20.277341987+05:30 level=info msg="Completed cleanup jobs" duration=128.991599ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T07:18:20.804736731+05:30 level=info msg="Update check succeeded" duration=281.428756ms
grafana-1     | logger=cleanup t=2024-04-27T07:28:20.275226647+05:30 level=info msg="Completed cleanup jobs" duration=126.92629ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T07:28:20.787036993+05:30 level=info msg="Update check succeeded" duration=264.086007ms
grafana-1     | logger=infra.usagestats t=2024-04-27T07:29:33.246760115+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-27T07:38:20.279221309+05:30 level=info msg="Completed cleanup jobs" duration=130.956167ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T07:38:20.787572282+05:30 level=info msg="Update check succeeded" duration=264.088257ms
grafana-1     | logger=cleanup t=2024-04-27T07:48:20.277896335+05:30 level=info msg="Completed cleanup jobs" duration=129.264718ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T07:48:20.78537303+05:30 level=info msg="Update check succeeded" duration=262.161833ms
grafana-1     | logger=cleanup t=2024-04-27T07:58:20.275331421+05:30 level=info msg="Completed cleanup jobs" duration=127.425115ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T07:58:20.777507147+05:30 level=info msg="Update check succeeded" duration=253.609641ms
grafana-1     | logger=infra.usagestats t=2024-04-27T07:59:33.267667415+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-27T08:08:20.27556944+05:30 level=info msg="Completed cleanup jobs" duration=127.346315ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T08:08:20.803716745+05:30 level=info msg="Update check succeeded" duration=280.403418ms
grafana-1     | logger=cleanup t=2024-04-27T08:18:20.207702785+05:30 level=info msg="Completed cleanup jobs" duration=58.252348ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T08:18:20.785842616+05:30 level=info msg="Update check succeeded" duration=262.698294ms
grafana-1     | logger=cleanup t=2024-04-27T08:28:20.219687935+05:30 level=info msg="Completed cleanup jobs" duration=71.704513ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T08:28:20.798305521+05:30 level=info msg="Update check succeeded" duration=274.748215ms
grafana-1     | logger=infra.usagestats t=2024-04-27T08:29:33.270481825+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-27T08:38:20.2792904+05:30 level=info msg="Completed cleanup jobs" duration=131.148806ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T08:38:20.804629755+05:30 level=info msg="Update check succeeded" duration=281.493891ms
grafana-1     | logger=cleanup t=2024-04-27T08:48:20.274937833+05:30 level=info msg="Completed cleanup jobs" duration=126.400157ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T08:48:20.788166086+05:30 level=info msg="Update check succeeded" duration=264.557291ms
grafana-1     | logger=cleanup t=2024-04-27T08:58:20.27925316+05:30 level=info msg="Completed cleanup jobs" duration=130.519191ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T08:58:20.805368018+05:30 level=info msg="Update check succeeded" duration=281.709084ms
grafana-1     | logger=infra.usagestats t=2024-04-27T08:59:33.247484943+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-27T09:08:20.277748745+05:30 level=info msg="Completed cleanup jobs" duration=129.489128ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T09:08:20.784767844+05:30 level=info msg="Update check succeeded" duration=261.613987ms
grafana-1     | logger=cleanup t=2024-04-27T09:18:20.275097434+05:30 level=info msg="Completed cleanup jobs" duration=127.125047ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T09:18:20.7972011+05:30 level=info msg="Update check succeeded" duration=273.685208ms
grafana-1     | logger=cleanup t=2024-04-27T09:28:20.276538843+05:30 level=info msg="Completed cleanup jobs" duration=128.139542ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T09:28:20.794303067+05:30 level=info msg="Update check succeeded" duration=271.257333ms
grafana-1     | logger=infra.usagestats t=2024-04-27T09:29:33.247051048+05:30 level=info msg="Usage stats are ready to report"
grafana-1     | logger=cleanup t=2024-04-27T09:38:20.272488083+05:30 level=info msg="Completed cleanup jobs" duration=124.180223ms
grafana-1     | logger=plugins.update.checker t=2024-04-27T09:38:20.792686923+05:30 level=info msg="Update check succeeded" duration=269.317902ms
Centaro0 commented 2 months ago

Hello everybody,

I got the same issue after migrating my database and grafana to a new machine. Now on Grafana 11.1.1 and MariaDB 11.4.3

logger=publicdashboards.service t=2024-08-25T11:10:07.97311833+02:00 level=error msg="Error querying datasources for public dashboard" error="data source not found" datasources=[mysql]

However, I do not understand why, because the Dashboard loads correctly from within the Grafana UI, but only when it goes public, it struggles to find the data source.