prometheus-operator / kube-prometheus

Use Prometheus to monitor Kubernetes and applications running on Kubernetes
https://prometheus-operator.dev/
Apache License 2.0
6.74k stars 1.93k forks source link

Grafana no such file or directory #2535

Open TeslaHan opened 3 weeks ago

TeslaHan commented 3 weeks ago

logger=settings t=2024-10-12T08:46:17.257211566Z level=info msg="Starting Grafana" version=11.2.1 commit=6291d0d71414b7ad982a9a5f5e7f0e13a4a42cba branch=v11.2.x compiled=2024-10-12T08:46:17Z logger=settings t=2024-10-12T08:46:17.329389706Z level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini logger=settings t=2024-10-12T08:46:17.329413715Z level=info msg="Config loaded from" file=/etc/grafana/grafana.ini logger=settings t=2024-10-12T08:46:17.329416682Z level=info msg="Config overridden from command line" arg="default.paths.data=/var/lib/grafana" logger=settings t=2024-10-12T08:46:17.329418844Z level=info msg="Config overridden from command line" arg="default.paths.logs=/var/log/grafana" logger=settings t=2024-10-12T08:46:17.329420745Z level=info msg="Config overridden from command line" arg="default.paths.plugins=/var/lib/grafana/plugins" logger=settings t=2024-10-12T08:46:17.329422671Z level=info msg="Config overridden from command line" arg="default.paths.provisioning=/etc/grafana/provisioning" logger=settings t=2024-10-12T08:46:17.329424671Z level=info msg="Config overridden from command line" arg="default.log.mode=console" logger=settings t=2024-10-12T08:46:17.329427204Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana" logger=settings t=2024-10-12T08:46:17.329429421Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana" logger=settings t=2024-10-12T08:46:17.329432472Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" logger=settings t=2024-10-12T08:46:17.329435479Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" logger=settings t=2024-10-12T08:46:17.329438493Z level=info msg=Target target=[all] logger=settings t=2024-10-12T08:46:17.329467071Z level=info msg="Path Home" path=/usr/share/grafana logger=settings t=2024-10-12T08:46:17.329469937Z level=info msg="Path Data" path=/var/lib/grafana logger=settings t=2024-10-12T08:46:17.329471875Z level=info msg="Path Logs" path=/var/log/grafana logger=settings t=2024-10-12T08:46:17.329510486Z level=info msg="Path Plugins" path=/var/lib/grafana/plugins logger=settings t=2024-10-12T08:46:17.329512831Z level=info msg="Path Provisioning" path=/etc/grafana/provisioning logger=settings t=2024-10-12T08:46:17.329515335Z level=info msg="App mode production" logger=featuremgmt t=2024-10-12T08:46:17.32990518Z level=info msg=FeatureToggles formatString=true lokiQuerySplitting=true cloudWatchNewLabelParsing=true recordedQueriesMulti=true groupToNestedTableTransformation=true angularDeprecationUI=true annotationPermissionUpdate=true dataplaneFrontendFallback=true exploreMetrics=true tlsMemcached=true awsAsyncQueryCaching=true logsInfiniteScrolling=true nestedFolders=true lokiMetricDataplane=true lokiStructuredMetadata=true logsExploreTableVisualisation=true kubernetesPlaylists=true alertingSimplifiedRouting=true correlations=true transformationsVariableSupport=true prometheusConfigOverhaulAuth=true prometheusAzureOverrideAudience=true cloudWatchRoundUpEndTime=true addFieldFromCalculationStatFunctions=true panelMonitoring=true cloudWatchCrossAccountQuerying=true topnav=true logRowsPopoverMenu=true dashgpt=true prometheusMetricEncyclopedia=true alertingNoDataErrorExecution=true managedPluginsInstall=true ssoSettingsApi=true lokiQueryHints=true prometheusDataplane=true recoveryThreshold=true publicDashboards=true autoMigrateXYChartPanel=true transformationsRedesign=true influxdbBackendMigration=true alertingInsights=true logsContextDatasourceUi=true logger=sqlstore t=2024-10-12T08:46:17.330002079Z level=info msg="Connecting to DB" dbtype=sqlite3 logger=migrator t=2024-10-12T08:46:17.353155794Z level=info msg="Locking database" logger=migrator t=2024-10-12T08:46:17.35318119Z level=info msg="Starting DB migrations" logger=migrator t=2024-10-12T08:46:17.437387331Z level=info msg="migrations completed" performed=0 skipped=594 duration=399.669µs logger=migrator t=2024-10-12T08:46:17.437830191Z level=info msg="Unlocking database" logger=secrets t=2024-10-12T08:46:17.439090739Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 logger=plugin.angulardetectorsprovider.dynamic t=2024-10-12T08:46:17.832123079Z level=info msg="Restored cache from database" duration=2.24832ms logger=plugin.store t=2024-10-12T08:46:18.034940104Z level=info msg="Loading plugins..." logger=plugins.registration t=2024-10-12T08:46:18.253344015Z level=error msg="Could not register plugin" pluginId=xychart error="plugin xychart is already registered" logger=plugins.initialization t=2024-10-12T08:46:18.253385146Z level=error msg="Could not initialize plugin" pluginId=xychart error="plugin xychart is already registered" logger=local.finder t=2024-10-12T08:46:18.253470172Z level=warn msg="Skipping finding plugins as directory does not exist" path=/usr/share/grafana/plugins-bundled logger=plugin.store t=2024-10-12T08:46:18.253479807Z level=info msg="Plugins loaded" count=54 duration=218.540356ms logger=query_data t=2024-10-12T08:46:18.352128405Z level=info msg="Query Service initialization" logger=live.push_http t=2024-10-12T08:46:18.494252571Z level=info msg="Live Push Gateway initialization" logger=ngalert.notifier.alertmanager org=1 t=2024-10-12T08:46:19.35552806Z level=info msg="Applying new configuration to Alertmanager" configHash=d2c56faca6af2a5772ff4253222f7386 logger=ngalert.state.manager t=2024-10-12T08:46:19.360960208Z level=info msg="Running in alternative execution of Error/NoData mode" logger=infra.usagestats.collector t=2024-10-12T08:46:19.470018395Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 logger=provisioning.plugins t=2024-10-12T08:46:19.557075619Z level=error msg="Failed to read plugin provisioning files from directory" path=/etc/grafana/provisioning/plugins error="open /etc/grafana/provisioning/plugins: no such file or directory" logger=provisioning.alerting t=2024-10-12T08:46:19.557127506Z level=error msg="can't read alerting provisioning files from directory" path=/etc/grafana/provisioning/alerting error="open /etc/grafana/provisioning/alerting: no such file or directory" logger=provisioning.alerting t=2024-10-12T08:46:19.557131239Z level=info msg="starting to provision alerting" logger=provisioning.alerting t=2024-10-12T08:46:19.557137192Z level=info msg="finished to provision alerting" logger=grafanaStorageLogger t=2024-10-12T08:46:19.563923283Z level=info msg="Storage starting" logger=ngalert.state.manager t=2024-10-12T08:46:19.650928408Z level=info msg="Warming state cache for startup" logger=ngalert.state.manager t=2024-10-12T08:46:19.656522356Z level=info msg="State cache has been initialized" states=0 duration=5.592677ms logger=ngalert.multiorg.alertmanager t=2024-10-12T08:46:19.656565359Z level=info msg="Starting MultiOrg Alertmanager" logger=ngalert.scheduler t=2024-10-12T08:46:19.656608973Z level=info msg="Starting scheduler" tickInterval=10s maxAttempts=1 logger=http.server t=2024-10-12T08:46:19.85622183Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=http subUrl= socket= logger=provisioning.dashboard t=2024-10-12T08:46:19.95303681Z level=info msg="starting to provision dashboards" logger=ticker t=2024-10-12T08:46:19.953963265Z level=info msg=starting first_tick=2024-10-12T08:46:20Z logger=provisioning.dashboard t=2024-10-12T08:46:23.150700238Z level=info msg="finished to provision dashboards" logger=grafana-apiserver t=2024-10-12T08:46:27.089504323Z level=info msg="failed to read in-cluster kubeconfig for delegated authentication: open /var/run/secrets/kubernetes.io/serviceaccount/token: no such file or directory" logger=grafana-apiserver t=2024-10-12T08:46:27.75092473Z level=info msg="Adding GroupVersion playlist.grafana.app v0alpha1 to ResourceManager" logger=grafana-apiserver t=2024-10-12T08:46:27.850690212Z level=info msg="Adding GroupVersion featuretoggle.grafana.app v0alpha1 to ResourceManager" logger=grafana.update.checker t=2024-10-12T08:46:31.654423872Z level=error msg="Update check failed" error="failed to get stable version from grafana.com: Get \"https://grafana.com/api/grafana/versions/stable\": dial tcp: lookup grafana.com: i/o timeout" duration=11.703167041s logger=infra.usagestats t=2024-10-12T08:47:55.264681266Z level=info msg="Usage stats are ready to report" logger=cleanup t=2024-10-12T08:56:20.193137351Z level=info msg="Completed cleanup jobs" duration=433.724234ms logger=plugins.update.checker t=2024-10-12T08:56:33.399498801Z level=info msg="Update check succeeded" duration=1.641613259s logger=cleanup t=2024-10-12T10:30:54.140045672Z level=error msg="Cancelled cleanup job" error="context deadline exceeded" duration=1h24m13.488657058s logger=cleanup t=2024-10-12T11:49:32.851595682Z level=error msg="Cancelled cleanup job" error="context deadline exceeded" duration=40m12.476835896s

Kustomize Version: v5.0.4-0.20230601165947-6ce0bf390ce3 Server Version: v1.28.0

I am using the latest main version, and after executing the command, the Grafana container does not become ready. How can I resolve this issue?

meijinmeng commented 2 days ago

me too....