search

elastic / cloud-on-k8s

Elastic Cloud on Kubernetes
Other
2.58k stars 703 forks source link

Quickstart guide on kibana with ECK does not work #3790

Closed MaCoredroid closed 4 years ago

MaCoredroid commented 4 years ago

Proposal

Use case. Why is this important? Can't run Kibana part on quickstart https://www.elastic.co/guide/en/cloud-on-k8s/1.2/k8s-deploy-kibana.html

Bug Report

What did you do? I tried to follow the quickstart on my cluster,get blocked on Kibana part after successfully deployed ECK cluster in the last step (https://www.elastic.co/guide/en/cloud-on-k8s/1.2/k8s-deploy-elasticsearch.html) What did you expect to see? Kibana should be health in green and ready to use. What did you see instead? Under which circumstances? After deploy 7.9.2 version as the guide said, the pod keeps crashing, the log says FATAL Error: Setup lifecycle of "monitoring" plugin wasn't completed in 30sec. Consider disabling the plugin and re-start. Environment

sebgl commented 4 years ago

Is there a chance the Kibana Pod runs on a slow machine with slow CPU?

MaCoredroid commented 4 years ago

Is there a chance the Kibana Pod runs on a slow machine with slow CPU?

Thanks for the reply. I have considered about low memory/cpu issue before, so I upgraded all nodes to 16G ram and 4 vcpu. But the "monitoring" plugin is not working as before, so this might not be the cause.

sebgl commented 4 years ago

Could you try enabling verbose logging in Kibana so we can maybe get more details?

apiVersion: kibana.k8s.elastic.co/v1
kind: Kibana
metadata:
  name: quickstart
spec:
  version: 7.9.2
  count: 1
  elasticsearchRef:
    name: quickstart
  config:
    logging.verbose: true
MaCoredroid commented 4 years ago

Could you try enabling verbose logging in Kibana so we can maybe get more details?

apiVersion: kibana.k8s.elastic.co/v1
kind: Kibana
metadata:
  name: quickstart
spec:
  version: 7.9.2
  count: 1
  elasticsearchRef:
    name: quickstart
  config:
    logging.verbose: true

{"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["info","plugins-system"],"pid":6,"message":"Setting up [92] plugins: [taskManager,licensing,observability,globalSearch,globalSearchProviders,code,usageCollection,ossTelemetry,telemetryCollectionManager,telemetry,telemetryCollectionXpack,kibanaUsageCollection,newsfeed,mapsLegacy,kibanaLegacy,translations,timelion,share,legacyExport,esUiShared,charts,bfetch,expressions,data,home,cloud,console,consoleExtensions,apmOss,searchprofiler,painlessLab,grokdebugger,management,upgradeAssistant,licenseManagement,watcher,indexPatternManagement,advancedSettings,fileUpload,dataEnhanced,savedObjects,visualizations,visualize,visTypeVislib,visTypeVega,visTypeTimeseries,visTypeTimelion,features,security,reporting,snapshotRestore,enterpriseSearch,encryptedSavedObjects,ingestManager,indexManagement,rollup,remoteClusters,crossClusterReplication,indexLifecycleManagement,beats_management,transform,ingestPipelines,maps,graph,canvas,visTypeTable,visTypeTagcloud,visTypeMetric,visTypeMarkdown,tileMap,regionMap,inputControlVis,discover,discoverEnhanced,dashboard,lens,dashboardMode,savedObjectsManagement,spaces,lists,eventLog,actions,case,alerts,alertingBuiltins,ml,securitySolution,infra,monitoring,logstash,apm,uptime]"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"taskManager\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","taskManager"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: xpack,task_manager"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"licensing\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","licensing"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: xpack,licensing"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","licensing"],"pid":6,"message":"Setting up Licensing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","licensing"],"pid":6,"message":"Polling Elasticsearch License API with frequency 30000ms."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"observability\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","observability"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: xpack,observability"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"globalSearch\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","globalSearch"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: xpack,global_search"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"globalSearchProviders\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","globalSearchProviders"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"code\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","code"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: xpack,code"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"usageCollection\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","usageCollection"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: usageCollection"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"ossTelemetry\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","ossTelemetry"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"telemetryCollectionManager\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","telemetryCollectionManager"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"telemetry\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","telemetry"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: telemetry"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: telemetry"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"telemetryCollectionXpack\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","telemetryCollectionXpack"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"kibanaUsageCollection\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","kibanaUsageCollection"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"newsfeed\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","newsfeed"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"mapsLegacy\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","mapsLegacy"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: map"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"kibanaLegacy\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","kibanaLegacy"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"translations\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","translations"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"timelion\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","timelion"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"share\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","share"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"legacyExport\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","legacyExport"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"esUiShared\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","esUiShared"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"charts\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","charts"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"bfetch\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","bfetch"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"expressions\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","expressions"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"data\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","data"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: data"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"home\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","home"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"cloud\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","cloud"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: xpack,cloud"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","cloud"],"pid":6,"message":"Setting up Cloud plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"console\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","console"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: console"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"consoleExtensions\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","consoleExtensions"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","consoleExtensions"],"pid":6,"message":"Added extension path to /usr/share/kibana/x-pack/plugins/console_extensions/server/lib/spec_definitions/json..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"apmOss\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","apmOss"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: apm_oss"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"searchprofiler\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","searchprofiler"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"painlessLab\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","painlessLab"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"grokdebugger\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","grokdebugger"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"management\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","management"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","management"],"pid":6,"message":"management: Setup"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"upgradeAssistant\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","upgradeAssistant"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"licenseManagement\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","licenseManagement"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"watcher\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","watcher"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"indexPatternManagement\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","indexPatternManagement"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"advancedSettings\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","advancedSettings"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","advancedSettings"],"pid":6,"message":"advancedSettings: Setup"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"fileUpload\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","fileUpload"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"dataEnhanced\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","dataEnhanced"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"savedObjects\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","savedObjects"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"visualizations\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","visualizations"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","visualizations"],"pid":6,"message":"visualizations: Setup"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"visualize\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","visualize"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","visualize"],"pid":6,"message":"visualize: Setup"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"visTypeVislib\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","visTypeVislib"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"visTypeVega\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","visTypeVega"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"visTypeTimeseries\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","visTypeTimeseries"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: vis_type_timeseries"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"visTypeTimelion\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","visTypeTimelion"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: vis_type_timelion"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: vis_type_timelion"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"features\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","features"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"security\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","security"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: xpack,security"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","security","authenticator"],"pid":6,"message":"Enabling \"basic\" (basic) authentication provider."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","security","authentication"],"pid":6,"message":"Successfully initialized authenticator."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","security","authentication"],"pid":6,"message":"Successfully registered core authentication handler."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"reporting\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","reporting"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: xpack,reporting"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"snapshotRestore\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","snapshotRestore"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: xpack,snapshot_restore"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"enterpriseSearch\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","enterpriseSearch"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: enterpriseSearch"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"encryptedSavedObjects\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","encryptedSavedObjects"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: xpack,encryptedSavedObjects"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"ingestManager\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","ingestManager"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: xpack,ingestManager"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"indexManagement\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","indexManagement"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"rollup\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","rollup"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"remoteClusters\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","remoteClusters"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: xpack,remote_clusters"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"crossClusterReplication\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","crossClusterReplication"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: xpack,ccr"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"indexLifecycleManagement\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","indexLifecycleManagement"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: xpack,ilm"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"beats_management\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","beats_management"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: xpack,beats_management"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"transform\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","transform"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"ingestPipelines\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","ingestPipelines"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","ingestPipelines"],"pid":6,"message":"ingest_pipelines: setup"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"maps\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","maps"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: xpack,maps"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"graph\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","graph"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"canvas\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","canvas"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"visTypeTable\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","visTypeTable"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"visTypeTagcloud\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","visTypeTagcloud"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"visTypeMetric\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","visTypeMetric"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"visTypeMarkdown\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","visTypeMarkdown"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"tileMap\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","tileMap"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"regionMap\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","regionMap"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"inputControlVis\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","inputControlVis"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"discover\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","discover"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"discoverEnhanced\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","discoverEnhanced"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"dashboard\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","dashboard"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","dashboard"],"pid":6,"message":"dashboard: Setup"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"lens\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","lens"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"dashboardMode\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","dashboardMode"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","dashboardMode"],"pid":6,"message":"registered DashboardModeRequestInterceptor"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"savedObjectsManagement\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","savedObjectsManagement"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","savedObjectsManagement"],"pid":6,"message":"Setting up SavedObjectsManagement plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"spaces\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","spaces"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: xpack,spaces"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"lists\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","lists"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: xpack,lists"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"eventLog\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","eventLog"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: xpack,eventLog"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","eventLog"],"pid":6,"message":"setting up plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"actions\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","actions"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: xpack,actions"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"case\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","case"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: xpack,case"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","case"],"pid":6,"message":"Setting up Case Workflow with core contract [capabilities,context,elasticsearch,http,logging,savedObjects,status,uiSettings,uuid,getStartServices,auditTrail] and plugins [actions,spaces,security]"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"alerts\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","alerts"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"alertingBuiltins\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","alertingBuiltins"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","alertingBuiltins"],"pid":6,"message":"registering indexThreshold route POST /api/alerting_builtins/index_threshold/_time_series_query"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","alertingBuiltins"],"pid":6,"message":"registering indexThreshold route POST /api/alerting_builtins/index_threshold/_fields"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","alertingBuiltins"],"pid":6,"message":"registering indexThreshold route POST /api/alerting_builtins/index_threshold/_indices"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"ml\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","ml"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"securitySolution\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","securitySolution"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: xpack,securitySolution"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","securitySolution","plugins","securitySolution"],"pid":6,"message":"plugin initialized"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","securitySolution","plugins","securitySolution"],"pid":6,"message":"plugin setup"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"infra\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","infra"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: xpack,infra"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins-system"],"pid":6,"message":"Setting up plugin \"monitoring\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","monitoring"],"pid":6,"message":"Initializing plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","config"],"pid":6,"message":"Marking config path as handled: monitoring"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["info","plugins","monitoring","monitoring"],"pid":6,"message":"config sourced from: production cluster"} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","licensing"],"pid":6,"message":"Polling Elasticsearch License API with frequency 30000ms."} {"type":"log","@timestamp":"2020-10-04T08:23:06Z","tags":["debug","plugins","licensing"],"pid":6,"message":"Requesting Elasticsearch licensing API"} {"type":"log","@timestamp":"2020-10-04T08:23:07Z","tags":["debug","plugins","reporting","config"],"pid":6,"message":"Running on OS: 'Linux Centos 7.8.2003'"} {"type":"log","@timestamp":"2020-10-04T08:23:07Z","tags":["warning","plugins","reporting","config"],"pid":6,"message":"Chromium sandbox provides an additional layer of protection, but is not supported for Linux Centos 7.8.2003 OS. Automatically setting 'xpack.reporting.capture.browser.chromium.disableSandbox: true'."} {"type":"log","@timestamp":"2020-10-04T08:23:07Z","tags":["debug","plugins","reporting"],"pid":6,"message":"Setup complete"} {"type":"log","@timestamp":"2020-10-04T08:23:10Z","tags":["debug","http"],"pid":6,"message":"Kibana server is not ready yet get:/login."} {"type":"log","@timestamp":"2020-10-04T08:23:20Z","tags":["debug","http"],"pid":6,"message":"Kibana server is not ready yet get:/login."} {"type":"log","@timestamp":"2020-10-04T08:23:30Z","tags":["debug","http"],"pid":6,"message":"Kibana server is not ready yet get:/login."} {"type":"log","@timestamp":"2020-10-04T08:23:36Z","tags":["debug","root"],"pid":6,"message":"shutting root down"} {"type":"log","@timestamp":"2020-10-04T08:23:36Z","tags":["fatal","root"],"pid":6,"message":"Error: Setup lifecycle of \"monitoring\" plugin wasn't completed in 30sec. Consider disabling the plugin and re-start.\n at Timeout.setTimeout (/usr/share/kibana/src/core/utils/promise.js:31:90)\n at ontimeout (timers.js:436:11)\n at tryOnTimeout (timers.js:300:5)\n at listOnTimeout (timers.js:263:5)\n at Timer.processTimers (timers.js:223:10)"} {"type":"log","@timestamp":"2020-10-04T08:23:36Z","tags":["debug","server"],"pid":6,"message":"stopping server"} {"type":"log","@timestamp":"2020-10-04T08:23:36Z","tags":["debug","legacy-service"],"pid":6,"message":"stopping legacy service"} {"type":"log","@timestamp":"2020-10-04T08:23:36Z","tags":["debug","plugins-service"],"pid":6,"message":"Stopping plugins service"} {"type":"log","@timestamp":"2020-10-04T08:23:36Z","tags":["info","plugins-system"],"pid":6,"message":"Stopping all plugins."} {"type":"log","@timestamp":"2020-10-04T08:23:36Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"infra\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:36Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"securitySolution\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:36Z","tags":["debug","plugins","securitySolution","plugins","securitySolution"],"pid":6,"message":"Stopping plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"ml\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"alertingBuiltins\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"alerts\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"case\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins","case"],"pid":6,"message":"Stopping Case Workflow"} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"actions\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"eventLog\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins","eventLog"],"pid":6,"message":"stopping plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"lists\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins","lists"],"pid":6,"message":"Stopping plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"spaces\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"savedObjectsManagement\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"dashboardMode\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"lens\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"dashboard\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"discoverEnhanced\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"discover\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"inputControlVis\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"regionMap\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"tileMap\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"visTypeMarkdown\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"visTypeMetric\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"visTypeTagcloud\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"visTypeTable\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"canvas\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"graph\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"maps\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"ingestPipelines\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"transform\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"beats_management\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"indexLifecycleManagement\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"crossClusterReplication\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"remoteClusters\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"rollup\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"indexManagement\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"ingestManager\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"encryptedSavedObjects\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins","encryptedSavedObjects"],"pid":6,"message":"Stopping plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"enterpriseSearch\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"snapshotRestore\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"reporting\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"security\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins","security"],"pid":6,"message":"Stopping plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"features\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"visTypeTimelion\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins","visTypeTimelion"],"pid":6,"message":"Stopping plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"visTypeTimeseries\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"visTypeVega\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"visTypeVislib\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"visualize\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"visualizations\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"savedObjects\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"dataEnhanced\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"fileUpload\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"advancedSettings\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"indexPatternManagement\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"watcher\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"licenseManagement\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"upgradeAssistant\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"management\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"grokdebugger\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"painlessLab\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"searchprofiler\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"apmOss\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"consoleExtensions\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"console\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"cloud\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"home\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"data\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"expressions\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"bfetch\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"charts\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"esUiShared\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"legacyExport\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"share\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins","share"],"pid":6,"message":"Stopping plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"timelion\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"translations\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"kibanaLegacy\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"mapsLegacy\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"newsfeed\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"kibanaUsageCollection\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"telemetryCollectionXpack\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"telemetry\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"telemetryCollectionManager\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"ossTelemetry\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"usageCollection\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins","usageCollection"],"pid":6,"message":"Stopping plugin"} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"code\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"globalSearchProviders\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"globalSearch\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"observability\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"licensing\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","plugins-system"],"pid":6,"message":"Stopping plugin \"taskManager\"..."} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","elasticsearch-service"],"pid":6,"message":"Stopping elasticsearch service"} {"type":"log","@timestamp":"2020-10-04T08:23:37Z","tags":["debug","http","server","Kibana"],"pid":6,"message":"stopping http server"}

FATAL Error: Setup lifecycle of "monitoring" plugin wasn't completed in 30sec. Consider disabling the plugin and re-start.

MaCoredroid commented 4 years ago

This issue could be closed now. My problem is due to mux. After I set mux to 1430 according to this guide https://docs.projectcalico.org/networking/mtu (Having so issue for Istio so I found this), the Kibana is working! I also installed socat too. So the monitoring plugin failure is due to some networking issues.