Reporting: Internal server error on task manager while generating reports

bhavyarm commented 3 years ago

Kibana version: 7.15.0 (latest 7.X snapshot)

Elasticsearch version: darwin_x86_64

Server OS version: Chrome latest

Browser version: OS X

Browser OS version: snapshots

Original install method (e.g. download page, yum, from source, etc.): snapshots link

Describe the bug:

Please note this is happening on BC1 Kibana/ES without installing any metricbeats.

Please note - there is a related bug in beats - https://github.com/elastic/beats/issues/27036

I tried to install metricbeat dashboards on 7.15.0 latest snapshot and it failed with

./metricbeat setup -E "setup.dashboards.url=https://snapshots.elastic.co/7.15.0-ba42231a/downloads/beats/beats-dashboards/beats-dashboards-7.15.0-SNAPSHOT.zip"
Overwriting ILM policy is disabled. Set `setup.ilm.overwrite: true` for enabling.

Index setup finished.
Loading dashboards (Kibana must be running and reachable)
Exiting: error connecting to Kibana: fail to get the Kibana version: HTTP GET request to http://localhost:5601/api/status fails: <nil>. Response: {"name":"Bhavyas-MacBook-Pro.local","uuid":"2ffea1b6-6bf8-494c-9b76-c7aaaebe3f51","version":{"number":"7.15.0","build_hash":"aa12d107c38c5cda96fc32bcd1f8226df172826a","build_number":43370,"build_snapshot":true},"status":{"overall":{"since":"2021-08-1... (truncated).
bhavyarajumandya@Bhavyas-MacBook-Pro metricbeat-7.15.0-SNAPSHOT-darwin-x86_64 % ./metricbeat setup -E "setup.dashboards.url=https://snapshots.elastic.co/7.15.0-ba42231a/downloads/beats/beats-dashboards/beats-dashboards-7.15.0-SNAPSHOT.zip"
Overwriting ILM policy is disabled. Set `setup.ilm.overwrite: true` for enabling.

This is what I see in kibana logs -internal server error on task manager:

iew)&forceNow=2021-08-16T17%3A17%3A24.908Z }
  log   [13:21:40.394] [info][execute-job][ksewgsh809kr2a7e7d0d79ie][plugins][printablePdf][printable_pdf][reporting][runTask] handled 155 page requests
  log   [13:23:38.215] [error][plugins][reporting][runTask] Error: Max attempts (3) reached for job ksewgsh809kr2a7e7d0d79ie. Failed with: TimeoutError: Timeout has occurred
    at Object.run (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/x-pack/plugins/reporting/server/lib/tasks/execute_report.js:428:58)
    at TaskManagerRunner.run (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/x-pack/plugins/task_manager/server/task_running/task_runner.js:273:22)
 error  [13:39:59.045]  Error: Internal Server Error
    at HapiResponseAdapter.toError (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/src/core/server/http/router/response_adapter.js:128:19)
    at HapiResponseAdapter.toHapiResponse (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/src/core/server/http/router/response_adapter.js:82:19)
    at HapiResponseAdapter.handle (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/src/core/server/http/router/response_adapter.js:73:17)
    at Router.handle (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/src/core/server/http/router/router.js:164:34)
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (internal/process/task_queues.js:95:5)
    at handler (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/src/core/server/http/router/router.js:124:50)
    at exports.Manager.execute (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/node_modules/@hapi/hapi/lib/toolkit.js:60:28)
    at Object.internals.handler (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/node_modules/@hapi/hapi/lib/handler.js:46:20)
    at exports.execute (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/node_modules/@hapi/hapi/lib/handler.js:31:20)
    at Request._lifecycle (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/node_modules/@hapi/hapi/lib/request.js:370:32)
    at Request._execute (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/node_modules/@hapi/hapi/lib/request.js:279:9)
 error  [13:40:40.161]  Error: Internal Server Error
    at HapiResponseAdapter.toError (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/src/core/server/http/router/response_adapter.js:128:19)
    at HapiResponseAdapter.toHapiResponse (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/src/core/server/http/router/response_adapter.js:82:19)
    at HapiResponseAdapter.handle (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/src/core/server/http/router/response_adapter.js:73:17)
    at Router.handle (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/src/core/server/http/router/router.js:164:34)
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (internal/process/task_queues.js:95:5)
    at handler (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/src/core/server/http/router/router.js:124:50)
    at exports.Manager.execute (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/node_modules/@hapi/hapi/lib/toolkit.js:60:28)
    at Object.internals.handler (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/node_modules/@hapi/hapi/lib/handler.js:46:20)
    at exports.execute (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/node_modules/@hapi/hapi/lib/handler.js:31:20)
    at Request._lifecycle (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/node_modules/@hapi/hapi/lib/request.js:370:32)
    at Request._execute (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/node_modules/@hapi/hapi/lib/request.js:279:9)

This is what I see in elasticsearch logs:

[2021-08-16T13:29:37,653][INFO ][o.e.c.m.MetadataIndexTemplateService] [Bhavyas-MacBook-Pro.local] adding template [metricbeat-7.15.0] for index patterns [metricbeat-7.15.0-*]
[2021-08-16T13:37:19,415][INFO ][o.e.c.m.MetadataIndexTemplateService] [Bhavyas-MacBook-Pro.local] adding template [metricbeat-7.15.0] for index patterns [metricbeat-7.15.0-*]
[2021-08-16T13:39:59,050][WARN ][r.suppressed             ] [Bhavyas-MacBook-Pro.local] path: /_security/user/_has_privileges, params: {}
org.elasticsearch.ElasticsearchException: Security must be explicitly enabled when using a [trial] license. Enable security by setting [xpack.security.enabled] to [true] in the elasticsearch.yml file and restart the node.
    at org.elasticsearch.xpack.security.rest.action.SecurityBaseRestHandler.checkFeatureAvailable(SecurityBaseRestHandler.java:72) ~[x-pack-security-7.15.0-SNAPSHOT.jar:7.15.0-SNAPSHOT]
    at org.elasticsearch.xpack.security.rest.action.SecurityBaseRestHandler.prepareRequest(SecurityBaseRestHandler.java:49) [x-pack-security-7.15.0-SNAPSHOT.jar:7.15.0-SNAPSHOT]
    at org.elasticsearch.rest.BaseRestHandler.handleRequest(BaseRestHandler.java:83) [elasticsearch-7.15.0-SNAPSHOT.jar:7.15.0-SNAPSHOT]
    at org.elasticsearch.xpack.security.rest.SecurityRestFilter.handleRequest(SecurityRestFilter.java:98) [x-pack-security-7.15.0-SNAPSHOT.jar:7.15.0-SNAPSHOT]
    at org.elasticsearch.rest.RestController.dispatchRequest(RestController.java:275) [elasticsearch-7.15.0-SNAPSHOT.jar:7.15.0-SNAPSHOT]
    at org.elasticsearch.rest.RestController.tryAllHandlers(RestController.java:343) [elasticsearch-7.15.0-SNAPSHOT.jar:7.15.0-SNAPSHOT]
    at org.elasticsearch.rest.RestController.dispatchRequest(RestController.java:196) [elasticsearch-7.15.0-SNAPSHOT.jar:7.15.0-SNAPSHOT]
    at org.elasticsearch.http.AbstractHttpServerTransport.dispatchRequest(AbstractHttpServerTransport.java:348) [elasticsearch-7.15.0-SNAPSHOT.jar:7.15.0-SNAPSHOT]
    at org.elasticsearch.http.AbstractHttpServerTransport.handleIncomingRequest(AbstractHttpServerTransport.java:413) [elasticsearch-7.15.0-SNAPSHOT.jar:7.15.0-SNAPSHOT]
    at org.elasticsearch.http.AbstractHttpServerTransport.incomingRequest(AbstractHttpServerTransport.java:330) [elasticsearch-7.15.0-SNAPSHOT.jar:7.15.0-SNAPSHOT]
    at org.elasticsearch.http.netty4.Netty4HttpRequestHandler.channelRead0(Netty4HttpRequestHandler.java:31) [transport-netty4-client-7.15.0-SNAPSHOT.jar:7.15.0-SNAPSHOT]
    at org.elasticsearch.http.netty4.Netty4HttpRequestHandler.channelRead0(Netty4HttpRequestHandler.java:17) [transport-netty4-client-7.15.0-SNAPSHOT.jar:7.15.0-SNAPSHOT]
    at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at org.elasticsearch.http.netty4.Netty4HttpPipeliningHandler.channelRead(Netty4HttpPipeliningHandler.java:47) [transport-netty4-client-7.15.0-SNAPSHOT.jar:7.15.0-SNAPSHOT]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.handler.codec.MessageToMessageCodec.channelRead(MessageToMessageCodec.java:111) [netty-codec-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:324) [netty-codec-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:296) [netty-codec-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) [netty-handler-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:719) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:620) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:583) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986) [netty-common-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.66.Final.jar:4.1.66.Final]
    at java.lang.Thread.run(Thread.java:831) [?:?]

This is Kibana status red which bought task manager down and I had a reporting job fail:

curl -k http://localhost:5601/api/status
{"name":"Bhavyas-MacBook-Pro.local","uuid":"2ffea1b6-6bf8-494c-9b76-c7aaaebe3f51","version":{"number":"7.15.0","build_hash":"aa12d107c38c5cda96fc32bcd1f8226df172826a","build_number":43370,"build_snapshot":true},"status":{"overall":{"since":"2021-08-16T17:38:39.090Z","state":"red","title":"Red","nickname":"Danger Will Robinson! Danger!","icon":"danger","uiColor":"danger"},"statuses":[{"id":"core:elasticsearch@7.15.0","message":"Elasticsearch is available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"core:savedObjects@7.15.0","message":"SavedObjects service has completed migrations and is available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:advancedSettings@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:apmOss@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:bfetch@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:charts@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:console@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:dashboard@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:data@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:devTools@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:discover@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:embeddable@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:esUiShared@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:expressionError@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:expressionImage@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:expressionMetric@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:expressionRepeatImage@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:expressionRevealImage@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:expressionShape@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:expressions@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:fieldFormats@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:home@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:indexPatternEditor@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:indexPatternFieldEditor@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:indexPatternManagement@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:inputControlVis@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:inspector@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:kibanaLegacy@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:kibanaOverview@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:kibanaReact@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:kibanaUsageCollection@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:kibanaUtils@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:legacyExport@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:management@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:mapsEms@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:mapsLegacy@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:navigation@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:newsfeed@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:presentationUtil@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:regionMap@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:savedObjects@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:savedObjectsManagement@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:savedObjectsTaggingOss@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:screenshotMode@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:securityOss@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:share@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:spacesOss@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:telemetry@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:telemetryCollectionManager@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:telemetryManagementSection@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:tileMap@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:timelion@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:uiActions@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:urlForwarding@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:usageCollection@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:visDefaultEditor@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:visTypeMarkdown@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:visTypeMetric@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:visTypePie@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:visTypeTable@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:visTypeTagcloud@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:visTypeTimelion@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:visTypeTimeseries@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:visTypeVega@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:visTypeVislib@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:visTypeXy@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:visualizations@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:visualize@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:actions@7.15.0","message":"[3] services are unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:alerting@7.15.0","message":"[4] services are unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:apm@7.15.0","message":"[12] services are unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:banners@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:canvas@7.15.0","message":"[reporting]: [2] services are unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:cases@7.15.0","message":"[3] services are unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:cloud@7.15.0","message":"[security]: [taskManager]: Task Manager is unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:code@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:crossClusterReplication@7.15.0","message":"[2] services are unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:dashboardEnhanced@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:dashboardMode@7.15.0","message":"[security]: [taskManager]: Task Manager is unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:dataEnhanced@7.15.0","message":"[2] services are unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:dataVisualizer@7.15.0","message":"[4] services are unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:discoverEnhanced@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:urlDrilldown@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:embeddableEnhanced@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:encryptedSavedObjects@7.15.0","message":"[security]: [taskManager]: Task Manager is unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:enterpriseSearch@7.15.0","message":"[3] services are unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:eventLog@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:features@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:fileUpload@7.15.0","message":"[security]: [taskManager]: Task Manager is unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:fleet@7.15.0","message":"[3] services are unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:globalSearch@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:globalSearchBar@7.15.0","message":"[savedObjectsTagging]: [security]: [taskManager]: Task Manager is unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:globalSearchProviders@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:graph@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:grokdebugger@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:indexLifecycleManagement@7.15.0","message":"[2] services are unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:indexManagement@7.15.0","message":"[2] services are unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:infra@7.15.0","message":"[6] services are unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:ingestPipelines@7.15.0","message":"[security]: [taskManager]: Task Manager is unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:lens@7.15.0","message":"[2] services are unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:licenseApiGuard@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:licenseManagement@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:licensing@7.15.0","message":"License fetched","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:lists@7.15.0","message":"[security]: [taskManager]: Task Manager is unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:logstash@7.15.0","message":"[2] services are unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:maps@7.15.0","message":"[2] services are unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:ml@7.15.0","message":"[6] services are unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:monitoring@7.15.0","message":"[7] services are unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:observability@7.15.0","message":"[6] services are unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:osquery@7.15.0","message":"[6] services are unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:painlessLab@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:remoteClusters@7.15.0","message":"[2] services are unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:reporting@7.15.0","message":"[2] services are unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:rollup@7.15.0","message":"[indexManagement]: [2] services are unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:ruleRegistry@7.15.0","message":"[3] services are unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:runtimeFields@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:savedObjectsTagging@7.15.0","message":"[security]: [taskManager]: Task Manager is unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:searchprofiler@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:security@7.15.0","message":"[taskManager]: Task Manager is unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:securitySolution@7.15.0","message":"[14] services are unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:snapshotRestore@7.15.0","message":"[2] services are unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:spaces@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:stackAlerts@7.15.0","message":"[2] services are unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:taskManager@7.15.0","message":"Task Manager is unavailable","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:telemetryCollectionXpack@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:timelines@7.15.0","message":"[3] services are unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:transform@7.15.0","message":"[security]: [taskManager]: Task Manager is unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:translations@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:triggersActionsUi@7.15.0","message":"[alerting]: [4] services are unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:uiActionsEnhanced@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:upgradeAssistant@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:uptime@7.15.0","message":"[6] services are unavailable See the status page for more information","since":"2021-08-16T17:38:39.090Z","state":"red","icon":"danger","uiColor":"danger"},{"id":"plugin:watcher@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"},{"id":"plugin:xpackLegacy@7.15.0","message":"All dependencies are available","since":"2021-08-16T17:38:39.090Z","state":"green","icon":"success","uiColor":"secondary"}]},"metrics":{"last_updated":"2021-08-16T17:38:35.121Z","collection_interval_in_millis":5000,"os":{"platform":"darwin","platformRelease":"darwin-20.6.0","load":{"1m":3.63916015625,"5m":3.30029296875,"15m":3.10400390625},"memory":{"total_in_bytes":68719476736,"free_in_bytes":446631936,"used_in_bytes":68272844800},"uptime_in_millis":443406000},"process":{"memory":{"heap":{"total_in_bytes":331706368,"used_in_bytes":260729528,"size_limit":4345298944},"resident_set_size_in_bytes":690331648},"pid":12411,"event_loop_delay":0.3054799437522888,"uptime_in_millis":2183511.758228},"response_times":{"avg_in_millis":0,"max_in_millis":0},"concurrent_connections":6,"requests":{"disconnects":0,"total":0,"statusCodes":{},"status_codes":{}}}}%

Logging this because I can't figure out which part is erroring out - is it reporting, task manager, failed beats dashboard imports?

elasticmachine commented 3 years ago

Pinging @elastic/kibana-alerting-services (Team:Alerting Services)

elasticmachine commented 3 years ago

Pinging @elastic/kibana-reporting-services (Team:Reporting Services)

bhavyarm commented 3 years ago

New kibana logs without doing anything with metricbeat:

log   [12:24:39.907] [info][plugins][reporting][runTask] Saved printable_pdf job /.reporting-2021-08-15/_doc/ksga0cpq0ro62a7e7d54uerf
  log   [12:24:45.534] [info][status] Kibana is now available (was unavailable)
 error  [12:24:54.711]  Error: Internal Server Error
    at HapiResponseAdapter.toError (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/src/core/server/http/router/response_adapter.js:128:19)
    at HapiResponseAdapter.toHapiResponse (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/src/core/server/http/router/response_adapter.js:82:19)
    at HapiResponseAdapter.handle (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/src/core/server/http/router/response_adapter.js:73:17)
    at Router.handle (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/src/core/server/http/router/router.js:164:34)
    at processTicksAndRejections (internal/process/task_queues.js:95:5)
    at handler (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/src/core/server/http/router/router.js:124:50)
    at exports.Manager.execute (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/node_modules/@hapi/hapi/lib/toolkit.js:60:28)
    at Object.internals.handler (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/node_modules/@hapi/hapi/lib/handler.js:46:20)
    at exports.execute (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/node_modules/@hapi/hapi/lib/handler.js:31:20)
    at Request._lifecycle (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/node_modules/@hapi/hapi/lib/request.js:370:32)
    at Request._execute (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/node_modules/@hapi/hapi/lib/request.js:279:9)

ES logs:

 ] [Bhavyas-MacBook-Pro.local] path: /_security/user/_has_privileges, params: {}
org.elasticsearch.ElasticsearchException: Security must be explicitly enabled when using a [trial] license. Enable security by setting [xpack.security.enabled] to [true] in the elasticsearch.yml file and restart the node.
    at org.elasticsearch.xpack.security.rest.action.SecurityBaseRestHandler.checkFeatureAvailable(SecurityBaseRestHandler.java:72) ~[x-pack-security-7.15.0-SNAPSHOT.jar:7.15.0-SNAPSHOT]
    at org.elasticsearch.xpack.security.rest.action.SecurityBaseRestHandler.prepareRequest(SecurityBaseRestHandler.java:49) [x-pack-security-7.15.0-SNAPSHOT.jar:7.15.0-SNAPSHOT]
    at org.elasticsearch.rest.BaseRestHandler.handleRequest(BaseRestHandler.java:83) [elasticsearch-7.15.0-SNAPSHOT.jar:7.15.0-SNAPSHOT]
    at org.elasticsearch.xpack.security.rest.SecurityRestFilter.handleRequest(SecurityRestFilter.java:98) [x-pack-security-7.15.0-SNAPSHOT.jar:7.15.0-SNAPSHOT]
    at org.elasticsearch.rest.RestController.dispatchRequest(RestController.java:275) [elasticsearch-7.15.0-SNAPSHOT.jar:7.15.0-SNAPSHOT]
    at org.elasticsearch.rest.RestController.tryAllHandlers(RestController.java:343) [elasticsearch-7.15.0-SNAPSHOT.jar:7.15.0-SNAPSHOT]
    at org.elasticsearch.rest.RestController.dispatchRequest(RestController.java:196) [elasticsearch-7.15.0-SNAPSHOT.jar:7.15.0-SNAPSHOT]
    at org.elasticsearch.http.AbstractHttpServerTransport.dispatchRequest(AbstractHttpServerTransport.java:348) [elasticsearch-7.15.0-SNAPSHOT.jar:7.15.0-SNAPSHOT]
    at org.elasticsearch.http.AbstractHttpServerTransport.handleIncomingRequest(AbstractHttpServerTransport.java:413) [elasticsearch-7.15.0-SNAPSHOT.jar:7.15.0-SNAPSHOT]
    at org.elasticsearch.http.AbstractHttpServerTransport.incomingRequest(AbstractHttpServerTransport.java:330) [elasticsearch-7.15.0-SNAPSHOT.jar:7.15.0-SNAPSHOT]
    at org.elasticsearch.http.netty4.Netty4HttpRequestHandler.channelRead0(Netty4HttpRequestHandler.java:31) [transport-netty4-client-7.15.0-SNAPSHOT.jar:7.15.0-SNAPSHOT]
    at org.elasticsearch.http.netty4.Netty4HttpRequestHandler.channelRead0(Netty4HttpRequestHandler.java:17) [transport-netty4-client-7.15.0-SNAPSHOT.jar:7.15.0-SNAPSHOT]
    at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at org.elasticsearch.http.netty4.Netty4HttpPipeliningHandler.channelRead(Netty4HttpPipeliningHandler.java:47) [transport-netty4-client-7.15.0-SNAPSHOT.jar:7.15.0-SNAPSHOT]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.handler.codec.MessageToMessageCodec.channelRead(MessageToMessageCodec.java:111) [netty-codec-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:324) [netty-codec-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:296) [netty-codec-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) [netty-handler-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:719) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:620) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:583) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) [netty-transport-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986) [netty-common-4.1.66.Final.jar:4.1.66.Final]
    at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.66.Final.jar:4.1.66.Final]
    at java.lang.Thread.run(Thread.java:831) [?:?]

elasticmachine commented 3 years ago

Pinging @elastic/kibana-app-services (Team:AppServices)

tsullivan commented 3 years ago

@bhavyarm I think this issue is missing some recreation details.

At what point are you sending a request to generate a report?
Is the Kibana server restarting in between any of the steps?
Can you include a full set of Kibana logs that show when Reporting has received the request to generate a report?
Can you enable verbose logging in Kibana?

bhavyarm commented 3 years ago

Please note this is user generated report. Here are my full kibana logs before I stopped it

bin/kibana
  log   [12:03:53.717] [info][plugins-service] Plugin "metricsEntities" is disabled.
  log   [12:03:53.799] [info][server][Preboot][http] http server running at http://localhost:5601
  log   [12:03:53.859] [warning][config][deprecation] plugins.scanDirs is deprecated and is no longer used
  log   [12:03:53.859] [warning][config][deprecation] Config key [monitoring.cluster_alerts.email_notifications.email_address] will be required for email notifications to work in 8.0."
  log   [12:03:53.859] [warning][config][deprecation] "xpack.reporting.roles" is deprecated. Granting reporting privilege through a "reporting_user" role will not be supported starting in 8.0. Please set "xpack.reporting.roles.enabled" to "false" and grant reporting privileges to users using Kibana application privileges **Management > Security > Roles**.
  log   [12:03:53.860] [warning][config][deprecation] Session idle timeout ("xpack.security.session.idleTimeout") will be set to 1 hour by default in the next major version (8.0).
  log   [12:03:53.860] [warning][config][deprecation] Session lifespan ("xpack.security.session.lifespan") will be set to 30 days by default in the next major version (8.0).
  log   [12:03:54.025] [info][plugins-system][standard] Setting up [112] plugins: [translations,licensing,globalSearch,globalSearchProviders,banners,licenseApiGuard,code,usageCollection,xpackLegacy,taskManager,telemetryCollectionManager,telemetryCollectionXpack,kibanaUsageCollection,securityOss,share,screenshotMode,telemetry,newsfeed,mapsEms,mapsLegacy,legacyExport,kibanaLegacy,embeddable,uiActionsEnhanced,fieldFormats,expressions,charts,esUiShared,bfetch,data,savedObjects,visualizations,visTypeXy,visTypeVislib,visTypeTimelion,features,visTypeTagcloud,visTypeTable,visTypePie,visTypeMetric,visTypeMarkdown,tileMap,regionMap,presentationUtil,expressionShape,expressionRevealImage,expressionRepeatImage,expressionMetric,expressionImage,timelion,home,searchprofiler,painlessLab,grokdebugger,graph,visTypeVega,management,watcher,upgradeAssistant,licenseManagement,indexPatternManagement,advancedSettings,discover,discoverEnhanced,dashboard,dashboardEnhanced,visualize,visTypeTimeseries,savedObjectsManagement,spaces,security,transform,savedObjectsTagging,lens,reporting,canvas,lists,ingestPipelines,fileUpload,maps,dataVisualizer,encryptedSavedObjects,dataEnhanced,dashboardMode,cloud,snapshotRestore,fleet,indexManagement,rollup,remoteClusters,crossClusterReplication,indexLifecycleManagement,eventLog,actions,alerting,triggersActionsUi,stackAlerts,ruleRegistry,osquery,ml,cases,timelines,securitySolution,observability,uptime,infra,monitoring,logstash,enterpriseSearch,console,apmOss,apm]
  log   [12:03:55.183] [info][plugins][taskManager] TaskManager is identified by the Kibana UUID: 2ffea1b6-6bf8-494c-9b76-c7aaaebe3f51
  log   [12:04:06.579] [warning][config][plugins][security] Generating a random key for xpack.security.encryptionKey. To prevent sessions from being invalidated on restart, please set xpack.security.encryptionKey in the kibana.yml or use the bin/kibana-encryption-keys command.
  log   [12:04:06.579] [warning][config][plugins][security] Session cookies will be transmitted over insecure connections. This is not recommended.
  log   [12:04:06.616] [warning][config][plugins][reporting] Generating a random key for xpack.reporting.encryptionKey. To prevent sessions from being invalidated on restart, please set xpack.reporting.encryptionKey in the kibana.yml or use the bin/kibana-encryption-keys command.
  log   [12:04:06.629] [info][config][plugins][reporting] Chromium sandbox provides an additional layer of protection, and is supported for Darwin OS. Automatically enabling Chromium sandbox.
  log   [12:04:06.639] [warning][encryptedSavedObjects][plugins] Saved objects encryption key is not set. This will severely limit Kibana functionality. Please set xpack.encryptedSavedObjects.encryptionKey in the kibana.yml or use the bin/kibana-encryption-keys command.
  log   [12:04:06.675] [warning][actions][plugins] APIs are disabled because the Encrypted Saved Objects plugin is missing encryption key. Please set xpack.encryptedSavedObjects.encryptionKey in the kibana.yml or use the bin/kibana-encryption-keys command.
  log   [12:04:06.685] [warning][alerting][plugins] APIs are disabled because the Encrypted Saved Objects plugin is missing encryption key. Please set xpack.encryptedSavedObjects.encryptionKey in the kibana.yml or use the bin/kibana-encryption-keys command.
  log   [12:04:15.986] [info][plugins][ruleRegistry] Write is disabled, not installing assets
  log   [12:04:16.261] [info][savedobjects-service] Waiting until all Elasticsearch nodes are compatible with Kibana before starting saved objects migrations...
  log   [12:04:16.841] [info][savedobjects-service] Starting saved objects migrations
  log   [12:04:17.131] [info][savedobjects-service] [.kibana] INIT -> OUTDATED_DOCUMENTS_SEARCH_OPEN_PIT. took: 63ms.
  log   [12:04:17.139] [info][savedobjects-service] [.kibana] OUTDATED_DOCUMENTS_SEARCH_OPEN_PIT -> OUTDATED_DOCUMENTS_SEARCH_READ. took: 8ms.
  log   [12:04:17.141] [info][savedobjects-service] [.kibana_task_manager] INIT -> OUTDATED_DOCUMENTS_SEARCH_OPEN_PIT. took: 71ms.
  log   [12:04:17.144] [info][savedobjects-service] [.kibana_task_manager] OUTDATED_DOCUMENTS_SEARCH_OPEN_PIT -> OUTDATED_DOCUMENTS_SEARCH_READ. took: 2ms.
  log   [12:04:17.175] [info][savedobjects-service] [.kibana] OUTDATED_DOCUMENTS_SEARCH_READ -> OUTDATED_DOCUMENTS_SEARCH_CLOSE_PIT. took: 36ms.
  log   [12:04:17.179] [info][savedobjects-service] [.kibana_task_manager] OUTDATED_DOCUMENTS_SEARCH_READ -> OUTDATED_DOCUMENTS_SEARCH_CLOSE_PIT. took: 36ms.
  log   [12:04:17.183] [info][savedobjects-service] [.kibana] OUTDATED_DOCUMENTS_SEARCH_CLOSE_PIT -> UPDATE_TARGET_MAPPINGS. took: 8ms.
  log   [12:04:17.185] [info][savedobjects-service] [.kibana_task_manager] OUTDATED_DOCUMENTS_SEARCH_CLOSE_PIT -> UPDATE_TARGET_MAPPINGS. took: 6ms.
  log   [12:04:18.473] [info][savedobjects-service] [.kibana] UPDATE_TARGET_MAPPINGS -> UPDATE_TARGET_MAPPINGS_WAIT_FOR_TASK. took: 1290ms.
  log   [12:04:18.474] [info][savedobjects-service] [.kibana_task_manager] UPDATE_TARGET_MAPPINGS -> UPDATE_TARGET_MAPPINGS_WAIT_FOR_TASK. took: 1289ms.
  log   [12:04:20.023] [info][savedobjects-service] [.kibana_task_manager] UPDATE_TARGET_MAPPINGS_WAIT_FOR_TASK -> DONE. took: 1549ms.
  log   [12:04:20.023] [info][savedobjects-service] [.kibana_task_manager] Migration completed after 2953ms
  log   [12:04:23.744] [info][savedobjects-service] [.kibana] UPDATE_TARGET_MAPPINGS_WAIT_FOR_TASK -> DONE. took: 5271ms.
  log   [12:04:23.744] [info][savedobjects-service] [.kibana] Migration completed after 6676ms
  log   [12:04:23.913] [info][status] Kibana is now unavailable
  log   [12:04:23.913] [info][plugins-system][standard] Starting [112] plugins: [translations,licensing,globalSearch,globalSearchProviders,banners,licenseApiGuard,code,usageCollection,xpackLegacy,taskManager,telemetryCollectionManager,telemetryCollectionXpack,kibanaUsageCollection,securityOss,share,screenshotMode,telemetry,newsfeed,mapsEms,mapsLegacy,legacyExport,kibanaLegacy,embeddable,uiActionsEnhanced,fieldFormats,expressions,charts,esUiShared,bfetch,data,savedObjects,visualizations,visTypeXy,visTypeVislib,visTypeTimelion,features,visTypeTagcloud,visTypeTable,visTypePie,visTypeMetric,visTypeMarkdown,tileMap,regionMap,presentationUtil,expressionShape,expressionRevealImage,expressionRepeatImage,expressionMetric,expressionImage,timelion,home,searchprofiler,painlessLab,grokdebugger,graph,visTypeVega,management,watcher,upgradeAssistant,licenseManagement,indexPatternManagement,advancedSettings,discover,discoverEnhanced,dashboard,dashboardEnhanced,visualize,visTypeTimeseries,savedObjectsManagement,spaces,security,transform,savedObjectsTagging,lens,reporting,canvas,lists,ingestPipelines,fileUpload,maps,dataVisualizer,encryptedSavedObjects,dataEnhanced,dashboardMode,cloud,snapshotRestore,fleet,indexManagement,rollup,remoteClusters,crossClusterReplication,indexLifecycleManagement,eventLog,actions,alerting,triggersActionsUi,stackAlerts,ruleRegistry,osquery,ml,cases,timelines,securitySolution,observability,uptime,infra,monitoring,logstash,enterpriseSearch,console,apmOss,apm]
  log   [12:04:23.965] [info][monitoring][monitoring][plugins] config sourced from: production cluster
  log   [12:04:25.616] [info][server][Kibana][http] http server running at http://localhost:5601
  log   [12:04:25.763] [info][kibana-monitoring][monitoring][monitoring][plugins] Starting monitoring stats collection
  log   [12:04:25.880] [info][plugins][securitySolution] Dependent plugin setup complete - Starting ManifestTask
  log   [12:04:26.226] [info][plugins][reporting] Browser executable: /Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/x-pack/plugins/reporting/chromium/headless_shell-darwin_x64/headless_shell
  log   [12:04:29.950] [info][status] Kibana is now degraded (was unavailable)
  log   [12:04:35.517] [info][status] Kibana is now available (was degraded)
  log   [12:24:18.780] [info][createJob][plugins][printablePdf][reporting] Request uses Space ID: space_c
  log   [12:24:18.918] [info][createJob][plugins][reporting] Scheduled PDF reporting task. Task ID: task:9277fbe0-ff77-11eb-8e0b-5172d43def06. Report ID: ksga0cpq0ro62a7e7d54uerf
  log   [12:24:20.101] [info][execute-job][ksga0cpq0ro62a7e7d54uerf][plugins][printablePdf][printable_pdf][reporting][runTask] Generating request for space: space_c
  log   [12:24:20.102] [info][execute-job][ksga0cpq0ro62a7e7d54uerf][plugins][printablePdf][printable_pdf][reporting][runTask] Request uses Space ID: space_c
  log   [12:24:20.102] [info][execute-job][ksga0cpq0ro62a7e7d54uerf][plugins][printablePdf][printable_pdf][reporting][runTask] Creating UI Settings Client for space: space_c
  log   [12:24:20.131] [info][browser-driver][execute-job][ksga0cpq0ro62a7e7d54uerf][plugins][printablePdf][printable_pdf][reporting][runTask] Creating browser page driver
  log   [12:24:20.735] [info][execute-job][ksga0cpq0ro62a7e7d54uerf][plugins][printablePdf][printable_pdf][reporting][runTask] opening url http://localhost:5601/s/space_c/app/dashboards#/view/7adfa750-4c81-11e8-b3d7-01146121b73d?_g=(filters%3A!())&_a=(description%3A'Analyze%20mock%20flight%20data%20for%20ES-Air%2C%20Logstash%20Airways%2C%20Kibana%20Airlines%20and%20JetBeats'%2Cfilters%3A!()%2CfullScreenMode%3A!f%2Coptions%3A(hidePanelTitles%3A!f%2CuseMargins%3A!t)%2Cpanels%3A!((embeddableConfig%3A(enhancements%3A())%2CgridData%3A(h%3A15%2Ci%3A'4'%2Cw%3A48%2Cx%3A0%2Cy%3A68)%2Cid%3A'571aaf70-4c88-11e8-b3d7-01146121b73d'%2CpanelIndex%3A'4'%2Ctype%3Asearch%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(enhancements%3A())%2CgridData%3A(h%3A9%2Ci%3A'7'%2Cw%3A24%2Cx%3A0%2Cy%3A15)%2Cid%3Abcb63b50-4c89-11e8-b3d7-01146121b73d%2CpanelIndex%3A'7'%2Ctype%3Avisualization%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(enhancements%3A()%2Cvis%3A(colors%3A(Count%3A%231F78C1)%2ClegendOpen%3A!f))%2CgridData%3A(h%3A11%2Ci%3A'10'%2Cw%3A24%2Cx%3A0%2Cy%3A57)%2Cid%3A'9886b410-4c8b-11e8-b3d7-01146121b73d'%2CpanelIndex%3A'10'%2Ctype%3Avisualization%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(enhancements%3A())%2CgridData%3A(h%3A11%2Ci%3A'21'%2Cw%3A12%2Cx%3A36%2Cy%3A57)%2Cid%3A'293b5a30-4c8f-11e8-b3d7-01146121b73d'%2CpanelIndex%3A'21'%2Ctype%3Avisualization%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(enhancements%3A()%2ChiddenLayers%3A!()%2CisLayerTOCOpen%3A!t%2CmapBuffer%3A(maxLat%3A48.9225%2CmaxLon%3A-90%2CminLat%3A21.94305%2CminLon%3A-135)%2CmapCenter%3A(lat%3A34.65823%2Clon%3A-112.44472%2Czoom%3A4.28)%2CopenTOCDetails%3A!())%2CgridData%3A(h%3A22%2Ci%3A'23'%2Cw%3A24%2Cx%3A0%2Cy%3A35)%2Cid%3A'5dd88580-1906-11e9-919b-ffe5949a18d2'%2CpanelIndex%3A'23'%2Ctype%3Amap%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(enhancements%3A())%2CgridData%3A(h%3A22%2Ci%3A'31'%2Cw%3A24%2Cx%3A24%2Cy%3A35)%2Cid%3Aed78a660-53a0-11e8-acbd-0be0ad9d822b%2CpanelIndex%3A'31'%2Ctype%3Avisualization%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(enhancements%3A()%2ChidePanelTitles%3A!t%2CsavedVis%3A(data%3A(aggs%3A!()%2CsearchSource%3A())%2Cdescription%3A''%2Cparams%3A(controls%3A!((fieldName%3AOriginCityName%2Cid%3A'1525098134264'%2CindexPattern%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Clabel%3A'Origin%20City'%2Coptions%3A(multiselect%3A!t%2Corder%3Adesc%2Csize%3A100%2Ctype%3Aterms)%2Cparent%3A''%2Ctype%3Alist)%2C(fieldName%3ADestCityName%2Cid%3A'1525099277699'%2CindexPattern%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Clabel%3A'Destination%20City'%2Coptions%3A(multiselect%3A!t%2Corder%3Adesc%2Csize%3A100%2Ctype%3Aterms)%2Cparent%3A'1525098134264'%2Ctype%3Alist)%2C(fieldName%3AAvgTicketPrice%2Cid%3A'1525099307278'%2CindexPattern%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Clabel%3A'Average%20Ticket%20Price'%2Coptions%3A(decimalPlaces%3A0%2Cstep%3A10)%2Cparent%3A''%2Ctype%3Arange))%2CpinFilters%3A!f%2CupdateFiltersOnChange%3A!f%2CuseTimeFilter%3A!t)%2Ctitle%3A'%5BFlights%5D%20Controls'%2Ctype%3Ainput_control_vis%2CuiState%3A()))%2CgridData%3A(h%3A7%2Ci%3Aaa810aa2-29c9-4a75-b39e-f4f267de1732%2Cw%3A32%2Cx%3A0%2Cy%3A0)%2CpanelIndex%3Aaa810aa2-29c9-4a75-b39e-f4f267de1732%2Ctype%3Avisualization%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(enhancements%3A()%2ChidePanelTitles%3A!t%2CsavedVis%3A(data%3A(aggs%3A!()%2CsearchSource%3A())%2Cdescription%3A''%2Cparams%3A(fontSize%3A10%2Cmarkdown%3A'%23%23%23%20Sample%20Flight%20data%0AThis%20dashboard%20contains%20sample%20data%20for%20you%20to%20play%20with.%20You%20can%20view%20it%2C%20search%20it%2C%20and%20interact%20with%20the%20visualizations.%20For%20more%20information%20about%20Kibana%2C%20check%20our%20%5Bdocs%5D(https%3A%2F%2Fwww.elastic.co%2Fguide%2Fen%2Fkibana%2Fcurrent%2Findex.html).'%2CopenLinksInNewTab%3A!t)%2Ctitle%3A'%5BFlights%5D%20Markdown%20Instructions'%2Ctype%3Amarkdown%2CuiState%3A()))%2CgridData%3A(h%3A7%2Ci%3A'6afc61f7-e2d5-45a3-9e7a-281160ad3eb9'%2Cw%3A16%2Cx%3A32%2Cy%3A0)%2CpanelIndex%3A'6afc61f7-e2d5-45a3-9e7a-281160ad3eb9'%2Ctype%3Avisualization%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(attributes%3A(references%3A!((id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-current-indexpattern%2Ctype%3Aindex-pattern)%2C(id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-layer-03c34665-471c-49c7-acf1-5a11f517421c%2Ctype%3Aindex-pattern))%2Cstate%3A(datasourceStates%3A(indexpattern%3A(layers%3A('03c34665-471c-49c7-acf1-5a11f517421c'%3A(columnOrder%3A!(a5b94e30-4e77-4b0a-9187-1d8b13de1456%2C'3e267327-7317-4310-aee3-320e0f7c1e70')%2Ccolumns%3A('3e267327-7317-4310-aee3-320e0f7c1e70'%3A(dataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Count%20of%20records'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords)%2Ca5b94e30-4e77-4b0a-9187-1d8b13de1456%3A(dataType%3Adate%2CisBucketed%3A!t%2Clabel%3Atimestamp%2CoperationType%3Adate_histogram%2Cparams%3A(interval%3Aauto)%2Cscale%3Ainterval%2CsourceField%3Atimestamp))%2CincompleteColumns%3A()))))%2Cfilters%3A!()%2Cquery%3A(language%3Akuery%2Cquery%3A'')%2Cvisualization%3A(axisTitlesVisibilitySettings%3A(x%3A!f%2CyLeft%3A!f%2CyRight%3A!t)%2CfittingFunction%3ANone%2CgridlinesVisibilitySettings%3A(x%3A!t%2CyLeft%3A!t%2CyRight%3A!t)%2Clayers%3A!((accessors%3A!('3e267327-7317-4310-aee3-320e0f7c1e70')%2ClayerId%3A'03c34665-471c-49c7-acf1-5a11f517421c'%2Cposition%3Atop%2CseriesType%3Abar_stacked%2CshowGridlines%3A!f%2CxAccessor%3Aa5b94e30-4e77-4b0a-9187-1d8b13de1456))%2Clegend%3A(isVisible%3A!t%2Cposition%3Aright)%2CpreferredSeriesType%3Abar_stacked%2CtickLabelsVisibilitySettings%3A(x%3A!t%2CyLeft%3A!t%2CyRight%3A!t)%2CvalueLabels%3Ahide%2CyLeftExtent%3A(mode%3Afull)%2CyRightExtent%3A(lowerBound%3A0%2Cmode%3Acustom%2CupperBound%3A1)))%2Ctitle%3A''%2Ctype%3Alens%2CvisualizationType%3AlnsXY)%2Cenhancements%3A()%2ChidePanelTitles%3A!f)%2CgridData%3A(h%3A8%2Ci%3A'086ac2e9-dd16-4b45-92b8-1e43ff7e3f65'%2Cw%3A24%2Cx%3A0%2Cy%3A7)%2CpanelIndex%3A'086ac2e9-dd16-4b45-92b8-1e43ff7e3f65'%2Ctitle%3A'%5BFlights%5D%20Flight%20count'%2Ctype%3Alens%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(attributes%3A(description%3A''%2Creferences%3A!((id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-current-indexpattern%2Ctype%3Aindex-pattern)%2C(id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-layer-8fa993db-c147-4954-adf7-4ff264d42576%2Ctype%3Aindex-pattern))%2Cstate%3A(datasourceStates%3A(indexpattern%3A(layers%3A('8fa993db-c147-4954-adf7-4ff264d42576'%3A(columnOrder%3A!('81124c45-6ab6-42f4-8859-495d55eb8065')%2Ccolumns%3A('81124c45-6ab6-42f4-8859-495d55eb8065'%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Total%20flights'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords))%2CincompleteColumns%3A()))))%2Cfilters%3A!()%2Cquery%3A(language%3Akuery%2Cquery%3A'')%2Cvisualization%3A(accessor%3A'81124c45-6ab6-42f4-8859-495d55eb8065'%2ClayerId%3A'8fa993db-c147-4954-adf7-4ff264d42576'))%2Ctitle%3A'%5BFlights%5D%20Total%20Flights'%2CvisualizationType%3AlnsMetric)%2Cenhancements%3A()%2ChidePanelTitles%3A!t)%2CgridData%3A(h%3A8%2Ci%3A'392b4936-f753-47bc-a98d-a4e41a0a4cd4'%2Cw%3A8%2Cx%3A24%2Cy%3A7)%2CpanelIndex%3A'392b4936-f753-47bc-a98d-a4e41a0a4cd4'%2Ctype%3Alens%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(attributes%3A(references%3A!((id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-current-indexpattern%2Ctype%3Aindex-pattern)%2C(id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-layer-b4712d43-1e84-4f5b-878d-8e38ba748317%2Ctype%3Aindex-pattern))%2Cstate%3A(datasourceStates%3A(indexpattern%3A(layers%3A(b4712d43-1e84-4f5b-878d-8e38ba748317%3A(columnOrder%3A!('7e8fe9b1-f45c-4f3d-9561-30febcd357ec'%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX0'%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX1'%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX2')%2Ccolumns%3A('7e8fe9b1-f45c-4f3d-9561-30febcd357ec'%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3ADelayed%2CoperationType%3Aformula%2Cparams%3A(format%3A(id%3Apercent%2Cparams%3A(decimals%3A1))%2Cformula%3A'count(kql%3D!'FlightDelay%20%3A%20true!')%20%2F%20count()'%2CisFormulaBroken%3A!f)%2Creferences%3A!('7e8fe9b1-f45c-4f3d-9561-30febcd357ecX2')%2Cscale%3Aratio)%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX0'%3A(customLabel%3A!t%2CdataType%3Anumber%2Cfilter%3A(language%3Akuery%2Cquery%3A'FlightDelay%20%3A%20true')%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20count(kql%3D!'FlightDelay%20%3A%20true!')%20%2F%20count()'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords)%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX1'%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20count(kql%3D!'FlightDelay%20%3A%20true!')%20%2F%20count()'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords)%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX2'%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20count(kql%3D!'FlightDelay%20%3A%20true!')%20%2F%20count()'%2CoperationType%3Amath%2Cparams%3A(tinymathAst%3A(args%3A!('7e8fe9b1-f45c-4f3d-9561-30febcd357ecX0'%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX1')%2Clocation%3A(max%3A41%2Cmin%3A0)%2Cname%3Adivide%2Ctext%3A'count(kql%3D!'FlightDelay%20%3A%20true!')%20%2F%20count()'%2Ctype%3Afunction))%2Creferences%3A!('7e8fe9b1-f45c-4f3d-9561-30febcd357ecX0'%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX1')%2Cscale%3Aratio))%2CincompleteColumns%3A()))))%2Cfilters%3A!()%2Cquery%3A(language%3Akuery%2Cquery%3A'')%2Cvisualization%3A(accessor%3A'7e8fe9b1-f45c-4f3d-9561-30febcd357ec'%2ClayerId%3Ab4712d43-1e84-4f5b-878d-8e38ba748317))%2Ctitle%3A''%2Ctype%3Alens%2CvisualizationType%3AlnsMetric)%2Cenhancements%3A())%2CgridData%3A(h%3A4%2Ci%3A'9271deff-5a61-4665-83fc-f9fdc6bf0c0b'%2Cw%3A8%2Cx%3A32%2Cy%3A7)%2CpanelIndex%3A'9271deff-5a61-4665-83fc-f9fdc6bf0c0b'%2Ctype%3Alens%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(attributes%3A(references%3A!((id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-current-indexpattern%2Ctype%3Aindex-pattern)%2C(id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-layer-b4712d43-1e84-4f5b-878d-8e38ba748317%2Ctype%3Aindex-pattern)%2C(id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Afilter-index-pattern-0%2Ctype%3Aindex-pattern))%2Cstate%3A(datasourceStates%3A(indexpattern%3A(layers%3A(b4712d43-1e84-4f5b-878d-8e38ba748317%3A(columnOrder%3A!(c7851241-5526-499a-960b-357af8c2ce5b%2Cc7851241-5526-499a-960b-357af8c2ce5bX2%2Cc7851241-5526-499a-960b-357af8c2ce5bX0%2Cc7851241-5526-499a-960b-357af8c2ce5bX1)%2Ccolumns%3A(c7851241-5526-499a-960b-357af8c2ce5b%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Delayed%20vs%201%20week%20earlier'%2CoperationType%3Aformula%2Cparams%3A(format%3A(id%3Apercent%2Cparams%3A(decimals%3A1))%2Cformula%3A'count()%20%2F%20count(shift%3D!'1w!')%20-%201'%2CisFormulaBroken%3A!f)%2Creferences%3A!(c7851241-5526-499a-960b-357af8c2ce5bX2)%2Cscale%3Aratio)%2Cc7851241-5526-499a-960b-357af8c2ce5bX0%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20Delayed'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords)%2Cc7851241-5526-499a-960b-357af8c2ce5bX1%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20Delayed'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords%2CtimeShift%3A'1w')%2Cc7851241-5526-499a-960b-357af8c2ce5bX2%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20Delayed'%2CoperationType%3Amath%2Cparams%3A(tinymathAst%3A(args%3A!((args%3A!(c7851241-5526-499a-960b-357af8c2ce5bX0%2Cc7851241-5526-499a-960b-357af8c2ce5bX1)%2Clocation%3A(max%3A28%2Cmin%3A0)%2Cname%3Adivide%2Ctext%3A'count()%20%2F%20count(shift%3D!'1w!')%20'%2Ctype%3Afunction)%2C1)%2Clocation%3A(max%3A31%2Cmin%3A0)%2Cname%3Asubtract%2Ctext%3A'count()%20%2F%20count(shift%3D!'1w!')%20-%201'%2Ctype%3Afunction))%2Creferences%3A!(c7851241-5526-499a-960b-357af8c2ce5bX0%2Cc7851241-5526-499a-960b-357af8c2ce5bX1)%2Cscale%3Aratio))%2CincompleteColumns%3A()))))%2Cfilters%3A!(('%24state'%3A(store%3AappState)%2Cmeta%3A(alias%3A!n%2Cdisabled%3A!f%2CindexRefName%3Afilter-index-pattern-0%2Ckey%3AFlightDelay%2Cnegate%3A!f%2Cparams%3A(query%3A!t)%2Ctype%3Aphrase)%2Cquery%3A(match_phrase%3A(FlightDelay%3A!t))))%2Cquery%3A(language%3Akuery%2Cquery%3A'')%2Cvisualization%3A(accessor%3Ac7851241-5526-499a-960b-357af8c2ce5b%2ClayerId%3Ab4712d43-1e84-4f5b-878d-8e38ba748317))%2Ctitle%3A''%2Ctype%3Alens%2CvisualizationType%3AlnsMetric)%2Cenhancements%3A())%2CgridData%3A(h%3A4%2Ci%3Aaa591c29-1a31-4ee1-a71d-b829c06fd162%2Cw%3A8%2Cx%3A40%2Cy%3A7)%2CpanelIndex%3Aaa591c29-1a31-4ee1-a71d-b829c06fd162%2Ctype%3Alens%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(attributes%3A(references%3A!((id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-current-indexpattern%2Ctype%3Aindex-pattern)%2C(id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-layer-b4712d43-1e84-4f5b-878d-8e38ba748317%2Ctype%3Aindex-pattern))%2Cstate%3A(datasourceStates%3A(indexpattern%3A(layers%3A(b4712d43-1e84-4f5b-878d-8e38ba748317%3A(columnOrder%3A!('7e8fe9b1-f45c-4f3d-9561-30febcd357ec'%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX0'%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX1'%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX2')%2Ccolumns%3A('7e8fe9b1-f45c-4f3d-9561-30febcd357ec'%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3ACancelled%2CoperationType%3Aformula%2Cparams%3A(format%3A(id%3Apercent%2Cparams%3A(decimals%3A1))%2Cformula%3A'count(kql%3D!'Cancelled%20%3A%20true!')%20%2F%20count()'%2CisFormulaBroken%3A!f)%2Creferences%3A!('7e8fe9b1-f45c-4f3d-9561-30febcd357ecX2')%2Cscale%3Aratio)%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX0'%3A(customLabel%3A!t%2CdataType%3Anumber%2Cfilter%3A(language%3Akuery%2Cquery%3A'Cancelled%20%3A%20true')%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20Cancelled'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords)%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX1'%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20Cancelled'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords)%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX2'%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20Cancelled'%2CoperationType%3Amath%2Cparams%3A(tinymathAst%3A(args%3A!('7e8fe9b1-f45c-4f3d-9561-30febcd357ecX0'%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX1')%2Clocation%3A(max%3A39%2Cmin%3A0)%2Cname%3Adivide%2Ctext%3A'count(kql%3D!'Cancelled%20%3A%20true!')%20%2F%20count()'%2Ctype%3Afunction))%2Creferences%3A!('7e8fe9b1-f45c-4f3d-9561-30febcd357ecX0'%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX1')%2Cscale%3Aratio))%2CincompleteColumns%3A()))))%2Cfilters%3A!()%2Cquery%3A(language%3Akuery%2Cquery%3A'')%2Cvisualization%3A(accessor%3A'7e8fe9b1-f45c-4f3d-9561-30febcd357ec'%2ClayerId%3Ab4712d43-1e84-4f5b-878d-8e38ba748317))%2Ctitle%3A''%2Ctype%3Alens%2CvisualizationType%3AlnsMetric)%2Cenhancements%3A())%2CgridData%3A(h%3A4%2Ci%3Ab766e3b8-4544-46ed-99e6-9ecc4847e2a2%2Cw%3A8%2Cx%3A32%2Cy%3A11)%2CpanelIndex%3Ab766e3b8-4544-46ed-99e6-9ecc4847e2a2%2Ctype%3Alens%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(attributes%3A(references%3A!((id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-current-indexpattern%2Ctype%3Aindex-pattern)%2C(id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-layer-b4712d43-1e84-4f5b-878d-8e38ba748317%2Ctype%3Aindex-pattern)%2C(id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Afilter-index-pattern-0%2Ctype%3Aindex-pattern))%2Cstate%3A(datasourceStates%3A(indexpattern%3A(layers%3A(b4712d43-1e84-4f5b-878d-8e38ba748317%3A(columnOrder%3A!(c7851241-5526-499a-960b-357af8c2ce5b%2Cc7851241-5526-499a-960b-357af8c2ce5bX2%2Cc7851241-5526-499a-960b-357af8c2ce5bX0%2Cc7851241-5526-499a-960b-357af8c2ce5bX1)%2Ccolumns%3A(c7851241-5526-499a-960b-357af8c2ce5b%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Cancelled%20vs%201%20week%20earlier'%2CoperationType%3Aformula%2Cparams%3A(format%3A(id%3Apercent%2Cparams%3A(decimals%3A1))%2Cformula%3A'count()%20%2F%20count(shift%3D!'1w!')%20-%201'%2CisFormulaBroken%3A!f)%2Creferences%3A!(c7851241-5526-499a-960b-357af8c2ce5bX2)%2Cscale%3Aratio)%2Cc7851241-5526-499a-960b-357af8c2ce5bX0%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20Delayed%20vs%201%20week%20earlier'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords)%2Cc7851241-5526-499a-960b-357af8c2ce5bX1%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20Delayed%20vs%201%20week%20earlier'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords%2CtimeShift%3A'1w')%2Cc7851241-5526-499a-960b-357af8c2ce5bX2%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20Delayed%20vs%201%20week%20earlier'%2CoperationType%3Amath%2Cparams%3A(tinymathAst%3A(args%3A!((args%3A!(c7851241-5526-499a-960b-357af8c2ce5bX0%2Cc7851241-5526-499a-960b-357af8c2ce5bX1)%2Clocation%3A(max%3A28%2Cmin%3A0)%2Cname%3Adivide%2Ctext%3A'count()%20%2F%20count(shift%3D!'1w!')%20'%2Ctype%3Afunction)%2C1)%2Clocation%3A(max%3A31%2Cmin%3A0)%2Cname%3Asubtract%2Ctext%3A'count()%20%2F%20count(shift%3D!'1w!')%20-%201'%2Ctype%3Afunction))%2Creferences%3A!(c7851241-5526-499a-960b-357af8c2ce5bX0%2Cc7851241-5526-499a-960b-357af8c2ce5bX1)%2Cscale%3Aratio))%2CincompleteColumns%3A()))))%2Cfilters%3A!(('%24state'%3A(store%3AappState)%2Cmeta%3A(alias%3A!n%2Cdisabled%3A!f%2CindexRefName%3Afilter-index-pattern-0%2Ckey%3ACancelled%2Cnegate%3A!f%2Cparams%3A(query%3A!t)%2Ctype%3Aphrase)%2Cquery%3A(match_phrase%3A(Cancelled%3A!t))))%2Cquery%3A(language%3Akuery%2Cquery%3A'')%2Cvisualization%3A(accessor%3Ac7851241-5526-499a-960b-357af8c2ce5b%2ClayerId%3Ab4712d43-1e84-4f5b-878d-8e38ba748317))%2Ctitle%3A''%2Ctype%3Alens%2CvisualizationType%3AlnsMetric)%2Cenhancements%3A())%2CgridData%3A(h%3A4%2Ci%3A'2e33ade5-96e5-40b4-b460-493e5d4fa834'%2Cw%3A8%2Cx%3A40%2Cy%3A11)%2CpanelIndex%3A'2e33ade5-96e5-40b4-b460-493e5d4fa834'%2Ctype%3Alens%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(attributes%3A(references%3A!((id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-current-indexpattern%2Ctype%3Aindex-pattern)%2C(id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-layer-f26e8f7a-4118-4227-bea0-5c02d8b270f7%2Ctype%3Aindex-pattern))%2Cstate%3A(datasourceStates%3A(indexpattern%3A(layers%3A(f26e8f7a-4118-4227-bea0-5c02d8b270f7%3A(columnOrder%3A!('3dd24cb4-45ef-4dd8-b22a-d7b802cb6da0'%2C'52f6f2e9-6242-4c44-be63-b799150e7e60'%2C'52f6f2e9-6242-4c44-be63-b799150e7e60X0'%2C'52f6f2e9-6242-4c44-be63-b799150e7e60X1'%2C'52f6f2e9-6242-4c44-be63-b799150e7e60X2'%2C'7b9f3ece-9da3-4c27-b582-d3f8e8cc31d6X0'%2C'7b9f3ece-9da3-4c27-b582-d3f8e8cc31d6X1'%2C'7b9f3ece-9da3-4c27-b582-d3f8e8cc31d6X2'%2C'7b9f3ece-9da3-4c27-b582-d3f8e8cc31d6')%2Ccolumns%3A('3dd24cb4-45ef-4dd8-b22a-d7b802cb6da0'%3A(dataType%3Astring%2CisBucketed%3A!t%2Clabel%3A'Top%20values%20of%20OriginCityName'%2CoperationType%3Aterms%2Cparams%3A(missingBucket%3A!f%2CorderBy%3A(fallback%3A!t%2Ctype%3Aalphabetical)%2CorderDirection%3Aasc%2CotherBucket%3A!t%2Csize%3A1000)%2Cscale%3Aordinal%2CsourceField%3AOriginCityName)%2C'52f6f2e9-6242-4c44-be63-b799150e7e60'%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Delay%20%25'%2CoperationType%3Aformula%2Cparams%3A(format%3A(id%3Apercent%2Cparams%3A(decimals%3A0))%2Cformula%3A'count(kql%3D!'FlightDelay%20%3A%20true%20!')%20%2F%20count()'%2CisFormulaBroken%3A!f)%2Creferences%3A!('52f6f2e9-6242-4c44-be63-b799150e7e60X2')%2Cscale%3Aratio)%2C'52f6f2e9-6242-4c44-be63-b799150e7e60X0'%3A(customLabel%3A!t%2CdataType%3Anumber%2Cfilter%3A(language%3Akuery%2Cquery%3A'FlightDelay%20%3A%20true%20')%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20Delay%20%25'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords)%2C'52f6f2e9-6242-4c44-be63-b799150e7e60X1'%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20Delay%20%25'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords)%2C'52f6f2e9-6242-4c44-be63-b799150e7e60X2'%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20Delay%20%25'%2CoperationType%3Amath%2Cparams%3A(tinymathAst%3A(args%3A!('52f6f2e9-6242-4c44-be63-b799150e7e60X0'%2C'52f6f2e9-6242-4c44-be63-b799150e7e60X1')%2Clocation%3A(max%3A42%2Cmin%3A0)%2Cname%3Adivide%2Ctext%3A'count(kql%3D!'FlightDelay%20%3A%20true%20!')%20%2F%20count()'%2Ctype%3Afunction))%2Creferences%3A!('52f6f2e9-6242-4c44-be63-b799150e7e60X0'%2C'52f6f2e9-6242-4c44-be63-b799150e7e60X1')%2Cscale%3Aratio)%2C'7b9f3ece-9da3-4c27-b582-d3f8e8cc31d6'%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Cancel%20%25'%2CoperationType%3Aformula%2Cparams%3A(format%3A(id%3Apercent%2Cparams%3A(decimals%3A0))%2Cformula%3A'count(kql%3D!'Cancelled%3A%20true!')%20%2F%20count()'%2CisFormulaBroken%3A!f)%2Creferences%3A!('7b9f3ece-9da3-4c27-b582-d3f8e8cc31d6X2')%2Cscale%3Aratio)%2C'7b9f3ece-9da3-4c27-b582-d3f8e8cc31d6X0'%3A(customLabel%3A!t%2CdataType%3Anumber%2Cfilter%3A(language%3Akuery%2Cquery%3A'Cancelled%3A%20true')%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20Cancel%20%25'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords)%2C'7b9f3ece-9da3-4c27-b582-d3f8e8cc31d6X1'%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20Cancel%20%25'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords)%2C'7b9f3ece-9da3-4c27-b582-d3f8e8cc31d6X2'%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20Cancel%20%25'%2CoperationType%3Amath%2Cparams%3A(tinymathAst%3A(args%3A!('7b9f3ece-9da3-4c27-b582-d3f8e8cc31d6X0'%2C'7b9f3ece-9da3-4c27-b582-d3f8e8cc31d6X1')%2Clocation%3A(max%3A38%2Cmin%3A0)%2Cname%3Adivide%2Ctext%3A'count(kql%3D!'Cancelled%3A%20true!')%20%2F%20count()'%2Ctype%3Afunction))%2Creferences%3A!('7b9f3ece-9da3-4c27-b582-d3f8e8cc31d6X0'%2C'7b9f3ece-9da3-4c27-b582-d3f8e8cc31d6X1')%2Cscale%3Aratio))%2CincompleteColumns%3A()))))%2Cfilters%3A!()%2Cquery%3A(language%3Akuery%2Cquery%3A'')%2Cvisualization%3A(columns%3A!((columnId%3A'3dd24cb4-45ef-4dd8-b22a-d7b802cb6da0'%2CisTransposed%3A!f%2Cwidth%3A262.75)%2C(alignment%3Acenter%2CcolorMode%3Acell%2CcolumnId%3A'52f6f2e9-6242-4c44-be63-b799150e7e60'%2CisTransposed%3A!f%2Cpalette%3A(name%3Acustom%2Cparams%3A(colorStops%3A!((color%3A%23f7e0b8%2Cstop%3A0.2)%2C(color%3A%23e7664c%2Cstop%3A0.6))%2Cname%3Acustom%2CrangeMax%3A0.6%2CrangeMin%3A0.2%2CrangeType%3Anumber%2Csteps%3A5%2Cstops%3A!((color%3A%23f7e0b8%2Cstop%3A0.6)%2C(color%3A%23e7664c%2Cstop%3A1)))%2Ctype%3Apalette)%2Cwidth%3A302.5)%2C(alignment%3Acenter%2CcolorMode%3Acell%2CcolumnId%3A'7b9f3ece-9da3-4c27-b582-d3f8e8cc31d6'%2CisTransposed%3A!f%2Cpalette%3A(name%3Acustom%2Cparams%3A(colorStops%3A!((color%3A%23f7e0b8%2Cstop%3A0.2)%2C(color%3A%23e7664c%2Cstop%3A0.6))%2Cname%3Acustom%2CrangeMax%3A0.6%2CrangeMin%3A0.2%2CrangeType%3Anumber%2Csteps%3A5%2Cstops%3A!((color%3A%23f7e0b8%2Cstop%3A0.6)%2C(color%3A%23e7664c%2Cstop%3A0.6666666666666666)))%2Ctype%3Apalette)))%2ClayerId%3Af26e8f7a-4118-4227-bea0-5c02d8b270f7%2Csorting%3A(columnId%3A'52f6f2e9-6242-4c44-be63-b799150e7e60'%2Cdirection%3Adesc)))%2Ctitle%3A'Cities%20by%20delay%2C%20cancellation'%2Ctype%3Alens%2CvisualizationType%3AlnsDatatable)%2Cenhancements%3A()%2ChidePanelTitles%3A!f)%2CgridData%3A(h%3A20%2Ci%3Afb86b32f-fb7a-45cf-9511-f366fef51bbd%2Cw%3A24%2Cx%3A24%2Cy%3A15)%2CpanelIndex%3Afb86b32f-fb7a-45cf-9511-f366fef51bbd%2Ctitle%3A'%5BFlights%5D%20Most%20delayed%20cities'%2Ctype%3Alens%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(attributes%3A(references%3A!((id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-current-indexpattern%2Ctype%3Aindex-pattern)%2C(id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-layer-e80cc05e-c52a-4e5f-ac71-4b37274867f5%2Ctype%3Aindex-pattern))%2Cstate%3A(datasourceStates%3A(indexpattern%3A(layers%3A(e80cc05e-c52a-4e5f-ac71-4b37274867f5%3A(columnOrder%3A!(caf7421e-93a3-439e-ab0a-fbdead93c21c%2C'13ec79e3-9d73-4536-9056-3d92802bb30a'%2C'0233d302-ec81-4fbe-96cb-7fac84cf035c')%2Ccolumns%3A('0233d302-ec81-4fbe-96cb-7fac84cf035c'%3A(dataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Count%20of%20records'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords)%2C'13ec79e3-9d73-4536-9056-3d92802bb30a'%3A(dataType%3Adate%2CisBucketed%3A!t%2Clabel%3Atimestamp%2CoperationType%3Adate_histogram%2Cparams%3A(interval%3Aauto)%2Cscale%3Ainterval%2CsourceField%3Atimestamp)%2Ccaf7421e-93a3-439e-ab0a-fbdead93c21c%3A(dataType%3Astring%2CisBucketed%3A!t%2Clabel%3A'Top%20values%20of%20FlightDelayType'%2CoperationType%3Aterms%2Cparams%3A(missingBucket%3A!f%2CorderBy%3A(columnId%3A'0233d302-ec81-4fbe-96cb-7fac84cf035c'%2Ctype%3Acolumn)%2CorderDirection%3Adesc%2CotherBucket%3A!t%2Csize%3A10)%2Cscale%3Aordinal%2CsourceField%3AFlightDelayType))%2CincompleteColumns%3A()))))%2Cfilters%3A!()%2Cquery%3A(language%3Akuery%2Cquery%3A'')%2Cvisualization%3A(axisTitlesVisibilitySettings%3A(x%3A!t%2CyLeft%3A!f%2CyRight%3A!t)%2CfittingFunction%3ANone%2CgridlinesVisibilitySettings%3A(x%3A!t%2CyLeft%3A!t%2CyRight%3A!t)%2Clayers%3A!((accessors%3A!('0233d302-ec81-4fbe-96cb-7fac84cf035c')%2ClayerId%3Ae80cc05e-c52a-4e5f-ac71-4b37274867f5%2Cpalette%3A(name%3Acool%2Ctype%3Apalette)%2Cposition%3Atop%2CseriesType%3Abar_percentage_stacked%2CshowGridlines%3A!f%2CsplitAccessor%3Acaf7421e-93a3-439e-ab0a-fbdead93c21c%2CxAccessor%3A'13ec79e3-9d73-4536-9056-3d92802bb30a'))%2Clegend%3A(isVisible%3A!t%2Cposition%3Abottom)%2CpreferredSeriesType%3Abar_percentage_stacked%2CtickLabelsVisibilitySettings%3A(x%3A!t%2CyLeft%3A!t%2CyRight%3A!t)%2CvalueLabels%3Ahide%2CyLeftExtent%3A(mode%3Afull)%2CyRightExtent%3A(mode%3Afull)))%2Ctitle%3A''%2Ctype%3Alens%2CvisualizationType%3AlnsXY)%2Cenhancements%3A()%2ChidePanelTitles%3A!f)%2CgridData%3A(h%3A11%2Ci%3A'0cc42484-16f7-42ec-b38c-9bf8be69cde7'%2Cw%3A24%2Cx%3A0%2Cy%3A24)%2CpanelIndex%3A'0cc42484-16f7-42ec-b38c-9bf8be69cde7'%2Ctitle%3A'%5BFlights%5D%20Delay%20Type'%2Ctype%3Alens%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(attributes%3A(references%3A!((id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-current-indexpattern%2Ctype%3Aindex-pattern)%2C(id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-layer-0c8e136b-a822-4fb3-836d-e06cbea4eea4%2Ctype%3Aindex-pattern)%2C(id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Afilter-index-pattern-0%2Ctype%3Aindex-pattern))%2Cstate%3A(datasourceStates%3A(indexpattern%3A(layers%3A('0c8e136b-a822-4fb3-836d-e06cbea4eea4'%3A(columnOrder%3A!(d1cee8bf-34cf-4141-99d7-ff043ee77b56%2Caa152ace-ee2d-447b-b86d-459bef4d7880)%2Ccolumns%3A(aa152ace-ee2d-447b-b86d-459bef4d7880%3A(dataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Count%20of%20records'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords)%2Cd1cee8bf-34cf-4141-99d7-ff043ee77b56%3A(dataType%3Astring%2CisBucketed%3A!t%2Clabel%3A'Top%20values%20of%20FlightDelayType'%2CoperationType%3Aterms%2Cparams%3A(missingBucket%3A!f%2CorderBy%3A(columnId%3Aaa152ace-ee2d-447b-b86d-459bef4d7880%2Ctype%3Acolumn)%2CorderDirection%3Adesc%2CotherBucket%3A!t%2Csize%3A10)%2Cscale%3Aordinal%2CsourceField%3AFlightDelayType))%2CincompleteColumns%3A()))))%2Cfilters%3A!(('%24state'%3A(store%3AappState)%2Cmeta%3A(alias%3A!n%2Cdisabled%3A!f%2CindexRefName%3Afilter-index-pattern-0%2Ckey%3AFlightDelayType%2Cnegate%3A!t%2Cparams%3A(query%3A'No%20Delay')%2Ctype%3Aphrase)%2Cquery%3A(match_phrase%3A(FlightDelayType%3A'No%20Delay'))))%2Cquery%3A(language%3Akuery%2Cquery%3A'')%2Cvisualization%3A(layers%3A!((categoryDisplay%3Adefault%2Cgroups%3A!(d1cee8bf-34cf-4141-99d7-ff043ee77b56)%2ClayerId%3A'0c8e136b-a822-4fb3-836d-e06cbea4eea4'%2ClegendDisplay%3Adefault%2Cmetric%3Aaa152ace-ee2d-447b-b86d-459bef4d7880%2CnestedLegend%3A!f%2CnumberDisplay%3Apercent))%2Cpalette%3A(name%3Acool%2Ctype%3Apalette)%2Cshape%3Apie))%2Ctitle%3A''%2Ctype%3Alens%2CvisualizationType%3AlnsPie)%2Cenhancements%3A()%2ChidePanelTitles%3A!f)%2CgridData%3A(h%3A11%2Ci%3A'5d53db36-2d5a-4adc-af7b-cec4c1a294e0'%2Cw%3A12%2Cx%3A24%2Cy%3A57)%2CpanelIndex%3A'5d53db36-2d5a-4adc-af7b-cec4c1a294e0'%2Ctitle%3A'%5BFlights%5D%20Delay%20Type'%2Ctype%3Alens%2Cversion%3A'7.15.0-SNAPSHOT'))%2Cquery%3A(language%3Akuery%2Cquery%3A'')%2Ctags%3A!()%2CtimeRestore%3A!t%2Ctitle%3A'%5BFlights%5D%20Global%20Flight%20Dashboard'%2CviewMode%3Aview)&forceNow=2021-08-17T16%3A24%3A18.782Z
  log   [12:24:20.863] [error][browser-driver][execute-job][headless-browser-console][ksga0cpq0ro62a7e7d54uerf][plugins][printablePdf][printable_pdf][reporting][runTask] Error in browser console: { text: "Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.", url: http://localhost:5601/s/space_c/app/dashboards#/view/7adfa750-4c81-11e8-b3d7-01146121b73d?_g=(filters%3A!())&_a=(description%3A'Analyze%20mock%20flight%20data%20for%20ES-Air%2C%20Logstash%20Airways%2C%20Kibana%20Airlines%20and%20JetBeats'%2Cfilters%3A!()%2CfullScreenMode%3A!f%2Coptions%3A(hidePanelTitles%3A!f%2CuseMargins%3A!t)%2Cpanels%3A!((embeddableConfig%3A(enhancements%3A())%2CgridData%3A(h%3A15%2Ci%3A'4'%2Cw%3A48%2Cx%3A0%2Cy%3A68)%2Cid%3A'571aaf70-4c88-11e8-b3d7-01146121b73d'%2CpanelIndex%3A'4'%2Ctype%3Asearch%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(enhancements%3A())%2CgridData%3A(h%3A9%2Ci%3A'7'%2Cw%3A24%2Cx%3A0%2Cy%3A15)%2Cid%3Abcb63b50-4c89-11e8-b3d7-01146121b73d%2CpanelIndex%3A'7'%2Ctype%3Avisualization%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(enhancements%3A()%2Cvis%3A(colors%3A(Count%3A%231F78C1)%2ClegendOpen%3A!f))%2CgridData%3A(h%3A11%2Ci%3A'10'%2Cw%3A24%2Cx%3A0%2Cy%3A57)%2Cid%3A'9886b410-4c8b-11e8-b3d7-01146121b73d'%2CpanelIndex%3A'10'%2Ctype%3Avisualization%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(enhancements%3A())%2CgridData%3A(h%3A11%2Ci%3A'21'%2Cw%3A12%2Cx%3A36%2Cy%3A57)%2Cid%3A'293b5a30-4c8f-11e8-b3d7-01146121b73d'%2CpanelIndex%3A'21'%2Ctype%3Avisualization%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(enhancements%3A()%2ChiddenLayers%3A!()%2CisLayerTOCOpen%3A!t%2CmapBuffer%3A(maxLat%3A48.9225%2CmaxLon%3A-90%2CminLat%3A21.94305%2CminLon%3A-135)%2CmapCenter%3A(lat%3A34.65823%2Clon%3A-112.44472%2Czoom%3A4.28)%2CopenTOCDetails%3A!())%2CgridData%3A(h%3A22%2Ci%3A'23'%2Cw%3A24%2Cx%3A0%2Cy%3A35)%2Cid%3A'5dd88580-1906-11e9-919b-ffe5949a18d2'%2CpanelIndex%3A'23'%2Ctype%3Amap%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(enhancements%3A())%2CgridData%3A(h%3A22%2Ci%3A'31'%2Cw%3A24%2Cx%3A24%2Cy%3A35)%2Cid%3Aed78a660-53a0-11e8-acbd-0be0ad9d822b%2CpanelIndex%3A'31'%2Ctype%3Avisualization%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(enhancements%3A()%2ChidePanelTitles%3A!t%2CsavedVis%3A(data%3A(aggs%3A!()%2CsearchSource%3A())%2Cdescription%3A''%2Cparams%3A(controls%3A!((fieldName%3AOriginCityName%2Cid%3A'1525098134264'%2CindexPattern%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Clabel%3A'Origin%20City'%2Coptions%3A(multiselect%3A!t%2Corder%3Adesc%2Csize%3A100%2Ctype%3Aterms)%2Cparent%3A''%2Ctype%3Alist)%2C(fieldName%3ADestCityName%2Cid%3A'1525099277699'%2CindexPattern%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Clabel%3A'Destination%20City'%2Coptions%3A(multiselect%3A!t%2Corder%3Adesc%2Csize%3A100%2Ctype%3Aterms)%2Cparent%3A'1525098134264'%2Ctype%3Alist)%2C(fieldName%3AAvgTicketPrice%2Cid%3A'1525099307278'%2CindexPattern%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Clabel%3A'Average%20Ticket%20Price'%2Coptions%3A(decimalPlaces%3A0%2Cstep%3A10)%2Cparent%3A''%2Ctype%3Arange))%2CpinFilters%3A!f%2CupdateFiltersOnChange%3A!f%2CuseTimeFilter%3A!t)%2Ctitle%3A'%5BFlights%5D%20Controls'%2Ctype%3Ainput_control_vis%2CuiState%3A()))%2CgridData%3A(h%3A7%2Ci%3Aaa810aa2-29c9-4a75-b39e-f4f267de1732%2Cw%3A32%2Cx%3A0%2Cy%3A0)%2CpanelIndex%3Aaa810aa2-29c9-4a75-b39e-f4f267de1732%2Ctype%3Avisualization%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(enhancements%3A()%2ChidePanelTitles%3A!t%2CsavedVis%3A(data%3A(aggs%3A!()%2CsearchSource%3A())%2Cdescription%3A''%2Cparams%3A(fontSize%3A10%2Cmarkdown%3A'%23%23%23%20Sample%20Flight%20data%0AThis%20dashboard%20contains%20sample%20data%20for%20you%20to%20play%20with.%20You%20can%20view%20it%2C%20search%20it%2C%20and%20interact%20with%20the%20visualizations.%20For%20more%20information%20about%20Kibana%2C%20check%20our%20%5Bdocs%5D(https%3A%2F%2Fwww.elastic.co%2Fguide%2Fen%2Fkibana%2Fcurrent%2Findex.html).'%2CopenLinksInNewTab%3A!t)%2Ctitle%3A'%5BFlights%5D%20Markdown%20Instructions'%2Ctype%3Amarkdown%2CuiState%3A()))%2CgridData%3A(h%3A7%2Ci%3A'6afc61f7-e2d5-45a3-9e7a-281160ad3eb9'%2Cw%3A16%2Cx%3A32%2Cy%3A0)%2CpanelIndex%3A'6afc61f7-e2d5-45a3-9e7a-281160ad3eb9'%2Ctype%3Avisualization%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(attributes%3A(references%3A!((id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-current-indexpattern%2Ctype%3Aindex-pattern)%2C(id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-layer-03c34665-471c-49c7-acf1-5a11f517421c%2Ctype%3Aindex-pattern))%2Cstate%3A(datasourceStates%3A(indexpattern%3A(layers%3A('03c34665-471c-49c7-acf1-5a11f517421c'%3A(columnOrder%3A!(a5b94e30-4e77-4b0a-9187-1d8b13de1456%2C'3e267327-7317-4310-aee3-320e0f7c1e70')%2Ccolumns%3A('3e267327-7317-4310-aee3-320e0f7c1e70'%3A(dataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Count%20of%20records'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords)%2Ca5b94e30-4e77-4b0a-9187-1d8b13de1456%3A(dataType%3Adate%2CisBucketed%3A!t%2Clabel%3Atimestamp%2CoperationType%3Adate_histogram%2Cparams%3A(interval%3Aauto)%2Cscale%3Ainterval%2CsourceField%3Atimestamp))%2CincompleteColumns%3A()))))%2Cfilters%3A!()%2Cquery%3A(language%3Akuery%2Cquery%3A'')%2Cvisualization%3A(axisTitlesVisibilitySettings%3A(x%3A!f%2CyLeft%3A!f%2CyRight%3A!t)%2CfittingFunction%3ANone%2CgridlinesVisibilitySettings%3A(x%3A!t%2CyLeft%3A!t%2CyRight%3A!t)%2Clayers%3A!((accessors%3A!('3e267327-7317-4310-aee3-320e0f7c1e70')%2ClayerId%3A'03c34665-471c-49c7-acf1-5a11f517421c'%2Cposition%3Atop%2CseriesType%3Abar_stacked%2CshowGridlines%3A!f%2CxAccessor%3Aa5b94e30-4e77-4b0a-9187-1d8b13de1456))%2Clegend%3A(isVisible%3A!t%2Cposition%3Aright)%2CpreferredSeriesType%3Abar_stacked%2CtickLabelsVisibilitySettings%3A(x%3A!t%2CyLeft%3A!t%2CyRight%3A!t)%2CvalueLabels%3Ahide%2CyLeftExtent%3A(mode%3Afull)%2CyRightExtent%3A(lowerBound%3A0%2Cmode%3Acustom%2CupperBound%3A1)))%2Ctitle%3A''%2Ctype%3Alens%2CvisualizationType%3AlnsXY)%2Cenhancements%3A()%2ChidePanelTitles%3A!f)%2CgridData%3A(h%3A8%2Ci%3A'086ac2e9-dd16-4b45-92b8-1e43ff7e3f65'%2Cw%3A24%2Cx%3A0%2Cy%3A7)%2CpanelIndex%3A'086ac2e9-dd16-4b45-92b8-1e43ff7e3f65'%2Ctitle%3A'%5BFlights%5D%20Flight%20count'%2Ctype%3Alens%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(attributes%3A(description%3A''%2Creferences%3A!((id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-current-indexpattern%2Ctype%3Aindex-pattern)%2C(id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-layer-8fa993db-c147-4954-adf7-4ff264d42576%2Ctype%3Aindex-pattern))%2Cstate%3A(datasourceStates%3A(indexpattern%3A(layers%3A('8fa993db-c147-4954-adf7-4ff264d42576'%3A(columnOrder%3A!('81124c45-6ab6-42f4-8859-495d55eb8065')%2Ccolumns%3A('81124c45-6ab6-42f4-8859-495d55eb8065'%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Total%20flights'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords))%2CincompleteColumns%3A()))))%2Cfilters%3A!()%2Cquery%3A(language%3Akuery%2Cquery%3A'')%2Cvisualization%3A(accessor%3A'81124c45-6ab6-42f4-8859-495d55eb8065'%2ClayerId%3A'8fa993db-c147-4954-adf7-4ff264d42576'))%2Ctitle%3A'%5BFlights%5D%20Total%20Flights'%2CvisualizationType%3AlnsMetric)%2Cenhancements%3A()%2ChidePanelTitles%3A!t)%2CgridData%3A(h%3A8%2Ci%3A'392b4936-f753-47bc-a98d-a4e41a0a4cd4'%2Cw%3A8%2Cx%3A24%2Cy%3A7)%2CpanelIndex%3A'392b4936-f753-47bc-a98d-a4e41a0a4cd4'%2Ctype%3Alens%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(attributes%3A(references%3A!((id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-current-indexpattern%2Ctype%3Aindex-pattern)%2C(id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-layer-b4712d43-1e84-4f5b-878d-8e38ba748317%2Ctype%3Aindex-pattern))%2Cstate%3A(datasourceStates%3A(indexpattern%3A(layers%3A(b4712d43-1e84-4f5b-878d-8e38ba748317%3A(columnOrder%3A!('7e8fe9b1-f45c-4f3d-9561-30febcd357ec'%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX0'%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX1'%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX2')%2Ccolumns%3A('7e8fe9b1-f45c-4f3d-9561-30febcd357ec'%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3ADelayed%2CoperationType%3Aformula%2Cparams%3A(format%3A(id%3Apercent%2Cparams%3A(decimals%3A1))%2Cformula%3A'count(kql%3D!'FlightDelay%20%3A%20true!')%20%2F%20count()'%2CisFormulaBroken%3A!f)%2Creferences%3A!('7e8fe9b1-f45c-4f3d-9561-30febcd357ecX2')%2Cscale%3Aratio)%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX0'%3A(customLabel%3A!t%2CdataType%3Anumber%2Cfilter%3A(language%3Akuery%2Cquery%3A'FlightDelay%20%3A%20true')%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20count(kql%3D!'FlightDelay%20%3A%20true!')%20%2F%20count()'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords)%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX1'%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20count(kql%3D!'FlightDelay%20%3A%20true!')%20%2F%20count()'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords)%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX2'%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20count(kql%3D!'FlightDelay%20%3A%20true!')%20%2F%20count()'%2CoperationType%3Amath%2Cparams%3A(tinymathAst%3A(args%3A!('7e8fe9b1-f45c-4f3d-9561-30febcd357ecX0'%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX1')%2Clocation%3A(max%3A41%2Cmin%3A0)%2Cname%3Adivide%2Ctext%3A'count(kql%3D!'FlightDelay%20%3A%20true!')%20%2F%20count()'%2Ctype%3Afunction))%2Creferences%3A!('7e8fe9b1-f45c-4f3d-9561-30febcd357ecX0'%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX1')%2Cscale%3Aratio))%2CincompleteColumns%3A()))))%2Cfilters%3A!()%2Cquery%3A(language%3Akuery%2Cquery%3A'')%2Cvisualization%3A(accessor%3A'7e8fe9b1-f45c-4f3d-9561-30febcd357ec'%2ClayerId%3Ab4712d43-1e84-4f5b-878d-8e38ba748317))%2Ctitle%3A''%2Ctype%3Alens%2CvisualizationType%3AlnsMetric)%2Cenhancements%3A())%2CgridData%3A(h%3A4%2Ci%3A'9271deff-5a61-4665-83fc-f9fdc6bf0c0b'%2Cw%3A8%2Cx%3A32%2Cy%3A7)%2CpanelIndex%3A'9271deff-5a61-4665-83fc-f9fdc6bf0c0b'%2Ctype%3Alens%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(attributes%3A(references%3A!((id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-current-indexpattern%2Ctype%3Aindex-pattern)%2C(id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-layer-b4712d43-1e84-4f5b-878d-8e38ba748317%2Ctype%3Aindex-pattern)%2C(id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Afilter-index-pattern-0%2Ctype%3Aindex-pattern))%2Cstate%3A(datasourceStates%3A(indexpattern%3A(layers%3A(b4712d43-1e84-4f5b-878d-8e38ba748317%3A(columnOrder%3A!(c7851241-5526-499a-960b-357af8c2ce5b%2Cc7851241-5526-499a-960b-357af8c2ce5bX2%2Cc7851241-5526-499a-960b-357af8c2ce5bX0%2Cc7851241-5526-499a-960b-357af8c2ce5bX1)%2Ccolumns%3A(c7851241-5526-499a-960b-357af8c2ce5b%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Delayed%20vs%201%20week%20earlier'%2CoperationType%3Aformula%2Cparams%3A(format%3A(id%3Apercent%2Cparams%3A(decimals%3A1))%2Cformula%3A'count()%20%2F%20count(shift%3D!'1w!')%20-%201'%2CisFormulaBroken%3A!f)%2Creferences%3A!(c7851241-5526-499a-960b-357af8c2ce5bX2)%2Cscale%3Aratio)%2Cc7851241-5526-499a-960b-357af8c2ce5bX0%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20Delayed'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords)%2Cc7851241-5526-499a-960b-357af8c2ce5bX1%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20Delayed'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords%2CtimeShift%3A'1w')%2Cc7851241-5526-499a-960b-357af8c2ce5bX2%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20Delayed'%2CoperationType%3Amath%2Cparams%3A(tinymathAst%3A(args%3A!((args%3A!(c7851241-5526-499a-960b-357af8c2ce5bX0%2Cc7851241-5526-499a-960b-357af8c2ce5bX1)%2Clocation%3A(max%3A28%2Cmin%3A0)%2Cname%3Adivide%2Ctext%3A'count()%20%2F%20count(shift%3D!'1w!')%20'%2Ctype%3Afunction)%2C1)%2Clocation%3A(max%3A31%2Cmin%3A0)%2Cname%3Asubtract%2Ctext%3A'count()%20%2F%20count(shift%3D!'1w!')%20-%201'%2Ctype%3Afunction))%2Creferences%3A!(c7851241-5526-499a-960b-357af8c2ce5bX0%2Cc7851241-5526-499a-960b-357af8c2ce5bX1)%2Cscale%3Aratio))%2CincompleteColumns%3A()))))%2Cfilters%3A!(('%24state'%3A(store%3AappState)%2Cmeta%3A(alias%3A!n%2Cdisabled%3A!f%2CindexRefName%3Afilter-index-pattern-0%2Ckey%3AFlightDelay%2Cnegate%3A!f%2Cparams%3A(query%3A!t)%2Ctype%3Aphrase)%2Cquery%3A(match_phrase%3A(FlightDelay%3A!t))))%2Cquery%3A(language%3Akuery%2Cquery%3A'')%2Cvisualization%3A(accessor%3Ac7851241-5526-499a-960b-357af8c2ce5b%2ClayerId%3Ab4712d43-1e84-4f5b-878d-8e38ba748317))%2Ctitle%3A''%2Ctype%3Alens%2CvisualizationType%3AlnsMetric)%2Cenhancements%3A())%2CgridData%3A(h%3A4%2Ci%3Aaa591c29-1a31-4ee1-a71d-b829c06fd162%2Cw%3A8%2Cx%3A40%2Cy%3A7)%2CpanelIndex%3Aaa591c29-1a31-4ee1-a71d-b829c06fd162%2Ctype%3Alens%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(attributes%3A(references%3A!((id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-current-indexpattern%2Ctype%3Aindex-pattern)%2C(id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-layer-b4712d43-1e84-4f5b-878d-8e38ba748317%2Ctype%3Aindex-pattern))%2Cstate%3A(datasourceStates%3A(indexpattern%3A(layers%3A(b4712d43-1e84-4f5b-878d-8e38ba748317%3A(columnOrder%3A!('7e8fe9b1-f45c-4f3d-9561-30febcd357ec'%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX0'%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX1'%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX2')%2Ccolumns%3A('7e8fe9b1-f45c-4f3d-9561-30febcd357ec'%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3ACancelled%2CoperationType%3Aformula%2Cparams%3A(format%3A(id%3Apercent%2Cparams%3A(decimals%3A1))%2Cformula%3A'count(kql%3D!'Cancelled%20%3A%20true!')%20%2F%20count()'%2CisFormulaBroken%3A!f)%2Creferences%3A!('7e8fe9b1-f45c-4f3d-9561-30febcd357ecX2')%2Cscale%3Aratio)%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX0'%3A(customLabel%3A!t%2CdataType%3Anumber%2Cfilter%3A(language%3Akuery%2Cquery%3A'Cancelled%20%3A%20true')%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20Cancelled'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords)%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX1'%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20Cancelled'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords)%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX2'%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20Cancelled'%2CoperationType%3Amath%2Cparams%3A(tinymathAst%3A(args%3A!('7e8fe9b1-f45c-4f3d-9561-30febcd357ecX0'%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX1')%2Clocation%3A(max%3A39%2Cmin%3A0)%2Cname%3Adivide%2Ctext%3A'count(kql%3D!'Cancelled%20%3A%20true!')%20%2F%20count()'%2Ctype%3Afunction))%2Creferences%3A!('7e8fe9b1-f45c-4f3d-9561-30febcd357ecX0'%2C'7e8fe9b1-f45c-4f3d-9561-30febcd357ecX1')%2Cscale%3Aratio))%2CincompleteColumns%3A()))))%2Cfilters%3A!()%2Cquery%3A(language%3Akuery%2Cquery%3A'')%2Cvisualization%3A(accessor%3A'7e8fe9b1-f45c-4f3d-9561-30febcd357ec'%2ClayerId%3Ab4712d43-1e84-4f5b-878d-8e38ba748317))%2Ctitle%3A''%2Ctype%3Alens%2CvisualizationType%3AlnsMetric)%2Cenhancements%3A())%2CgridData%3A(h%3A4%2Ci%3Ab766e3b8-4544-46ed-99e6-9ecc4847e2a2%2Cw%3A8%2Cx%3A32%2Cy%3A11)%2CpanelIndex%3Ab766e3b8-4544-46ed-99e6-9ecc4847e2a2%2Ctype%3Alens%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(attributes%3A(references%3A!((id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-current-indexpattern%2Ctype%3Aindex-pattern)%2C(id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-layer-b4712d43-1e84-4f5b-878d-8e38ba748317%2Ctype%3Aindex-pattern)%2C(id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Afilter-index-pattern-0%2Ctype%3Aindex-pattern))%2Cstate%3A(datasourceStates%3A(indexpattern%3A(layers%3A(b4712d43-1e84-4f5b-878d-8e38ba748317%3A(columnOrder%3A!(c7851241-5526-499a-960b-357af8c2ce5b%2Cc7851241-5526-499a-960b-357af8c2ce5bX2%2Cc7851241-5526-499a-960b-357af8c2ce5bX0%2Cc7851241-5526-499a-960b-357af8c2ce5bX1)%2Ccolumns%3A(c7851241-5526-499a-960b-357af8c2ce5b%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Cancelled%20vs%201%20week%20earlier'%2CoperationType%3Aformula%2Cparams%3A(format%3A(id%3Apercent%2Cparams%3A(decimals%3A1))%2Cformula%3A'count()%20%2F%20count(shift%3D!'1w!')%20-%201'%2CisFormulaBroken%3A!f)%2Creferences%3A!(c7851241-5526-499a-960b-357af8c2ce5bX2)%2Cscale%3Aratio)%2Cc7851241-5526-499a-960b-357af8c2ce5bX0%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20Delayed%20vs%201%20week%20earlier'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords)%2Cc7851241-5526-499a-960b-357af8c2ce5bX1%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20Delayed%20vs%201%20week%20earlier'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords%2CtimeShift%3A'1w')%2Cc7851241-5526-499a-960b-357af8c2ce5bX2%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20Delayed%20vs%201%20week%20earlier'%2CoperationType%3Amath%2Cparams%3A(tinymathAst%3A(args%3A!((args%3A!(c7851241-5526-499a-960b-357af8c2ce5bX0%2Cc7851241-5526-499a-960b-357af8c2ce5bX1)%2Clocation%3A(max%3A28%2Cmin%3A0)%2Cname%3Adivide%2Ctext%3A'count()%20%2F%20count(shift%3D!'1w!')%20'%2Ctype%3Afunction)%2C1)%2Clocation%3A(max%3A31%2Cmin%3A0)%2Cname%3Asubtract%2Ctext%3A'count()%20%2F%20count(shift%3D!'1w!')%20-%201'%2Ctype%3Afunction))%2Creferences%3A!(c7851241-5526-499a-960b-357af8c2ce5bX0%2Cc7851241-5526-499a-960b-357af8c2ce5bX1)%2Cscale%3Aratio))%2CincompleteColumns%3A()))))%2Cfilters%3A!(('%24state'%3A(store%3AappState)%2Cmeta%3A(alias%3A!n%2Cdisabled%3A!f%2CindexRefName%3Afilter-index-pattern-0%2Ckey%3ACancelled%2Cnegate%3A!f%2Cparams%3A(query%3A!t)%2Ctype%3Aphrase)%2Cquery%3A(match_phrase%3A(Cancelled%3A!t))))%2Cquery%3A(language%3Akuery%2Cquery%3A'')%2Cvisualization%3A(accessor%3Ac7851241-5526-499a-960b-357af8c2ce5b%2ClayerId%3Ab4712d43-1e84-4f5b-878d-8e38ba748317))%2Ctitle%3A''%2Ctype%3Alens%2CvisualizationType%3AlnsMetric)%2Cenhancements%3A())%2CgridData%3A(h%3A4%2Ci%3A'2e33ade5-96e5-40b4-b460-493e5d4fa834'%2Cw%3A8%2Cx%3A40%2Cy%3A11)%2CpanelIndex%3A'2e33ade5-96e5-40b4-b460-493e5d4fa834'%2Ctype%3Alens%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(attributes%3A(references%3A!((id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-current-indexpattern%2Ctype%3Aindex-pattern)%2C(id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-layer-f26e8f7a-4118-4227-bea0-5c02d8b270f7%2Ctype%3Aindex-pattern))%2Cstate%3A(datasourceStates%3A(indexpattern%3A(layers%3A(f26e8f7a-4118-4227-bea0-5c02d8b270f7%3A(columnOrder%3A!('3dd24cb4-45ef-4dd8-b22a-d7b802cb6da0'%2C'52f6f2e9-6242-4c44-be63-b799150e7e60'%2C'52f6f2e9-6242-4c44-be63-b799150e7e60X0'%2C'52f6f2e9-6242-4c44-be63-b799150e7e60X1'%2C'52f6f2e9-6242-4c44-be63-b799150e7e60X2'%2C'7b9f3ece-9da3-4c27-b582-d3f8e8cc31d6X0'%2C'7b9f3ece-9da3-4c27-b582-d3f8e8cc31d6X1'%2C'7b9f3ece-9da3-4c27-b582-d3f8e8cc31d6X2'%2C'7b9f3ece-9da3-4c27-b582-d3f8e8cc31d6')%2Ccolumns%3A('3dd24cb4-45ef-4dd8-b22a-d7b802cb6da0'%3A(dataType%3Astring%2CisBucketed%3A!t%2Clabel%3A'Top%20values%20of%20OriginCityName'%2CoperationType%3Aterms%2Cparams%3A(missingBucket%3A!f%2CorderBy%3A(fallback%3A!t%2Ctype%3Aalphabetical)%2CorderDirection%3Aasc%2CotherBucket%3A!t%2Csize%3A1000)%2Cscale%3Aordinal%2CsourceField%3AOriginCityName)%2C'52f6f2e9-6242-4c44-be63-b799150e7e60'%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Delay%20%25'%2CoperationType%3Aformula%2Cparams%3A(format%3A(id%3Apercent%2Cparams%3A(decimals%3A0))%2Cformula%3A'count(kql%3D!'FlightDelay%20%3A%20true%20!')%20%2F%20count()'%2CisFormulaBroken%3A!f)%2Creferences%3A!('52f6f2e9-6242-4c44-be63-b799150e7e60X2')%2Cscale%3Aratio)%2C'52f6f2e9-6242-4c44-be63-b799150e7e60X0'%3A(customLabel%3A!t%2CdataType%3Anumber%2Cfilter%3A(language%3Akuery%2Cquery%3A'FlightDelay%20%3A%20true%20')%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20Delay%20%25'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords)%2C'52f6f2e9-6242-4c44-be63-b799150e7e60X1'%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20Delay%20%25'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords)%2C'52f6f2e9-6242-4c44-be63-b799150e7e60X2'%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20Delay%20%25'%2CoperationType%3Amath%2Cparams%3A(tinymathAst%3A(args%3A!('52f6f2e9-6242-4c44-be63-b799150e7e60X0'%2C'52f6f2e9-6242-4c44-be63-b799150e7e60X1')%2Clocation%3A(max%3A42%2Cmin%3A0)%2Cname%3Adivide%2Ctext%3A'count(kql%3D!'FlightDelay%20%3A%20true%20!')%20%2F%20count()'%2Ctype%3Afunction))%2Creferences%3A!('52f6f2e9-6242-4c44-be63-b799150e7e60X0'%2C'52f6f2e9-6242-4c44-be63-b799150e7e60X1')%2Cscale%3Aratio)%2C'7b9f3ece-9da3-4c27-b582-d3f8e8cc31d6'%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Cancel%20%25'%2CoperationType%3Aformula%2Cparams%3A(format%3A(id%3Apercent%2Cparams%3A(decimals%3A0))%2Cformula%3A'count(kql%3D!'Cancelled%3A%20true!')%20%2F%20count()'%2CisFormulaBroken%3A!f)%2Creferences%3A!('7b9f3ece-9da3-4c27-b582-d3f8e8cc31d6X2')%2Cscale%3Aratio)%2C'7b9f3ece-9da3-4c27-b582-d3f8e8cc31d6X0'%3A(customLabel%3A!t%2CdataType%3Anumber%2Cfilter%3A(language%3Akuery%2Cquery%3A'Cancelled%3A%20true')%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20Cancel%20%25'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords)%2C'7b9f3ece-9da3-4c27-b582-d3f8e8cc31d6X1'%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20Cancel%20%25'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords)%2C'7b9f3ece-9da3-4c27-b582-d3f8e8cc31d6X2'%3A(customLabel%3A!t%2CdataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Part%20of%20Cancel%20%25'%2CoperationType%3Amath%2Cparams%3A(tinymathAst%3A(args%3A!('7b9f3ece-9da3-4c27-b582-d3f8e8cc31d6X0'%2C'7b9f3ece-9da3-4c27-b582-d3f8e8cc31d6X1')%2Clocation%3A(max%3A38%2Cmin%3A0)%2Cname%3Adivide%2Ctext%3A'count(kql%3D!'Cancelled%3A%20true!')%20%2F%20count()'%2Ctype%3Afunction))%2Creferences%3A!('7b9f3ece-9da3-4c27-b582-d3f8e8cc31d6X0'%2C'7b9f3ece-9da3-4c27-b582-d3f8e8cc31d6X1')%2Cscale%3Aratio))%2CincompleteColumns%3A()))))%2Cfilters%3A!()%2Cquery%3A(language%3Akuery%2Cquery%3A'')%2Cvisualization%3A(columns%3A!((columnId%3A'3dd24cb4-45ef-4dd8-b22a-d7b802cb6da0'%2CisTransposed%3A!f%2Cwidth%3A262.75)%2C(alignment%3Acenter%2CcolorMode%3Acell%2CcolumnId%3A'52f6f2e9-6242-4c44-be63-b799150e7e60'%2CisTransposed%3A!f%2Cpalette%3A(name%3Acustom%2Cparams%3A(colorStops%3A!((color%3A%23f7e0b8%2Cstop%3A0.2)%2C(color%3A%23e7664c%2Cstop%3A0.6))%2Cname%3Acustom%2CrangeMax%3A0.6%2CrangeMin%3A0.2%2CrangeType%3Anumber%2Csteps%3A5%2Cstops%3A!((color%3A%23f7e0b8%2Cstop%3A0.6)%2C(color%3A%23e7664c%2Cstop%3A1)))%2Ctype%3Apalette)%2Cwidth%3A302.5)%2C(alignment%3Acenter%2CcolorMode%3Acell%2CcolumnId%3A'7b9f3ece-9da3-4c27-b582-d3f8e8cc31d6'%2CisTransposed%3A!f%2Cpalette%3A(name%3Acustom%2Cparams%3A(colorStops%3A!((color%3A%23f7e0b8%2Cstop%3A0.2)%2C(color%3A%23e7664c%2Cstop%3A0.6))%2Cname%3Acustom%2CrangeMax%3A0.6%2CrangeMin%3A0.2%2CrangeType%3Anumber%2Csteps%3A5%2Cstops%3A!((color%3A%23f7e0b8%2Cstop%3A0.6)%2C(color%3A%23e7664c%2Cstop%3A0.6666666666666666)))%2Ctype%3Apalette)))%2ClayerId%3Af26e8f7a-4118-4227-bea0-5c02d8b270f7%2Csorting%3A(columnId%3A'52f6f2e9-6242-4c44-be63-b799150e7e60'%2Cdirection%3Adesc)))%2Ctitle%3A'Cities%20by%20delay%2C%20cancellation'%2Ctype%3Alens%2CvisualizationType%3AlnsDatatable)%2Cenhancements%3A()%2ChidePanelTitles%3A!f)%2CgridData%3A(h%3A20%2Ci%3Afb86b32f-fb7a-45cf-9511-f366fef51bbd%2Cw%3A24%2Cx%3A24%2Cy%3A15)%2CpanelIndex%3Afb86b32f-fb7a-45cf-9511-f366fef51bbd%2Ctitle%3A'%5BFlights%5D%20Most%20delayed%20cities'%2Ctype%3Alens%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(attributes%3A(references%3A!((id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-current-indexpattern%2Ctype%3Aindex-pattern)%2C(id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-layer-e80cc05e-c52a-4e5f-ac71-4b37274867f5%2Ctype%3Aindex-pattern))%2Cstate%3A(datasourceStates%3A(indexpattern%3A(layers%3A(e80cc05e-c52a-4e5f-ac71-4b37274867f5%3A(columnOrder%3A!(caf7421e-93a3-439e-ab0a-fbdead93c21c%2C'13ec79e3-9d73-4536-9056-3d92802bb30a'%2C'0233d302-ec81-4fbe-96cb-7fac84cf035c')%2Ccolumns%3A('0233d302-ec81-4fbe-96cb-7fac84cf035c'%3A(dataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Count%20of%20records'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords)%2C'13ec79e3-9d73-4536-9056-3d92802bb30a'%3A(dataType%3Adate%2CisBucketed%3A!t%2Clabel%3Atimestamp%2CoperationType%3Adate_histogram%2Cparams%3A(interval%3Aauto)%2Cscale%3Ainterval%2CsourceField%3Atimestamp)%2Ccaf7421e-93a3-439e-ab0a-fbdead93c21c%3A(dataType%3Astring%2CisBucketed%3A!t%2Clabel%3A'Top%20values%20of%20FlightDelayType'%2CoperationType%3Aterms%2Cparams%3A(missingBucket%3A!f%2CorderBy%3A(columnId%3A'0233d302-ec81-4fbe-96cb-7fac84cf035c'%2Ctype%3Acolumn)%2CorderDirection%3Adesc%2CotherBucket%3A!t%2Csize%3A10)%2Cscale%3Aordinal%2CsourceField%3AFlightDelayType))%2CincompleteColumns%3A()))))%2Cfilters%3A!()%2Cquery%3A(language%3Akuery%2Cquery%3A'')%2Cvisualization%3A(axisTitlesVisibilitySettings%3A(x%3A!t%2CyLeft%3A!f%2CyRight%3A!t)%2CfittingFunction%3ANone%2CgridlinesVisibilitySettings%3A(x%3A!t%2CyLeft%3A!t%2CyRight%3A!t)%2Clayers%3A!((accessors%3A!('0233d302-ec81-4fbe-96cb-7fac84cf035c')%2ClayerId%3Ae80cc05e-c52a-4e5f-ac71-4b37274867f5%2Cpalette%3A(name%3Acool%2Ctype%3Apalette)%2Cposition%3Atop%2CseriesType%3Abar_percentage_stacked%2CshowGridlines%3A!f%2CsplitAccessor%3Acaf7421e-93a3-439e-ab0a-fbdead93c21c%2CxAccessor%3A'13ec79e3-9d73-4536-9056-3d92802bb30a'))%2Clegend%3A(isVisible%3A!t%2Cposition%3Abottom)%2CpreferredSeriesType%3Abar_percentage_stacked%2CtickLabelsVisibilitySettings%3A(x%3A!t%2CyLeft%3A!t%2CyRight%3A!t)%2CvalueLabels%3Ahide%2CyLeftExtent%3A(mode%3Afull)%2CyRightExtent%3A(mode%3Afull)))%2Ctitle%3A''%2Ctype%3Alens%2CvisualizationType%3AlnsXY)%2Cenhancements%3A()%2ChidePanelTitles%3A!f)%2CgridData%3A(h%3A11%2Ci%3A'0cc42484-16f7-42ec-b38c-9bf8be69cde7'%2Cw%3A24%2Cx%3A0%2Cy%3A24)%2CpanelIndex%3A'0cc42484-16f7-42ec-b38c-9bf8be69cde7'%2Ctitle%3A'%5BFlights%5D%20Delay%20Type'%2Ctype%3Alens%2Cversion%3A'7.15.0-SNAPSHOT')%2C(embeddableConfig%3A(attributes%3A(references%3A!((id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-current-indexpattern%2Ctype%3Aindex-pattern)%2C(id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Aindexpattern-datasource-layer-0c8e136b-a822-4fb3-836d-e06cbea4eea4%2Ctype%3Aindex-pattern)%2C(id%3Ad3d7af60-4c81-11e8-b3d7-01146121b73d%2Cname%3Afilter-index-pattern-0%2Ctype%3Aindex-pattern))%2Cstate%3A(datasourceStates%3A(indexpattern%3A(layers%3A('0c8e136b-a822-4fb3-836d-e06cbea4eea4'%3A(columnOrder%3A!(d1cee8bf-34cf-4141-99d7-ff043ee77b56%2Caa152ace-ee2d-447b-b86d-459bef4d7880)%2Ccolumns%3A(aa152ace-ee2d-447b-b86d-459bef4d7880%3A(dataType%3Anumber%2CisBucketed%3A!f%2Clabel%3A'Count%20of%20records'%2CoperationType%3Acount%2Cscale%3Aratio%2CsourceField%3ARecords)%2Cd1cee8bf-34cf-4141-99d7-ff043ee77b56%3A(dataType%3Astring%2CisBucketed%3A!t%2Clabel%3A'Top%20values%20of%20FlightDelayType'%2CoperationType%3Aterms%2Cparams%3A(missingBucket%3A!f%2CorderBy%3A(columnId%3Aaa152ace-ee2d-447b-b86d-459bef4d7880%2Ctype%3Acolumn)%2CorderDirection%3Adesc%2CotherBucket%3A!t%2Csize%3A10)%2Cscale%3Aordinal%2CsourceField%3AFlightDelayType))%2CincompleteColumns%3A()))))%2Cfilters%3A!(('%24state'%3A(store%3AappState)%2Cmeta%3A(alias%3A!n%2Cdisabled%3A!f%2CindexRefName%3Afilter-index-pattern-0%2Ckey%3AFlightDelayType%2Cnegate%3A!t%2Cparams%3A(query%3A'No%20Delay')%2Ctype%3Aphrase)%2Cquery%3A(match_phrase%3A(FlightDelayType%3A'No%20Delay'))))%2Cquery%3A(language%3Akuery%2Cquery%3A'')%2Cvisualization%3A(layers%3A!((categoryDisplay%3Adefault%2Cgroups%3A!(d1cee8bf-34cf-4141-99d7-ff043ee77b56)%2ClayerId%3A'0c8e136b-a822-4fb3-836d-e06cbea4eea4'%2ClegendDisplay%3Adefault%2Cmetric%3Aaa152ace-ee2d-447b-b86d-459bef4d7880%2CnestedLegend%3A!f%2CnumberDisplay%3Apercent))%2Cpalette%3A(name%3Acool%2Ctype%3Apalette)%2Cshape%3Apie))%2Ctitle%3A''%2Ctype%3Alens%2CvisualizationType%3AlnsPie)%2Cenhancements%3A()%2ChidePanelTitles%3A!f)%2CgridData%3A(h%3A11%2Ci%3A'5d53db36-2d5a-4adc-af7b-cec4c1a294e0'%2Cw%3A12%2Cx%3A24%2Cy%3A57)%2CpanelIndex%3A'5d53db36-2d5a-4adc-af7b-cec4c1a294e0'%2Ctitle%3A'%5BFlights%5D%20Delay%20Type'%2Ctype%3Alens%2Cversion%3A'7.15.0-SNAPSHOT'))%2Cquery%3A(language%3Akuery%2Cquery%3A'')%2Ctags%3A!()%2CtimeRestore%3A!t%2Ctitle%3A'%5BFlights%5D%20Global%20Flight%20Dashboard'%2CviewMode%3Aview)&forceNow=2021-08-17T16%3A24%3A18.782Z }
  log   [12:24:22.915] [info][execute-job][ksga0cpq0ro62a7e7d54uerf][plugins][printablePdf][printable_pdf][reporting][runTask] handled 156 page requests
  log   [12:24:33.410] [info][execute-job][ksga0cpq0ro62a7e7d54uerf][plugins][printablePdf][printable_pdf][reporting][runTask] timeRange: Aug 10, 2021 @ 12:24:24.063 to Aug 17, 2021 @ 12:24:24.063
  log   [12:24:33.413] [info][execute-job][ksga0cpq0ro62a7e7d54uerf][plugins][printablePdf][printable_pdf][reporting][runTask] taking screenshots
  log   [12:24:36.504] [info][execute-job][ksga0cpq0ro62a7e7d54uerf][plugins][printablePdf][printable_pdf][reporting][runTask] screenshots taken: 1
  log   [12:24:39.007] [warning][plugins][taskManager] Detected potential performance issue with Task Manager. Set 'xpack.task_manager.monitored_stats_health_verbose_log.enabled: true' in your Kibana.yml to enable debug logging
  log   [12:24:39.821] [info][status] Kibana is now unavailable (was available)
  log   [12:24:39.907] [info][plugins][reporting][runTask] Saved printable_pdf job /.reporting-2021-08-15/_doc/ksga0cpq0ro62a7e7d54uerf
  log   [12:24:45.534] [info][status] Kibana is now available (was unavailable)
 error  [12:24:54.711]  Error: Internal Server Error
    at HapiResponseAdapter.toError (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/src/core/server/http/router/response_adapter.js:128:19)
    at HapiResponseAdapter.toHapiResponse (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/src/core/server/http/router/response_adapter.js:82:19)
    at HapiResponseAdapter.handle (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/src/core/server/http/router/response_adapter.js:73:17)
    at Router.handle (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/src/core/server/http/router/router.js:164:34)
    at processTicksAndRejections (internal/process/task_queues.js:95:5)
    at handler (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/src/core/server/http/router/router.js:124:50)
    at exports.Manager.execute (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/node_modules/@hapi/hapi/lib/toolkit.js:60:28)
    at Object.internals.handler (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/node_modules/@hapi/hapi/lib/handler.js:46:20)
    at exports.execute (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/node_modules/@hapi/hapi/lib/handler.js:31:20)
    at Request._lifecycle (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/node_modules/@hapi/hapi/lib/request.js:370:32)
    at Request._execute (/Users/bhavyarajumandya/Desktop/snapshot_7.15.0/kibana-7.15.0-SNAPSHOT-darwin-x86_64/node_modules/@hapi/hapi/lib/request.js:279:9)
^C  log   [15:11:47.581] [error][savedobjects-service] Unable to retrieve version information from Elasticsearch nodes. connect ECONNREFUSED 127.0.0.1:9200
  log   [15:11:47.711] [warning][licensing][plugins] License information could not be obtained from Elasticsearch due to ConnectionError: connect ECONNREFUSED 127.0.0.1:9200 error
  log   [15:11:47.716] [info][plugins][searchprofiler] You cannot use searchprofiler because license information is not available at this time.
  log   [15:11:47.716] [info][painlessLab][plugins] You cannot use painlessLab because license information is not available at this time.
  log   [15:11:47.717] [info][plugins][transform] You cannot use transform because license information is not available at this time.
  log   [15:11:47.717] [info][plugins][snapshotRestore] You cannot use snapshot_restore because license information is not available at this time.
  log   [15:11:47.718] [info][plugins][rollup] You cannot use rollup because license information is not available at this time.
  log   [15:11:47.718] [info][plugins][remoteClusters] You cannot use Remote Clusters because license information is not available at this time.
  log   [15:11:47.718] [info][indexLifecycleManagement][plugins] You cannot use index_lifecycle_management because license information is not available at this time.
  log   [15:11:47.722] [info][kibana-monitoring][monitoring][monitoring][plugins] Monitoring status upload endpoint is not enabled in Elasticsearch:Monitoring stats collection is stopped
  log   [15:11:47.783] [warning][plugins][securitySolution] Unable to verify endpoint policies in line with license change: failed to fetch package policies: connect ECONNREFUSED 127.0.0.1:9200
  log   [15:11:48.290] [info][status] Kibana is now critical (was available)
  log   [15:11:48.917] [info][plugins-system][standard] Stopping all plugins.
  log   [15:11:48.918] [info][kibana-monitoring][monitoring][monitoring][plugins] Monitoring stats collection is stopped
  log   [15:11:48.925] [error][eventLog][plugins] error writing bulk events: "connect ECONNREFUSED 127.0.0.1:9200"; docs: [{"create":{"_index":".kibana-event-log-7.15.0-snapshot"}},{"@timestamp":"2021-08-17T19:11:48.919Z","event":{"provider":"eventLog","action":"stopping"},"message":"eventLog stopping","ecs":{"version":"1.8.0"},"kibana":{"server_uuid":"2ffea1b6-6bf8-494c-9b76-c7aaaebe3f51"}}]

tsullivan commented 3 years ago

New kibana logs without doing anything with metricbeat:

I'm confused about the change in logs too. In the first log sample, the PDF report was failing, but in the second sample, the PDF output is being created in ES.

bhavyarm commented 3 years ago

Happened again on BC1 immediately after I generated a report of a dashboard. Same errors in es logs and kibana logs. Nothing in browser logs. This is on darwin build https://staging.elastic.co/7.15.0-d9929120/summary-7.15.0.html please note I don't have security enabled.

bhavyarm commented 3 years ago

I don't see the errors after I enable security.

pmuellr commented 3 years ago

For the internal server error, unfortunately, Kibana doesn't log what URL it was processing. So we don't really know what part of Kibana that came from. The only thing we have is the time it occurred, and hopefully correlate that with what the user was doing in Kibana (or using curl, for instance) at that time.

We could add logging for the HTTP requests, which makes the log extremely noisy, but should help pinpoint the request that caused the error.

Task manager only has one route installed, to fetch it's health report, so unless that was called at the time of the internal server error, it's unlikely task manager was involved with that.

We have an issue open for task manager status "flapping" from available -> degraded -> unavailable -> ... https://github.com/elastic/kibana/issues/109095 - from other reports, things seem to be running fine when these show up, so it seems like task manager is likely setting a status of "not ok" in some cases, when it shouldn't, because it's still running alerting rules and other tasks. It's not clear to me exactly what "Kibana is unavailable" or "Kibana is degraded" actually mean - I'm thinking that it's just a status indication, and doesn't affect how Kibana runs, but of course it's possible Kibana acts different when it's "unavailable" or "degraded". We're still investigating ...

jloleysens commented 3 years ago

Hey @bhavyarm and all!

The Error: Internal Server Error in Kibana is a result of these changes: https://github.com/elastic/kibana/pull/105181 (adds call to _has_privileges) which correlates to the message about security from ES logs. We should definitely clean this up, probably by adding a check for whether security is enabled - I'll open a PR for this.

However, this would not result in Kibana going unavailable. I suspect we need to investigate that further.

I tried running the metricbeat setup command from the issue description but am seeing a different error (not familiar to me):

Exiting: 1 error: error loading index pattern: returned 415 to import file: Unsupported Media Type: <nil>.

So the dashboards from metricbeat were not available to me during testing locally.

When I used a dashboard from sample data I was able to generate a new dashboard without seeing a message from task manager and Kibana going unavailable. Perhaps there is something specific to the environment Kibana is running in that is memory constrained somehow?

pmuellr commented 3 years ago

However, this would not result in Kibana going unavailable. I suspect we need to investigate that further.

Already being investigated: https://github.com/elastic/kibana/issues/108247

At this time, it seems most likely that this is coming from Task Manager, which is trying to inform Kibana that it's under stress, but ... it's lying. :-) So I'd ignore those messages at this point.

tsullivan commented 3 years ago

Hi @bhavyarm I believe the Internal Server Error issue was fixed in this PR: https://github.com/elastic/kibana/pull/109429, which means we can probably close this issue.

bhavyarm commented 3 years ago

Fixed via https://github.com/elastic/kibana/pull/109429

elastic / kibana

Reporting: Internal server error on task manager while generating reports #108774