elastic / kibana

Your window into the Elastic Stack
https://www.elastic.co/products/kibana
Other
19.73k stars 8.14k forks source link

Unhandled promise rejection in observability #137871

Open rudolf opened 2 years ago

rudolf commented 2 years ago

There's been a recent uptick in unhandled promise rejections on cloud and around 200 clusters have had a unhandled rejection with the following stack trace&_a=(columns:!(ece.cluster.keyword,error.stack_trace,message,docker.container.labels.co.elastic.cloud.allocator.type_version),filters:!(('$state':(store:appState),meta:(alias:'%22unhandled%20promise%20rejection%22%20AND%20NOT%20%22index_not_found_exception%22',disabled:!f,index:'logging-:cluster-kibana-',key:query,negate:!f,type:custom,value:'%7B%22bool%22:%7B%22must%22:%5B%5D,%22filter%22:%5B%7B%22bool%22:%7B%22filter%22:%5B%7B%22multi_match%22:%7B%22type%22:%22phrase%22,%22query%22:%22unhandled%20promise%20rejection%22,%22lenient%22:true%7D%7D,%7B%22bool%22:%7B%22must_not%22:%7B%22multi_match%22:%7B%22type%22:%22phrase%22,%22query%22:%22index_not_found_exception%22,%22lenient%22:true%7D%7D%7D%7D%5D%7D%7D%5D,%22should%22:%5B%5D,%22must_not%22:%5B%5D%7D%7D'),query:(bool:(filter:!((bool:(filter:!((multi_match:(lenient:!t,query:'unhandled%20promise%20rejection',type:phrase)),(bool:(must_not:(multi_match:(lenient:!t,query:index_not_found_exception,type:phrase)))))))),must:!(),must_not:!(),should:!()))),('$state':(store:appState),meta:(alias:!n,disabled:!f,index:'logging-:cluster-kibana-',key:error.stack_trace,negate:!f,type:exists,value:exists),query:(exists:(field:error.stack_trace)))),grid:(columns:(error.stack_trace:(width:360),message:(width:687))),index:'logging-:cluster-kibana-',interval:auto,query:(language:kuery,query:'NOT%20(error.stack_trace:%20TelemetryEventsSender)%20AND%20docker.container.labels.co.elastic.cloud.allocator.type_version%20:%208%20AND%20NOT%20error.stack_trace:%20alert%20AND%20error.stack_trace:%20observability*'),sort:!(!('@timestamp',desc)))):

Error: Request aborted at /usr/share/kibana/x-pack/plugins/observability/common/utils/unwrap_es_response.js:60:11 at runMicrotasks (<anonymous>) at processTicksAndRejections (node:internal/process/task_queues:96:5) at getDerivedServiceAnnotations (/usr/share/kibana/x-pack/plugins/apm/server/routes/services/annotations/get_derived_service_annotations.js:45:72)

Unhandled promise rejections could lead to memory leaks and generally indicate that the code didn't consider how to best handle the failure scenario so we're hoping to reduce the number of occurrences as part of https://github.com/elastic/kibana/issues/77469

elasticmachine commented 2 years ago

Pinging @elastic/unified-observability (Team:Observability)