search

elastic / kibana

Your window into the Elastic Stack
https://www.elastic.co/products/kibana
Other
19.72k stars 8.14k forks source link

[Synthetics] Project monitors - Streaming project monitor results does not work in cloud. #139746

Closed dominiqueclarke closed 1 year ago

dominiqueclarke commented 2 years ago

Related to https://github.com/elastic/cloud/issues/106308

Kibana version: 8.4.0

Original install method (e.g. download page, yum, from source, etc.): Cloud console

Description of the problem including expected versus actual behavior:

The project monitors api allows our users to store monitor configuration in source control and push them directly to Kibana, via the synthetics-agent, to generate monitors that can run either through our globally managed testing infrastructure, or via elastic-agent and private locations.

When configuration monitors to run via elastic-agent via private locations in particular, the operations are slow.

This causes timeouts when pushing even a small number of monitors, say 4 or 5, as the synthetics-agent has a 30-second timeout.

To resolve this, we use streaming to provide updates of each monitor operation as they happen. This works fine locally, but in Cloud the streaming response headers are not being honored, causing the entire response to be buffered and then sent back to the synthetics-agent. This buffering often takes longer than 30 seconds in even the smallest cases, causing timeouts.

elasticmachine commented 2 years ago

Pinging @elastic/uptime (Team:uptime)

paulb-elastic commented 1 year ago

We have made various other improvements where we can, but will keep this open to track the platform change to improve streaming responses (moving to the 8.6 board as we’ll be closing the 8.5 board down soon).

shahzad31 commented 1 year ago

This is not valid anymore, so closing. Since we are moving away from streaming in new api structure