search

elastic / fleet-server

The Fleet server allows managing a fleet of Elastic Agents.
Other
11 stars 81 forks source link

[Self-Managed]: Fleet Server doesn't gets back healthy itself when setup VM is turned off then re-run after sometime. #2989

Open amolnater-qasource opened 1 year ago

amolnater-qasource commented 1 year ago

Kibana Build details:

VERSION: 8.11.0 SNAPSHOT self-managed
BUILD: 67254
COMMIT: 7ac96504f11ebde1f14d7cd9d45d99ed0d81768f

Host OS: Windows

Preconditions:

  1. 8.11.0 SNAPSHOT Kibana self-managed environment should be available.

Steps to reproduce:

  1. Setup 8.11 self-managed elasticsearch and kibana.
  2. Install Fleet Server.
  3. Shut down elasticsearch and kibana services. Now shut down the VM
  4. Turn VM on after 10 minutes and also re-run elasticsearch and kibana again.
  5. Navigate to Fleet tab and observe Fleet server keeps sending data and logs, however remain offline on UI. [We have waited more than an hour to get the fleet server back Healthy.]
  6. Agent diagnostics also fails.
  7. Now run .\elastic-agent.exe diagnostics collect.
  8. Observe agent gets back Healthy.

Note:

Agent logs: elastic-agent-diagnostics-2023-09-25T10-35-16Z-00.zip

Screen Recording:

https://github.com/elastic/fleet-server/assets/77374876/36bf9d94-aaa2-4454-b3f4-a0834ce95934

Expected Result: Fleet Server should get back healthy itself when setup VM is turned off then re-run after sometime.

amolnater-qasource commented 1 year ago

@manishgupta-qasource Please review.

manishgupta-qasource commented 1 year ago

Secondary review for this ticket is Done