elastic / e2e-testing

Formal verification of Elastic-Agent and more using BDD
Other
24 stars 42 forks source link

[Agent] add basic integrations tests for Windows package (and maybe some detailed data validation too) #824

Open EricDavisX opened 3 years ago

EricDavisX commented 3 years ago

This is dependent on having windows worker / ci support, but when we get it in we want to integrate with it as possible, and likely go a bit deeper than we have thus far with automation.

Dependent on https://github.com/elastic/e2e-testing/issues/823 for Windows support at all, then we can itemize out more specifics

Akin to this for system package: https://github.com/elastic/e2e-testing/issues/313

mdelapenya commented 3 years ago

Using same approach as in the ARM side, we can provision Windows workers, and adapt the code to use Windows containers. But I'm afraid we are not generating Windows images. This issue must be achieved refactoring the test framework to allow spinning windows boxes (VMs?) instead of containers.

@elastic/observablt-robots wdyt of providing a VM driver to the e2e tests, which allows to spin up a VM? We currently have the docker-compose driver, which is the manager for container services.

EricDavisX commented 3 years ago

this is nearly done and ready to be worked. the support for Windows is cited here as a (possibly) last step to achieve support: https://github.com/elastic/e2e-testing/issues/1435

the next step will be for someone on the engg prod team to do the leg work to add in tests - @IgorGuz2000 want to put this on your list?

IgorGuz2000 commented 3 years ago

Yes

cachedout commented 2 years ago

Hello @IgorGuz2000 and @mdelapenya

We have had this issue for quite some time. @IgorGuz2000 did you ever manage to add in these tests or is this work still outstanding?