[Automatic Import] Create e2e integration tests

bhapas commented 3 weeks ago

This focus of this issue is to create e2e integration tests for Automatic Import.

The alternatives are to use Cypress or Playwright. With the current CI setup and tool availability in Kibana , it is better to go with Cypress to have the tests implemented in 8.16.

This issue shall be used to identify test scenarios and the goal of this issue is to have automated e2e integration tests for Automatic Import.

License and access

[ ] User with Basic license should not be able to access Automatic Import
[ ] User without RBAC privileges [ fleet.all , integrations.all ] should not be able to use Auto Import

Create Integration Landing

[ ] api/integrations/create should land in create_integration_landing page
[ ] Click the buttons to ensure they go to the correct pages
[ ] Check RBAC: if the fleet or integrations capabilities are missing we show the callout and the buttons do not exist
[ ] Check availability: license paywall appear when the license does not allow using the integration assistant, and the buttons do not exist

Connectors

[ ] If there are no connectors added , It should be possible to add a new connector

Create Integration Upload

[ ]

Create Integration Assistant

[ ] Check RBAC: in the connectors step, the capabilities for the connectors are missing the callout should appear. Buttons disabled

Serverless

[ ] Check availability: In Security Serverless environment with "Security Essentials" tier should not allow using the auto import.

elasticmachine commented 3 weeks ago

Pinging @elastic/security-scalability (Team:Security-Scalability)

bhapas commented 1 week ago

From discussions with @elastic/security-engineering-productivity looks like playwright implementation takes more effort.

Hence moving on with Cypress based testing to get this in before 8.16

bhapas commented 4 days ago

The decision is to add the cypress tests for Automatic Import under https://github.com/elastic/kibana/tree/main/x-pack/plugins/fleet/cypress since it is offered in both Security and Observability solutions.

elastic / kibana