Add QIT Custom E2E support and migrate tests

iamdharmesh commented 4 days ago

Issue: #2723

Description

This PR introduces initial support for QIT Custom E2E tests and migrates existing E2E tests to the QIT framework, enabling them to run in the QIT environment.

This is the first step towards adding integration tests to the workflow. QIT Custom E2E tests allow us to run tests for other plugins. This enables us to check plugin compatibility by running tests with specific plugins activated and configured.

Key Changes

Support for QIT Custom E2E Tests: Added QIT integration to enable Custom E2E testing.
Migration of Existing E2E Tests: Migrated current tests to QIT and added GitHub Action workflow for run E2E tests
Initial Compatibility Testing: Implemented compatibility tests with the "WooCommerce Stripe Payment Gateway" plugin in GitHub Action.
New Workflow for Upload test tags: Added a GitHub Action workflow to upload test tags to QIT upon release. Tests are categorized into:
- default: All E2E tests.
- subscriptions-tests: Tests for subscriptions functionality.

[!NOTE] Some E2E tests are skipped because they require an in-depth checking of the current errors they encounter. Therefore, they are excluded from this initial PR and can be revisited later.

Steps to Test

Run npm run build.
Copy the file /tests/qit-e2e/config/.env.example to /tests/qit-e2e/config/.env.
Add the credentials in the .env file.
Run npm run test:e2e-local and make sure that tests are running properly and are passing.
Make sure that the "QIT E2E tests" action is passing. (This is PR from fork repo so, This GH action will not successfully run here, you can verify it from PR here)

Documentation

[ ] This PR needs documentation (has the "Documentation" label).

Changelog Entry

Dev - Added QIT Custom E2E tests support and migrated tests to QIT

Closes #2723.

iamdharmesh commented 3 days ago

@dkotter I am not able to request a review from you due to access constraints here, But this is ready for your review.

vikrampm1 commented 1 day ago

@woocommerce/quark this PR is ready for your review (we have limited access and unable to request review).

jeffpaul commented 7 hours ago

@zhongruige @luc45 FYI this is also up for your review on approach / code review feedback

annemirasol commented 6 hours ago

@iamdharmesh @vikrampm1 To avoid impacting development that are currently underway for Stripe and Paypal, we created a new repo for hosting the new QIT tests. Could we move these tests to https://github.com/woocommerce/woocommerce-gateway-integration-qit, please?

cc @diegocurbelo

woocommerce / woocommerce-paypal-payments