centrica-engineering / muon

Versatile token based web components for Design Systems
https://main--61dd6b0ee46d9a004ac27873.chromatic.com
ISC License
2 stars 0 forks source link

[EPIC] Muon Regression tests #104

Closed PraveenAsokan closed 2 years ago

PraveenAsokan commented 2 years ago

Outcome

To confirm and capture the tests that we should do apart from unit and CI tests for the muon components and for beta release.

Scope

We have integrated cucumber with cypress and completed the BDD and test steps for below components

PraveenAsokan commented 2 years ago

As discussed with Jon, cypress automation framework would be the best pick as it contains multiple plugins, web and component testing, and visual testing as well. - https://www.cypress.io/

Test coverage for muon

(as per the initial discussion and might be more to be added in it)

Note - All the tests should be performed in different browsers and devices (cross-browser testing)

Testing scope for beta release

@jholt1 - If any of my above understanding is wrong, please feel free to add/update the points.

PraveenAsokan commented 2 years ago

Initial cypress setup for Beta release

PR - https://github.com/centrica-engineering/muon/pull/131

PraveenAsokan commented 2 years ago

Cypress framework setup with Cucumber BDD has been done and added the BDD steps and tests for CTA, icon, and inputter.

PraveenAsokan commented 2 years ago

I had a discussion with Jon and he helped me to fix some terminal errors and to know other options in cypress to run the tests. I tried to integrate the Allure report to the cypress and it's working now. I'll need to get this PR approved and merge it with main branch.

PraveenAsokan commented 2 years ago

Browserstack setup in cypress

I completed the setup to run the cypress BDD tests in Browserstack (Cross-browser testing) and tried to execute the tests. But I was facing some issues that skips all the tests in the run. Then it's resolved with the help of the Browserstack team. Now, the tests are running as expected in local, but the same is failing in the Browserstack build by throwing some step implementation error. I'll send the screenshot of the error to the Browserstack team to see if I get any help from them.

PraveenAsokan commented 2 years ago

The BrowserStack issue has been resolved and it's working with cypress as expected.

Separate ticket raised for BrowserStack integration - https://github.com/centrica-engineering/muon/issues/205 PR for the same - https://github.com/centrica-engineering/muon/pull/178

PraveenAsokan commented 2 years ago

Removed Review needed label as the separate ticket raised for BrowserStack mentioned above

PtitBen commented 2 years ago

Closing this as per standup conversations today and last Thursday