artilleryio / artillery

The complete load testing platform. Everything you need for production-grade load tests. Serverless & distributed. Load test with Playwright. Load test HTTP APIs, GraphQL, WebSocket, and more. Use any Node.js module.
https://www.artillery.io
Mozilla Public License 2.0
8.04k stars 511 forks source link

Why is there no support for Playwright Assertions? #2450

Closed ATheCoder closed 9 months ago

ATheCoder commented 9 months ago

Basically what the title says. If we omit playwright assertions how do we know that things work properly under load?

hassy commented 9 months ago

hi @ATheCoder 👋 there's an example using expect() calls here:

https://github.com/artilleryio/artillery/blob/main/examples/browser-playwright-reuse-authentication/flow.js

If any of those fail Artillery will report a failed VU with the vusers.failed metric.

From then on you'd look at monitoring & tracing data - either Artillery's traces (https://www.artillery.io/blog/end-to-end-tracing-for-playwright-tests) or traces produced by the app you're testing.