BabylonJS / Babylon.js

Babylon.js is a powerful, beautiful, simple, and open game and rendering engine packed into a friendly JavaScript framework.
http://www.babylonjs.com
Apache License 2.0
23.09k stars 3.41k forks source link

Experimental performance tests using playwright #15152

Closed RaananW closed 4 months ago

RaananW commented 4 months ago

This moves experimental performance testing to playwright.

It will run the defined scene N frames, M times (N = 1000, M >=5). Threshold is currently at 5% but is fully configurable. At the moment only 3 scenes are defined (simple scene, particles, and the performance scene).

It allows testing against any previous version (after v5.71.0) and against current master.

Next step it testing this procedure on browserstack.

bjsplat commented 4 months ago

Please make sure to label your PR with "bug", "new feature" or "breaking change" label(s). To prevent this PR from going to the changelog marked it with the "skip changelog" label.

bjsplat commented 4 months ago

Reviewer - this PR has made changes to one or more package.json files.

bjsplat commented 4 months ago

Snapshot stored with reference name: refs/pull/15152/merge

Test environment: https://babylonsnapshots.z22.web.core.windows.net/refs/pull/15152/merge/index.html

To test a playground add it to the URL, for example:

https://babylonsnapshots.z22.web.core.windows.net/refs/pull/15152/merge/index.html#WGZLGJ#4600

Links to test babylon tools with this snapshot:

https://playground.babylonjs.com/?snapshot=refs/pull/15152/merge https://sandbox.babylonjs.com/?snapshot=refs/pull/15152/merge https://gui.babylonjs.com/?snapshot=refs/pull/15152/merge https://nme.babylonjs.com/?snapshot=refs/pull/15152/merge

To test the snapshot in the playground with a playground ID add it after the snapshot query string:

https://playground.babylonjs.com/?snapshot=refs/pull/15152/merge#BCU1XR#0

bjsplat commented 4 months ago

WebGL2 visualization test reporter:

https://babylonsnapshots.z22.web.core.windows.net/refs/pull/15152/merge/testResults/webgl2playwright/index.html

bjsplat commented 4 months ago

Visualization tests for WebGPU (Experimental)

https://babylonsnapshots.z22.web.core.windows.net/refs/pull/15152/merge/testResults/webgpuplaywright/index.html