gpuweb / cts

WebGPU Conformance Test Suite
https://gpuweb.github.io/cts/
BSD 3-Clause "New" or "Revised" License
121 stars 72 forks source link

`npm test` is failing with `Generated test variant would produce too-long -actual.txt filename` #3676

Closed ben-clayton closed 2 months ago

ben-clayton commented 2 months ago
Running "run:write-out-wpt-cts-html-chunked2sec" (run) task
Error: Generated test variant would produce too-long -actual.txt filename. Possible solutions:
- Reduce the length of the parts of the test query
- Reduce the parameterization of the test
- Make the test function faster and regenerate the listing_meta entry
- Reduce the specificity of test expectations (if you're using them)
webgpu:shader,validation,expression,call,builtin,textureLoad:texture_type,non_storage:testTextureType="texture_storage_1d%3Crgba8unorm,%20read%3E";textureType="texture_multisampled_2d";*
    at assert (/home/ben/src/dawn/third_party/webgpu-cts/src/common/util/util.ts:37:11)
    at /home/ben/src/dawn/third_party/webgpu-cts/src/common/tools/gen_wpt_cts_html.ts:222:15
ben-clayton commented 2 months ago

Issue only occurs when listiing_meta.json is updated to include the new webgpu:shader,validation,expression,call,builtin,textureLoad tests. This is updated automatically with run-cts.

greggman commented 2 months ago

On it.

But, was some build step removed? npm test used to complain if a test was missing from listing_meta.json so it wouldn't have committed before. @kainino0x ?

kainino0x commented 2 months ago

But, was some build step removed? npm test used to complain if a test was missing from listing_meta.json so it wouldn't have committed before. @kainino0x ?

3548

kainino0x commented 2 months ago

This is updated automatically with run-cts.

Beware run-cts producing a number that's way too big: https://crbug.com/dawn/2468

ben-clayton commented 2 months ago

Fixed.