Open juliandescottes opened 1 year ago
More specifically, the problem is the ::
parsing. When adding another parameter, namely abc::com
, the test name shows up as com]
in the metadata, likewise.
This might be the fundamental test_id behaviour of pytest
. There's an ids
argument to paramterize
: https://docs.pytest.org/en/latest/reference/reference.html#pytest.Metafunc.parametrize
Mentioned by @thiagowfx at https://github.com/web-platform-tests/wpt/commit/bb6cf97f8d49604f274c019253ea6b08d2140464#r125054097
The following test is using "::1" as parametrized value: https://github.com/web-platform-tests/wpt/blob/3df1ed2d3a57ca4853ce996697fe7d8e9cfaa502/webdriver/tests/bidi/network/add_intercept/invalid.py#L138-L139
Logged at https://community-tc.services.mozilla.com/tasks/AUsx8q5ORmmu4f6J5rcjuA/runs/0/logs/public/logs/live.log#L10120
But when written in the wpt_report.json, the first part of the name gets removed, only
1]
remains. wpt_report for the same job: https://community-tc.services.mozilla.com/api/queue/v1/task/AUsx8q5ORmmu4f6J5rcjuA/runs/0/artifacts/public%2Fresults%2Fwpt_report.json.gz . Relevant part: