Open braingram opened 2 days ago
During downloading results okify uses a "--flat" option: https://github.com/spacetelescope/jwst/blob/57f6148f16e49025927d76a3b61d351b2c49f0ae/jwst/scripts/okify_regtests.py#L110-L114 which results in overwriting "spec" files for tests with matching names. When multiple tests fail that share the same name this results in only 1 of the failures being okified.
For example, this run: https://bytesalad.stsci.edu/ui/repos/tree/General/jwst-pipeline-results/2024-11-20_GITHUB_CI_Linux-X64-py3.12-1006 when run with okify_regtests results only allows okifying 2 instead of 3 failures.
During downloading results okify uses a "--flat" option: https://github.com/spacetelescope/jwst/blob/57f6148f16e49025927d76a3b61d351b2c49f0ae/jwst/scripts/okify_regtests.py#L110-L114 which results in overwriting "spec" files for tests with matching names. When multiple tests fail that share the same name this results in only 1 of the failures being okified.
For example, this run: https://bytesalad.stsci.edu/ui/repos/tree/General/jwst-pipeline-results/2024-11-20_GITHUB_CI_Linux-X64-py3.12-1006 when run with okify_regtests results only allows okifying 2 instead of 3 failures.