Closed mirenradia closed 9 months ago
This is a limitation actually of all the options that dynamically generate new tests, such as --repeat
, --distribute
and --parameterize
. There are two problems that prevent restoring such tests:
-c
along with the --restore-session
in order to force reframe to look into a specific path for tests, no test will be restored either. The reason is that these automatically generated tests are technically different from their parents (they are derived parameterized tests which simply have the same base name). So reframe cannot match them to any of the loaded tests in order to restore them.We will need to update the docs to reflect this behaviour.
Now, if you really want session restore to support automatically generated tests, I suggest opening a separate feature request.
Now, if you really want session restore to support automatically generated tests, I suggest opening a separate feature request.
OK, I've created a separate issue for the feature request: #3077.
When I run a benchmark with a command such as
and one of the runs fails, doing
finds 0 checks so I see
This doesn't seem to be a problem when one of the runs fails without the
--repeat
flag.Please find attached two consecutive ReFrame reports demonstrating this issue: