We currently have a subset of models to test E2E performance. We need similar subset for E2E accuracy tests. If the E2E accuracy workflow started with the subset, it should check that all models in the subset passed the accuracy check.
Periodic E2E jobs (E2E accuracy, Try latest PyTorch) need to use the subset mode to catch regressions early.
We currently have a subset of models to test E2E performance. We need similar subset for E2E accuracy tests. If the E2E accuracy workflow started with the subset, it should check that all models in the subset passed the accuracy check.
Periodic E2E jobs (E2E accuracy, Try latest PyTorch) need to use the subset mode to catch regressions early.