Closed ihsaan-ullah closed 7 months ago
I think it makes sense that the tests are failing. I guess the tests need to be adapted to match this change.
@ihsaan-ullah
I encountered a problem while testing this on the test server.
Here is the test competition: https://codabench-test.lri.fr/competitions/143
Here is what I did:
When the final phase started, the two submissions got run, so the change worked (only leaderboard submissions got run).
In the logs, I can find the scores and everything, so the submissions worked well:
However, on the final phase leaderboard, the scores are N/A and the detailed results lead to 404 error:
I think this problem is not related to the change I made because we have never tested auto migration. Or maybe you have tested auto migration before?
I am not sure but I think someone has reported this before
OK, I had the impression it worked before but I'm not sure. I'll open another issue about it.
Indeed, it's here:
@ mention of reviewers
@Didayolo
A brief description of the purpose of the changes contained in this PR.
Previously, all submissions of a phase were migrated to a new phase in the auto-migration.
NOW, only leaderboard submissions will be migrated
Issues this PR resolves
1182 -> Auto-migration
Test
Checklist