Score n/a for one of the subtasks when submitting for both subtasks at once.

[Aktsvigun]

Hi team,

Here is the link to my competition: https://www.codabench.org/competitions/3734/#/results-tab

When I submit results to both subtasks at once, the results for one of them are shown as n/a (kindly see the attached image) even though it provides valid results in the scores logs. Could you please investigate?

Thanks!

[Didayolo]

Hi @Aktsvigun,

Thank you for reporting the issue.

Have you tried the subtasks separately? Can you confirm that they work fine?

Related:

• 1540

[Aktsvigun]

Hi @Didayolo , thank you for your reply! They do work fine, however there is a caveat: once I submit the scores, say, for the task B, if I previously had some scores on the task A, they turn to be n/a. You can see in the competition that after I submitted my scores for only the subtask A, my results for task B are displayed as n/a

[Didayolo]

OK I get it now! Thank you for the clarification.

[Didayolo]

Right now, we consider that it is the intended behavior to have n/a scores when submitting to just one task. This kind of submissions can be useful as participants for testing purpose. To have a full row on the leaderboard, it is required to submit to all tasks. Having independent submissions is discussed as a feature suggestion here: #1334

To clarify this behavior, we need to add a warning here:

TODO

• [ ] Add "Submit to" before the drop down selector, like the "Submit as" (this is shown only when there are multiple tasks)
• [ ] Add a warning when at least one checkbox is unchecked. A red box message explaining that the unselected tasks will get n/a scores.

[Aktsvigun]

Dear @Didayolo , I agree with your comment, however, the problem is the n/a scores appear even if I submit to both tasks at once. As a result, currently, I cannot have my scores displayed for both tasks regardless of how I submit my solution: for both tasks at once or separately.

[Didayolo]

@Aktsvigun Oh OK, I did not get that. I need to test a bit to see if it is a general problem with multitask. Thanks for reporting it.

[Aktsvigun]

Hi @Didayolo , could you please tell me whether there are any updates here?

[Didayolo]

Hi @Aktsvigun, sorry right now I think nobody is working on this bug. I will try to bring it up soon. You can also contribute to it by yourself if you will (see contributing.md).