RagnarGrootKoerkamp / BAPCtools

Tools for developing ICPC-style programming contest problems.
GNU General Public License v3.0
49 stars 22 forks source link

Testgroup verdicts #358

Closed thorehusfeldt closed 5 months ago

thorehusfeldt commented 7 months ago

Properly determine the verdicts for each testgroup.

thorehusfeldt commented 6 months ago

@mpsijm : thanks for 28f9c457ef27aabe446db00670f0205adc59806e, I was writing almost the same code.

The directory mixed remains a problem and currently breaks pytest on hello.

mpsijm commented 6 months ago

@thorehusfeldt No problem! :smile: And it looks like the mixed directory is processed just fine, there was just an empty @EXPECTED_RESULTS@: string in one of the submissions. :joy: Let's see if that fixes it :slightly_smiling_face: (EDIT: it does! :partying_face: )

mpsijm commented 5 months ago

I've re-implemented lazy judging and changed it from "stop as soon as parent verdict is known" to "stop when one of the runs gets aborted" (unless -v or --table is given, of course). While I was at it, I also changed the displayed run time to be the slowest rejected test case (or, if the submission is AC, the slowest AC test case). Does anybody wants to do a double-check before we merge? :slightly_smiling_face: