code-423n4 / org

Code4rena Governance and Discussion
71 stars 17 forks source link

Proposal - Additional grade for bot contests #102

Open trust1995 opened 1 year ago

trust1995 commented 1 year ago

Currently, the three grades are: A - High-value report B - Satisfactory report (eligible for rewards) C - Unsatisfactory report (not eligible for rewards, warning/disqualification)

Two Cs disqualify bot crews for future races. I believe the grading system lacks a middle tier between B and C, and propose the following structure: A - High-value report B - Satisfactory report (eligible for rewards) C - Unsatisfactory report (not eligible for rewards, no negative impact) D - Particularly low quality report (not eligible for rewards, warning/disqualification)

The proposed tier system is less punishing for newer bots who are being improved but don't have too much to show as of yet. It will also make judging more fine-grained. Judges will not feel the need to upgrade a strong C to a B to not disqualify a crew, which has the side effect of diluting the pot.

Happy to hear thoughts.

ezcodeslide commented 1 year ago

As someone working on a bot and trying to catch up with the established players, I appreciate this: "The proposed tier system is less punishing for newer bots who are being improved"

IllIllI000 commented 1 year ago

Presumably, everyone still in the qualifiers is also trying to catch up. What is the advantage of letting some stay in the rotation over letting others cycle in? They only get pushed out if someone in the qualifiers does better.