howard36 / probase

An online math contest platform
https://probase.app
MIT License
17 stars 1 forks source link

Feature request: anti-laziness features for testsolvers #80

Open vEnhance opened 10 months ago

vEnhance commented 10 months ago

Proposal:

We have an issue with people who just want to look at the problems but don't actually want to put in the effort to testsolve them which is ruining the feedback system.

vEnhance commented 10 months ago

Maybe preventing quitting testsolves is a bit draconian since i guess sometimes the problem sucks or the author fucked up the answer.

I just think there should be some mechanism preventing people from just like recklessly creating and terminating testsolving sessions (e.g. rate limit).

vEnhance commented 9 months ago

just to reiterate the proposal from Discord:

Let everyone pick a role upfront: casual or serious

For casual testers:

The "official" solves come from serious testers, who provide real data on problem difficulties.

I like this suggestion. I propose the names "casual" and "hardcore". And in the acknowledgments we'd split those by role (hardcore is a lot more work, so I'd like to give extra shout-out to people who are willing to do it).

vEnhance commented 9 months ago

I think we can also allow hardcore => casual after people are satiated from testsolving and want to cruise through the rest of the list to see what else they did.

So maybe for acknowledgments, we'd include a special shout-out to everyone who solved at least N problems / M bulbs correctly before switching to casual, and then include everyone in the general testsolver list.