codewars / codewars.com

Issue tracker for Codewars
https://www.codewars.com
BSD 2-Clause "Simplified" License
2.09k stars 219 forks source link

Someone has been voting lots of beta katas `somewhat satisfied` without solving them #1174

Closed Voileexperiments closed 6 years ago

Voileexperiments commented 6 years ago

I recently have found that apparently there is someone (disgruntled?) who went on a spree to vote lots of beta katas somewhat satisfied without solving the kata at all. These votes weren't there at all until this week. It looks like a somewhat semi-targeted act:

(and probably many more, but you get the idea so I'm not gonna list them all)

Proof: look at the number of ranking votes vs. satisfaction votes, and number of solves. They all exhibit the pattern of n solves, n-1 rankings (one of the solves comes from the the author) but n votes, with all very satisfied except one.

The damage has been done. The thing we've conjectured some day to happen HAS BEEN HAPPENED. WE NEED TO DEAL WITH IT ASAP, i.e REMOVE THE ABILITY TO VOTE ON BETA KATAS ONE HASN'T SOLVED

(also please remove these votes)


Incidentally, given the final satisfaction rating, this person seems to have 2x voting power, so his honor is between 1000 and 2000.

docgunthrop commented 6 years ago

Related issue #1165

jhoffner commented 6 years ago

I've lowered white/yellow kata requirements to 80% and made it so that you can't vote unless you have completed the kata. These changes are in preview.

Note that a certain vote threshold is needed to get out of beta. Some users may have liked the kata but just got stuck on the last few tests, deciding to forfeit honor but ultimately voting very satisfied. Without these types of votes, its going to take longer to get out of beta.

One somewhat satisfied vote isn't going to make or break the satisfaction requirement but it will help get a kata to its required vote count faster, so if anything this guy probably helped the situation.

Regardless I've made the change and we can see how this affects things once I push it out later today.

Incidentally, given the final satisfaction rating, this person seems to have 2x voting power, so his honor is between 1000 and 2000.

Voting power didn't have anything to do with percentages, though there was a bug with how it affected the voting minimums which I've also fixed.

Additional, if a kata has 4 votes or more and a 0% satisfaction score, I'm going to auto retire it.

Voileexperiments commented 6 years ago

@jhoffner Thanks.

By the way:

One somewhat satisfied vote isn't going to make or break the satisfaction requirement but it will help get a kata to its required vote count faster, so if anything this guy probably helped the situation.

Even when that happens, the approval process is still bound by ranking votes anyways so it only helps if someone completed the katas and only ranked it.