search

carykh / PrisonersDilemmaTournament

Watch This Place's awesome video about iterated Prisoner's Dilemma for context! https://www.youtube.com/watch?v=BOvAbjfJ0x0
MIT License
205 stars 160 forks source link

Number of strategies per user #13

Closed cornelg7 closed 3 years ago

cornelg7 commented 3 years ago

Are we allowed to submit multiple strategies?

Quadrapod commented 3 years ago

Probably not for quite a few reasons.

The google form simply doesn't allow duplicate submissions.

Allowing multiple submissions per user would somewhat undermine the experiment's goal of finding out something about individuals and their personal biases when approaching a game theory type problem.

The tournament setting will involve all the submissions competing against one another in one giant pool which has O(n+9)^2 execution time. Allowing just one additional submission per participant would significantly hamper the execution time.

Because all the submissions are in the same pool and your performance is judged on an average it allows exploitation of the system by having multiple submissions interact. In an extreme case consider if I submitted a thousand scripts which all listened for the first 10 inputs like a password then if the got it right always cooperate otherwise always defect. That way against competitors who didn't know the password their average score would go down and against your own scripts who did know their average score would go up.

There's just no reasonable way multiple submissions can be allowed I think.

D0V4HKIIN commented 3 years ago

i was thinking of putting my strategies in a zip file i can upload them all at once together so he can clearly see they don't have weird password recognition.

Quadrapod commented 3 years ago

Password recognition was an extreme case. All that you have to do is submit strategies which have a better interaction with each other than the average to get an advantage. For example you could submit 4 detective style strategies that look for different things and a TFT style strategy that defects first. The basic detective is forgiving of early defection during the testing phase so your TFT will do better than average against them. Hence you've given yourself an advantage with reasonable looking strategies.

As well the google form specifically limits you to a .py file as your submission.

carykh commented 3 years ago

Yeah, only one strategy per Gmail account is allowed. (Since you can only fill out the form once.) There are already a lot more strategies than I expected, so I wanna make sure everyone has an equal shot at winning!