search

Nakiami / mellivora

Mellivora is a CTF engine written in PHP
GNU General Public License v3.0
441 stars 171 forks source link

Scoring based on time of submission #67

Open ebdavison opened 8 years ago

ebdavison commented 8 years ago

It would be a good to have partial/full grading depending on time of answer submission so that the first answer gets full credit, second gets 90% credit, third places gets 75% credit and everyone else gets 50% credit. The percentages should be configurable in the Manage menus. This would help prevent ties.

0x90n commented 8 years ago

This is an interesting case study. We trialed this scoring method when holding a CTF for a conference and found it resulted in a number of intrresting outcomes including challenge avoidance. If you follow this path, ensure your CTF is a formative assessment rather than summative; or in other words, a test of skills rather than trying to teach skills.

When teaching weve found it better to have flat, equal playing field. When testing we can allow for score adjustments with some consideration of the players and their ability levels.

ebdavison commented 8 years ago

Interesting perspective. We are going to use this for a security conference to test ability to find the flags rather than for teaching. Maybe an option to use flat scores or graduated scores would work.