UCL-ARC / shortlister

0 stars 1 forks source link

Allow the user to compare candidates pairwise and record the results #69

Open tamuri opened 4 days ago

tamuri commented 4 days ago

The tool will run a "tournament" where applicants are compared in pairs, and the results of the comparisons are used to determine overall ranking.

  1. Take a list of applicants
  2. Conduct pairwise comparisons between applicants
  3. Rank applicants based on the comparisons

Step 1: Implement pairwise comparison logic

This should be a separate module (e.g. tournament.py) that can do the comparisons on any object (e.g. any items in a list). Don't design it specifically for the shortlister model or applicants.

Build the logic:

Step 2: Ranking algorithm

Step 3: Integrate into shortlister tool

shiyingwucl commented 4 days ago

A few questions after I started to outline the code:

tamuri commented 4 days ago

What format would the data come in? (considering its not specifically for the shortlister)

A list of items, you don't know what they are, but they are printable: e.g. [682, 619, 807, 161] or ["lorem", "ipsum", "dolor"]

Should there be any conditions when generating the pair, or just randomly?

You need a system such that you can do the ranking - what are the options? While random is okay, you could end up getting the same pair to rank.

tamuri commented 4 days ago

Addition: we can assume that the input list has some kind of preliminary order that we are looking to refine. That might influence the logic to generate the pairs.