numbas / Numbas

A completely browser-based e-assessment/e-learning system, with an emphasis on mathematics
http://www.numbas.org.uk
Apache License 2.0
202 stars 117 forks source link

In a gap-fill with "sort answers" enabled, the gaps should be sorted by expected answer #794

Open christianp opened 3 years ago

christianp commented 3 years ago

It's not obvious that the gaps need to be in order of expected answer. For example, if you have two number entry gaps with expected answers of 3 and 1, no ordering of answers will be marked correct because the lowest student answer will be marked against the first gap, whose expected answer is 3.

The gaps should be sorted by expected answer, so the first item in the sorted list of student's answers is marked against the gap whose expected answer sorts before the rest.

christianp commented 1 year ago

The difficulty is that there's no generic means of getting the expected answer as a JME token.

In fact, there are difficult cases even in just the number entry type: if the gaps are as follows:

how should the expected answers be sorted?

I think the "sort answers" option is misconceived, and there should instead be something like "try every permutation of the answers and take the highest credit"