The part testing tab's answer widget doesn't seem to update when the variables change, for custom parts

christianp commented 5 months ago

I noticed this with the spreadsheet extension. It might just be the spreadsheet widget that has this problem.

christianp commented 3 months ago

It seems that the testing tab is generally out of date quite often: I've noticed the feedback messages and score not matching. There are also two copies of the feedback on a part with alternatives, which shouldn't happen.

christianp commented 3 months ago

There's an inconsistency in how alternatives are used.

The routine at the moment is:

the part is submitted with part.submit.
part.markAlternatives is called, to get the name of the alternative used, if there is one.
the displayed score comes from the first call to submit, while the feedback messages come from the markAlternatives call.

If any of the main part or the alternatives' marking algorithms behave randomly, then the feedback can end up not matching.

I think that we should change Part.submit so that the best_alternative is saved, so we don't have to call markAlternatives again.

christianp commented 3 months ago

After these changes, I'm going to mark this as completed, until and if I find a custom part type which has problems.

numbas / editor

The part testing tab's answer widget doesn't seem to update when the variables change, for custom parts #814