Closed bboudaoud-nv closed 1 year ago
In reviewing this I noticed that the correctAnswer
was something I naively assumed would show up in the results db next to the answers in the Questions
table, but it isn't printed there. Since the correct answer was only included to provide user feedback, it makes sense that we wouldn't record it.
@joohwankimNV , would you prefer that the correct answer showed up in the Questions
table, or is it okay for us to just use the traditional style to figure that out? It's probably worth having you try to run a pilot to see if you can get the analysis you want out of this.
I confirmed with Joohwan that the correct answer does not need to appear in the Questions table.
This branch adds support for "tasks" in FPSci. The new heirarchy of experiments is as shown below:
Old configuration files still provide the same experience by using the
count
from thetrials
array to generate tasks when notasks
array is specified. In this model eachtrial
from prior configs becomes atask
of its own.The new model allows for a
tasks
array to be specified with the following structure: