Validate baseline PPHC ability to approximate underlying DECA coordinates system

cereal-lab / EvoPIE

Evolutionary Peer Instruction Environment

1 stars 0 forks source link

Validate baseline PPHC ability to approximate underlying DECA coordinates system #79

Open profgrumpy opened 2 years ago

profgrumpy commented 2 years ago

[x] Finish code to simulate student interactions based on a DECA coordinate system.
[x] run experiment on simulated student interaction data to ensure that PPHC is able to approximate the underlying DECA coordinate system.
[x] Update overleaf paper accordingly
[x] Make sure to emphasize the differences in our implementations vis-a-vis the original algorithm; e.g., mutations, other implementation specifics since the code reformulates the algorithm a bit.

dvitel commented 2 years ago

First version of synth_deca_axes, synth_deca_spanned was committed. TBD mapping of dimensions to StudentKnowledge

dvitel commented 2 years ago

I am closing this issue for now. Experiment was done and paper is on overleaf. We could create separate tickets for other experiments.

dvitel commented 1 year ago

Experimentation of PPHC with slightly changed behavior on Pareto non-dominance did not give better results than initial PPHC. The idea was to move from strategy of leaving parent on non-dominance to strategy of leaving least evaluated individual (basically child). The results are similar: PPHC-1-2-1-3 is not better/slightly better that RAND-3 and worse than RAND-5. Changes are possibly statistically insignificant. Conclusion: we need to go to different schema how algorithm could "move" towards best knowledge discovery. I reopen this ticket to continue the experimentation.