drbenvincent / darc_toolbox

Run adaptive decision making experiments
MIT License
16 stars 2 forks source link

Implement heuristics for restricting design space #11

Closed drbenvincent closed 6 years ago

drbenvincent commented 6 years ago

Following on from #2, I need to implement the heuristic component for DARC tasks. This takes the set of all possible designs and shrinks the set of designs to be entered into the design optimisation procedure on a trial-to-trial basis.

The plan is still to implement what Tom wrote here in Matlab. However, that was based on all models being subjective value models, and so you could compute VA and VB for each prospect. Tom's code assumes we can access the design variable VB-VA and also VB+VA. But this is no longer the case when we consider our broader class of models... we now have attribute-wise models which simply don't operate by assessing the subjective value of each prospect. But all models do have a decision_variable axis... just not necessarily an easy way to specify orthogonality from the decision_variable.

Stuff to be addressed in other Issues

drbenvincent commented 6 years ago

The heuristics I've added so far (removal of already asked designs, removal of highly predictive designs) has already helped a lot. Doing a few tests shows a big improvement in the design selection and tightness of the posterior

drbenvincent commented 6 years ago

Basic set of heuristics done. Need to implement the more clever stuff. See #27