Prioritized sweeping does not correctly max over the action transitions when a state is a successor to itself

beniz / hmdp

hmdp is a C++ library and tools for solving Markov Decision Processes (MDPs) with hybrid discrete and/or continuous state-spaces.

Apache License 2.0

23 stars 4 forks source link

Open beniz opened 10 years ago

beniz commented 10 years ago

pred_hst->setPriority((*pit).first*hst->getResidual());

in HmdpEngine.cc is the culprit.