JuliaPOMDP / POMDPs.jl

MDPs and POMDPs in Julia - An interface for defining, solving, and simulating fully and partially observable Markov decision processes on discrete and continuous spaces.
http://juliapomdp.github.io/POMDPs.jl/latest/
Other
652 stars 99 forks source link

updater for ValuePolicy #548

Open zsunberg opened 1 month ago

zsunberg commented 1 month ago

As noted here: https://github.com/JuliaPOMDP/POMDPs.jl/discussions/546#discussioncomment-9283721 ValuePolicy does not have an updater method. It seems like it should just be a DiscreteUpdater. We should also consider the appropriate action method for ValuePolicy with a POMDP, which, I suppose, should just return the QMDP action.