search

JuliaPOMDP / RockSample.jl

Implement the rock sample problem using POMDPs.jl
Other
5 stars 5 forks source link

Solving using QMDP #17

Closed pparmesh closed 3 years ago

pparmesh commented 3 years ago

Hi, I'm trying to solve the example problem using QMDP and it looks like the simulation (or generated policy) gets stuck once it takes a measurement action. Any solver/problem settings that I might be missing?

zsunberg commented 3 years ago

I don't think you should need to change any settings for QMDP to work. It may produce some bad policies because QMDP is, in general, suboptimal though.

You may have more luck finding some help if you post a few more details, and the POMDPs.jl discussion page (https://github.com/JuliaPOMDP/POMDPs.jl/discussions) is more popular.

MaximeBouton commented 3 years ago

Rock sample requires some information gathering action, so I don't expect QMDP to work well on this problem, a discussion would be more appropriate.