search

JuliaPOMDP / POMDPs.jl

MDPs and POMDPs in Julia - An interface for defining, solving, and simulating fully and partially observable Markov decision processes on discrete and continuous spaces.
http://juliapomdp.github.io/POMDPs.jl/latest/
Other
671 stars 105 forks source link

Online Greedy Solver tutorial in docs is not very meaningful #319

Open zsunberg opened 4 years ago

zsunberg commented 4 years ago

Since it uses SimpleGridWorld and it gives reward for taking an action in a reward state, there is nothing interesting that the solver can figure out, i.e., if the grid world was 3 x 1, you could do

action(planner, GWPos(3,1))

and it would still output :right

dylan-asmar commented 8 months ago

@zsunberg, can you provide a link/reference to where this issue is in the docs? The only thing I can find is the online solver example (https://juliapomdp.github.io/POMDPs.jl/latest/online_solver/). In my last update, I added a heuristic policy example (https://juliapomdp.github.io/POMDPs.jl/latest/example_solvers/#Heuristic-Policy) but I'm not sure that addresses this issue.