JuliaPOMDP / POMDPs.jl

MDPs and POMDPs in Julia - An interface for defining, solving, and simulating fully and partially observable Markov decision processes on discrete and continuous spaces.
http://juliapomdp.github.io/POMDPs.jl/latest/
Other
657 stars 100 forks source link

belief-dependent transition function #439

Closed gdaddi closed 1 year ago

gdaddi commented 1 year ago

Hi,

Is there a way to implement a transition function that depends on the belief state? I checked the source code of both POMDPs and QuickPOMDP and there does not seem to be an obvious way of doing it. Thank you! This is the pseudocode of what I'm trying to do:

    transition = function (s, a, b)
        if mean(particles(b)) < X:
            # transitionA
        else:
            # transitionB
        end
        # return new state 
    end,