search

mhahsler / pomdp

R package for Partially Observable Markov Decision Processes
16 stars 5 forks source link

Convergence problem #11

Closed haniees closed 2 years ago

haniees commented 3 years ago

Hi,

I have a finite horizon problem that is not converging. I read in the manual that I should put the initial value function of zero in order to guarantee the convergence. Where can I add this to the code? should I add it in here? sol <- solve_POMDP(model = Total, discount = 0.99, method = "grid") if yes how?

Thanks

mhahsler commented 3 years ago

Please send me the code and data for Total again.