Does this library support continuous pomdp problems?

h2r / pomdp-py

A framework to build and solve POMDP problems. Documentation: https://h2r.github.io/pomdp-py/

MIT License

209 stars 49 forks source link

Does this library support continuous pomdp problems? #37

Open ShunanJiang opened 12 months ago

ShunanJiang commented 12 months ago

Seems the examples in the documentation are mostly discrete?

Many thanks!

zkytony commented 12 months ago

The base classes are general enough to allow defining continuous POMDPs (see light dark example), but currently there is no solver for them -- I just added an item for this in call for contributions!

If your continuous domain has a discrete action space, you should be able to still apply POUCT but it may not work well (flat tree, for example).