Implement lazy approximation

beniz / hmdp

hmdp is a C++ library and tools for solving Markov Decision Processes (MDPs) with hybrid discrete and/or continuous state-spaces.

Apache License 2.0

23 stars 4 forks source link

Implement lazy approximation #1

Open beniz opened 10 years ago

beniz commented 10 years ago

Implement the lazy approximation scheme described in Li & Littman 2005 (1).

(1) Lihong Li and Michael L. Littman: Lazy approximation for solving continuous finite-horizon MDPs. In AAAI-05, pages 1175-1180, Pittsburgh, PA, 2005. See http://www.research.rutgers.edu/~lihong/research/publications.html for PDF of both the articles and the slides.

beniz commented 10 years ago

This first requires working out the PWCxPWC = PWL operation. Should be able to do so within BspTreeOperations.cc by defining a PWC / PWC -> PWL schema, and writing the required in cell operation (cf. BspTreeOperations.cc:518).