search

algorithmsbooks / decisionmaking

Algorithms for Decision Making textbook
516 stars 53 forks source link

How should the problem be defined? #77

Closed AlexandrParkhomenko closed 3 years ago

AlexandrParkhomenko commented 3 years ago

Hello. I have another question about basic things. There is an Example 10.1 on Page 213

b, d, n_rollouts = Normal(0.3,0.1), 10, 3
U = MonteCarloPolicyEvaluation(𝒫, b, d, n_rollouts)

ERROR: LoadError: UndefVarError: 𝒫 not defined

Please explain how should the problem be defined?

tawheeler commented 3 years ago

Hello Alexandr,

The method takes an MDP struct as defined in alg 7.1: Selection_355

That being said, because we don't use type templating you can use any struct that provides the necessary fields.

In other parts of the book, problems may be POMDPs, simple decision problems, or search problems. It should generally be clear from context, and the algorithm's description.

Cheers, -Tim

tawheeler commented 3 years ago

Also, the DecisionMakingProblems.jl repo contains implementations for the problems used in the book.