markusdumke / reinforcelearn

R Package for Reinforcement Learning
https://markusdumke.github.io/reinforcelearn/
Other
33 stars 6 forks source link

sarsa on mountaincar leads to uninformative error - because we have no func approx #17

Closed berndbischl closed 6 years ago

berndbischl commented 6 years ago

MRE:

package.path = system.file(package = "reinforcelearn")
path2pythonfile = paste0(package.path, "/gym_http_server.py")
system2("python", args = path2pythonfile, stdout = NULL,
  wait = FALSE, invisible = FALSE)

env = makeEnvironment("MountainCar-v0")

res = sarsa(env, n.episodes = 50)

Error in matrix(0, nrow = n.states, ncol = envir$n.actions) : non-numeric matrix extent