markusdumke / reinforcelearn

R Package for Reinforcement Learning
https://markusdumke.github.io/reinforcelearn/
Other
33 stars 6 forks source link

it would be nice if states and actions have string names #16

Closed berndbischl closed 6 years ago

berndbischl commented 6 years ago

eg look here:

env = windyGridworld()
res = sarsa(env, n.episodes = 30)
head(res$Q1)
> head(res$Q1)
       [,1]   [,2]   [,3]   [,4]
[1,] -4.689 -4.662 -4.745 -4.730
[2,] -4.935 -5.053 -5.032 -4.924
[3,] -5.463 -5.498 -5.602 -5.436
[4,] -6.202 -6.575 -6.271 -6.344
[5,] -6.968 -7.036 -7.005 -6.958
[6,] -7.403 -7.534 -7.569 -7.570
> 

at least the actions are "down, up, left right". would be nice if i can specify this during env construction and that these names are used then?

markusdumke commented 6 years ago

It is now possible to give string names for actions:

env = makeEnvironment("gym", gym.name = "MountainCar-v0", 
  action.names = c("accelerate" = 2L, "stop" = 0L, "do nothing" = 1L))
env$step("accelerate")