search

rlworkgroup / garage

A toolkit for reproducible reinforcement learning research.
MIT License
1.84k stars 309 forks source link

Use Simulink as environment in Garage #2296

Closed mehrdad-moradi closed 2 years ago

mehrdad-moradi commented 2 years ago

Can we couple Simulink and Gym and use the Simulink model as an environment for Garage?

krzentner commented 2 years ago

You may be able to, if you can make it use the Gym API. One thing that is somewhat tricky is that Garage tends to make copies of the environment object, which can be difficult to implement. You may find it helpful to use only a single worker (set n_workers=1 when constructing the sampler) to avoid difficulties with multiple environment objects connecting to the same simulink model.

Unfortunately I can't provide detailed instructions for how to set up Simulink with the Gym API.