Closed TheButlah closed 5 years ago
Quite a while ago we determined that there will be no formal Environment
class as part of our framework. It will instead be structured in a way independent of the particular environment class. Because we need the agent to have some set API it can depend on, it currently seems most likely that we will either interact with the environment using the OpenAI environment api, or else the experiment code will handle the interaction of the agent and environment (less likely)
After building BatchedEnv
, it became clear that only duck typing is necessary. As long as an environment can expose the same basic API as a Gym environment, the code will work. If it didn't, you would get an exception and it would crash.
Our
Environment
class was originally just going to wrap the OpenAI environments. However, I can't help but feel that it might be better forEnvironment
to extend from them. What are people's thoughts? I can think of the following benefits of incorporating theEnvironment
class into an OpenAI compatible system:Drawbacks: