sail-sg / envpool

C++-based high-performance parallel environment execution engine (vectorized env) for general RL environments.
https://envpool.readthedocs.io
Apache License 2.0
1.1k stars 100 forks source link

[Feature Request] Have a render() function exposed for Gym environments to see agent performance #304

Open bmcnns opened 6 months ago

bmcnns commented 6 months ago

Motivation

When I'm training a RL model cumulative reward isn't always a true indicator of model performance. It's helpful for me to be able to see how an agent is interacting with the environment to ensure that the training performance is matching my expectation.

Solution

Ideally, I'd like to have a method of visualizing the environments. In particular the Gym, ALE, and Mujoco environments. Individually, these environments typically expose a render() function of RGB output. Are these methods exposed in the envpool implementation?

Alternatives

None come to mind.

Additional context

Checklist