sail-sg / envpool

C++-based high-performance parallel environment execution engine (vectorized env) for general RL environments.
https://envpool.readthedocs.io
Apache License 2.0
1.09k stars 100 forks source link

[Feature Request] DMC framestack wrapper support #148

Open Ericonaldo opened 2 years ago

Ericonaldo commented 2 years ago

Motivation

DMC experiments always need a framestack wrapper. However it is hard to implement it out of envpool because we should wrap env before creating vector envs.

Solution

Can you explain why, and whether it is possible to support this wrapper?

Checklist

Trinkle23897 commented 2 years ago

Would you like to provide an example (just a link) to show the common-style dm_control usage?

Ericonaldo commented 2 years ago

https://github.com/MishaLaskin/rad/blob/18d079e677398c70ff2eefefcc81d5a99662103d/train.py#L207

RAD. The current SoTA RL algorithm on DMC.

Trinkle23897 commented 2 years ago

136