[Question] multi processus observation collection

[kenzlegouge]

❓ Question

I built an env that relies on an external DLL. Due to the constraints of this Dll, it cannot be loaded twice in the same process. This makes make_vec_env impossible.

Is it possible launch multiple env in separate processes, and collect the different observations and feed them to the learner (PPO in my case)?

Checklist

• [X] I have checked that there is no similar issue in the repo
• [X] I have read the documentation
• [X] If code there is, it is minimal and working
• [X] If code there is, it is formatted using the markdown code blocks for both code and stack traces.

[araffin]

Is it possible launch multiple env in separate processes, and collect the different observations and feed them to the learner (PPO in my case)?

Hello, have you looked into SubprocVecEnv in the doc? (it can be passed as parameter to make_vec_env)