Use a work queue to better load balanced the thread pool. I also added the ability to reset the envs in parallel and the vulkan rendering in parallel since it seems to be just OpenGL that doesn't like that. This doesn't really matter for the async RL setting as the extra latency due to bad load balancing doesn't matter. I made a kinda sync setting by setting SF to 1 worker and 1 env per worker, there FPS improves from 4.5k to 4.7k, so this helps, but not much.
Use a work queue to better load balanced the thread pool. I also added the ability to reset the envs in parallel and the vulkan rendering in parallel since it seems to be just OpenGL that doesn't like that. This doesn't really matter for the async RL setting as the extra latency due to bad load balancing doesn't matter. I made a kinda sync setting by setting SF to 1 worker and 1 env per worker, there FPS improves from 4.5k to 4.7k, so this helps, but not much.