search

isaac-sim / IsaacLab

Unified framework for robot learning built on NVIDIA Isaac Sim
https://isaac-sim.github.io/IsaacLab
Other
1.85k stars 710 forks source link

[Question] Can I have different number of objects in each sub-environment? #704

Open QuanyiLi opened 1 month ago

QuanyiLi commented 1 month ago

Question

Hi IsaacLab team,

Thank you for this great work! I got a question about the parallel training.

As far as I know, parallel training is launched by using the clone method, which replicates the same scene thousands of times with domain randomization applied to each replicated scene. As a result, the objects in the scene can have different initial conditions.

However, it seems that is not allowed to have different objects in each sub-environment so we can not vary the number of objects (correct me if I am wrong). This prevents researchers from doing scene-level parallel training, where each scene consists of a different number/types of objects. For example, if I have a 1K room in different layouts, and I want to train navigation policy in it, I can not load each room to a single sub-environment as they have different layouts/objects in each room. So I need to fall back to using traditional multi-processing as a workaround.

I wonder if it is easy to have this feature supported. I believe it can bring much more speed-up, compared to doing the parallelization with multi-processing.

hutslib commented 1 month ago

I meet the same problem and have the same need。 Is there any way to workaround this? @animesh-garg

QuanyiLi commented 1 month ago

@hutslib A simple workaround that comes to my mind is first to find all objects you need for all sub-environments. After this, the clone would copy this environment with all assets. Then for each sub-environment, you can put objects that you don't need in a place that your agent can not observe, i.e. underground as if the training environment is composed of only the objects observable. This allows you to simulate parallel environments with different numbers of objects at the same time, though all sub-environments still have the same number of objects.

(It is just a guess, I don't verify this yet

animesh-garg commented 1 month ago

@hutslib A simple workaround that comes to my mind is first to find all objects you need for all sub-environments. After this, the clone would copy this environment with all assets. Then for each sub-environment, you can put objects that you don't need in a place that your agent can not observe, i.e. underground as if the training environment is composed of only the objects observable. This allows you to simulate parallel environments with different numbers of objects at the same time, though all sub-environments still have the same number of objects.

(It is just a guess, I don't verify this yet

Yes I think this should be a viable solution. Basically the idea is that each env has the same number of entities preallocated which enables the tensorAPI to function correctly.