Unity-Technologies / com.unity.perception

Perception toolkit for sim2real training and validation in Unity
Other
925 stars 177 forks source link

Question: Is it possible to manipulate a "flexible" object for each frame of capture? #438

Closed cd25643 closed 2 years ago

cd25643 commented 2 years ago

I am looking to capture 100 frames of a flexible object "drooping" over multiple stationary objects. For example, say I have a desk that has 5 items that are randomly placed on the desk, but then I want to also randomly place a phone charger that "droops" over whatever objects its placed on top of. Is something like this even possible with the perception package? From what I've seen, Ive only seen rigid/stationary objects be randomized...

mkamalza commented 2 years ago

Yes, accumulative effects are possible through rendering more than one frame per each Iteration of the Scenario. You just need to set your Perception Camera to capture at a non-zero frame, and make sure this comes before the number frames rendered for each Iteration. This is useful for things such as physics, temporal anti aliasing, auto exposure, and more. Have a look at the answer provided for this question in the Perception FAQ to get a better idea of how to achieve this.

" I want to simulate physics (or other accumulative behaviors such as auto-exposure) for a number of frames and let things settle before capturing the Scene. Is this possible with the Perception package?"

cd25643 commented 2 years ago

Fantastic, thanks for the link!