isl-org / spear

SPEAR: A Simulator for Photorealistic Embodied AI Research
MIT License
224 stars 15 forks source link

How to spawn objects and change conents in the scene. #275

Closed a2a4 closed 5 months ago

a2a4 commented 5 months ago

What platform am I on? What are my system specifications? Do I meet the minimum specifications for the Unreal Engine?

Platform: Ubuntu 20.04

What commit of the spear repository am I on? Am I synced to a specific tag, or am I synced to the head of the main branch?

Branch: main

What am I attempting to do, what do I expect to happen, and what actually happened?

I'm attempting to create my own scene in the simulation and spawn objects in the scene and create a scene in the environment.

Can you please suggest me how do I go about this? I've searched through the contents of the documentation. But it is not clear.

mikeroberts3000 commented 5 months ago

Hi. We don't currently have good support for spawning custom objects. The spawning behavior in SPEAR is painfully hard-coded right now. But we'll be improving things significantly in our next release, which we will ship in a few weeks. Thanks for trying out SPEAR, and please stay tuned!

a2a4 commented 5 months ago

Hello @mikeroberts3000. Thanks for your prompt reply. Looking forward to the further releases of spear.

Currently I've seen few scenes, in the spear release. debug_0000, debug1_0000, apartment_0000 and warehouse_0000. I extracted the SpearSim-Linux.pak and warehouse_0000-v0.4.0-Linux.pak through the ./UnrealPak /source/dir/ -Extract /destination/dir/ command to make changes to the warehouse scene for the way we desired. I was able to open the unreal levels of debug_0000, debug1_0000, apartment_0000 but not for warehouse_0000 level. There were no .umap or .uexp extension files in the extracted version of warehouse_0000-v0.4.0-Linux.pak.

Very grateful if we can receive your input on this. Thanks and cheers.

mikeroberts3000 commented 5 months ago

We don't officially support using the UnrealPak tool in the way you're describing. But in our next release, we will have a general-purpose Python interface that can be used to modify the scenes at runtime.