allenai / Holodeck

CVPR 2024: Language Guided Generation of 3D Embodied AI Environments.
https://yueyang1996.github.io/holodeck
Apache License 2.0
346 stars 33 forks source link

Generate the JSON file normally, but only one picture of the pilot view #49

Closed zengpengyu-student closed 3 months ago

zengpengyu-student commented 4 months ago

Can you help me see this problem: I can have a JSON file normally, but there is only one picture of the push -up view: Please_design_a_Nordic_style_h

Using Unity for visualization will also report an error, but the code is not wrong.

3d9e0f93e7b8e5d5877a97e50d80355 d469a9d656b87058147520a15da9d08

My json file is: Please_design_a_Nordic_style_h.json

YueYANG1996 commented 4 months ago

Could you follow this to pull the latest commit for new_cam_adjust? https://github.com/allenai/Holodeck/issues/47#issuecomment-2235278814

zengpengyu-student commented 4 months ago

Thank you for your reply. The problem of generating pictures has been solved. But I found another problem. There are some objects in my room in the scene, but these objects are not displayed in the top view generated later.

c0dc9294bb02e4a20266f3b25dd20b2 6ba452648da1fbb8f5d2faa19d03aba

My json file is: a_living_room.json

YueYANG1996 commented 4 months ago

Have you downloaded those assets and set them to the correct directory?

https://github.com/allenai/Holodeck/blob/c4af5945b04212f6fca7940d6982e7bbeb3d061c/connect_to_unity.py#L26

zengpengyu-student commented 4 months ago

Yes, I downloaded the following 4 sets of data and added them to the path of code constants.py (OBJATHOR_ASSETS_BASE_DIR). python -m objathor.dataset.download_holodeck_base_data --version 2023_09_23 python -m objathor.dataset.download_assets --version 2023_09_23 python -m objathor.dataset.download_annotations --version 2023_09_23 python -m objathor.dataset.download_features --version 2023_09_23 From the images, it can be seen that some objects were generated, but some were not generated correctly. The objects in the living room in the upper image were not generated correctly, but some objects in one of the bedrooms represented by the lower image were generated normally.

dd039a85d43358ecaa03b1763a70d14
YueYANG1996 commented 4 months ago

For those missing objects, could you double-check that they are in the folder by looking up their assetIDs?

basteran commented 4 months ago

Hi @zengpengyu-student , how did you manage to solve your issue with opening Unity? I am following the guide from the Readme (https://github.com/allenai/Holodeck?tab=readme-ov-file#load-the-scene-in-unity) and I can't figure out what it means to open the Procedural.unity file as it seems to be a YAML file.. my system (Ubuntu 20.04) opens it with a text editor..

YueYANG1996 commented 4 months ago

Hi @zengpengyu-student , how did you manage to solve your issue with opening Unity? I am following the guide from the Readme (https://github.com/allenai/Holodeck?tab=readme-ov-file#load-the-scene-in-unity) and I can't figure out what it means to open the Procedural.unity file as it seems to be a YAML file.. my system (Ubuntu 20.04) opens it with a text editor..

You need to open the Unity editor and click this file there.

Screenshot 2024-07-30 at 12 45 07 PM