allenai / Holodeck

CVPR 2024: Language Guided Generation of 3D Embodied AI Environments.
https://yueyang1996.github.io/holodeck
Apache License 2.0
304 stars 25 forks source link

Error trying to open generated scene in Unity. #28

Closed ZheningHuang closed 3 months ago

ZheningHuang commented 3 months ago

I tried to follow this guide to view the generated scene in Unity.

Here is what I have in Unity once I open the ai2thor project: Unity Screenshot

Then, I attempted to run python connect_to_unity.py --scene a_living_room-2024-04-06-11-58-33-174468/a_living_room.json but encountered the following errors.

Any suggestions?

Traceback (most recent call last):
  File "/Users/zhao/miniconda3/envs/holodeck/lib/python3.9/site-packages/ai2thor/wsgi_server.py", line 48, in queue_get
    res = que.get(block=True, timeout=queue_get_timeout_per_try)
  File "/Users/zhao/miniconda3/envs/holodeck/lib/python3.9/queue.py", line 179, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/zhao/Documents/Holodeck/connect_to_unity.py", line 14, in <module>
    controller = Controller(
  File "/Users/zhao/miniconda3/envs/holodeck/lib/python3.9/site-packages/ai2thor/controller.py", line 545, in __init__
    self.start(
  File "/Users/zhao/miniconda3/envs/holodeck/lib/python3.9/site-packages/ai2thor/controller.py", line 1548, in start
    self.last_event = self.server.receive(timeout=self.server_start_timeout)
  File "/Users/zhao/miniconda3/envs/holodeck/lib/python3.9/site-packages/ai2thor/wsgi_server.py", line 281, in receive
    return queue_get(
  File "/Users/zhao/miniconda3/envs/holodeck/lib/python3.9/site-packages/ai2thor/wsgi_server.py", line 62, in queue_get
    raise TimeoutError(
TimeoutError: Could not get a message from the queue after 600 attempts 
ZheningHuang commented 3 months ago

got this work now

Aoihigashi commented 3 months ago

got this work now

Hello, may I ask how you resolved this issue? I am currently encountering the same error.

ZheningHuang commented 3 months ago

Hi, I followed the instructions at https://github.com/allenai/Holodeck#load-the-scene-in-unity closely and managed to get it working. I forgot to do step 3 in my first try.

Zhening

Aoihigashi commented 3 months ago

Hi, I followed the instructions at https://github.com/allenai/Holodeck#load-the-scene-in-unity closely and managed to get it working. I forgot to do step 3 in my first try.

Zhening

Thank you for your reply. I have completed everything as instructed, but I am still encountering the error mentioned above.

ZheningHuang commented 3 months ago

Hi, I think this error is due to the fact that your Python code cannot link with the Unity engine after a long time of trying. So, I guess there's something wrong with your Unity installation?

Maybe try this and see if it can open Unity first:

image

[Note: I'm not the builder of this engine, just my simple observation after using this for couple of days]

DDDDorwin commented 2 months ago

Hi, I think this error is due to the fact that your Python code cannot link with the Unity engine after a long time of trying. So, I guess there's something wrong with your Unity installation?

Maybe try this and see if it can open Unity first: image

[Note: I'm not the builder of this engine, just my simple observation after using this for couple of days]

Hi Zhening. I spent weeks trying to connect to Unity and load the scene, but it did not work. And it looks like you are using Miniconda, could you please get me more info regarding the sys, env and version you are using?

Because I am using ubuntu 24.04 and unity 2020.3.25, but I couldn't open unity without sandbox and everytime when I load ai2thor in it, I have complier issues. I think it is because Unity may not be supported in ubuntu 24,04.

I would appreciate any information. Thanks:)

ZheningHuang commented 2 months ago

Hi, I was using a Mac and had no problem following the instructions given by the author. Maybe @ the author team for support?