allenai / Holodeck

CVPR 2024: Language Guided Generation of 3D Embodied AI Environments.
https://yueyang1996.github.io/holodeck
Apache License 2.0
304 stars 25 forks source link

Output Stuck after "Selecting objects for living room..." #45

Closed arjuntheprogrammer closed 3 weeks ago

arjuntheprogrammer commented 4 weeks ago

Hi, I am using ubuntu machine to run holodeck and i am not able to generate the output after AI: Selecting objects for living room.... It is stuck there and I waited for more than 30 mins.

$ cd ai2holodeck
$ python main.py --query "a living room" --openai_api_key xxx

Generating from an empty scene.
User: You are an experienced room designer. Please assist me in crafting a floor plan. Each room is a rectangle. You need to define the four coordinates and specify an appropriate design scheme, including each room's color, material, and texture.
Assume the wall thickness is zero. Please ensure that all rooms are connected, not overlapped, and do not contain each other.
Note: the units for the coordinates are meters.
For example:
living room | maple hardwood, matte | light grey drywall, smooth | [(0, 0), (0, 8), (5, 8), (5, 0)]
kitchen | white hex tile, glossy | light grey drywall, smooth | [(5, 0), (5, 5), (8, 5), (8, 0)]

Here are some guidelines for you:
1. A room's size range (length or width) is 3m to 8m. The maximum area of a room is 48 m$^2$. Please provide a floor plan within this range and ensure the room is not too small or too large.
2. It is okay to have one room in the floor plan if you think it is reasonable.
3. The room name should be unique.

Now, I need a design for a living room.
Additional requirements: N/A.
Your response should be direct and without additional text at the beginning or end.

AI: Here is the floor plan:
living room | oak hardwood, semi-gloss | taupe wallpaper, textured | [(0, 0), (0, 6), (7, 6), (7, 0)]
AI: The floor plan is valid. (Only one room)

User: I am now designing a living room. Please help me decide the wall height in meters.
Answer with a number, for example, 3.0. Do not add additional text at the beginning or in the end.

AI: The wall height is 2.5

User: I need assistance in designing the connections between rooms. The connections could be of three types: doorframe (no door installed), doorway (with a door), or open (no wall separating rooms). The sizes available for doorframes and doorways are single (1m wide) and double (2m wide).

Ensure that the door style complements the design of the room. The output format should be: room 1 | room 2 | connection type | size | door style. For example:
exterior | living room | doorway | double | dark brown metal door
living room | kitchen | open | N/A | N/A
living room | bedroom | doorway | single | wooden door with white frames

The design under consideration is a living room, which includes these rooms: living room. The length, width and height of each room in meters are:
living room: 7.0 m x 6.0 m x 2.5 m

Certain pairs of rooms share a wall: (exterior, living room). There must be a door to the exterior.
Adhere to these additional requirements: N/A.
Provide your response succinctly, without additional text at the beginning or end.

AI: Here is the doorway plan:
exterior | living room | doorway | double | dark brown metal door
There are multiple ways between exterior and living room

User: Guide me in designing the windows for each room. The window types are: fixed, hung, and slider.
The available sizes (width x height in cm) are:
fixed: (92, 120), (150, 92), (150, 120), (150, 180), (240, 120), (240, 180)
hung: (87, 160), (96, 91), (120, 160), (130, 67), (130, 87), (130, 130)
slider: (91, 92), (120, 61), (120, 91), (120, 120), (150, 92), (150, 120)

Your task is to determine the appropriate type, size, and quantity of windows for each room, bearing in mind the room's design, dimensions, and function.

Please format your suggestions as follows: room | wall direction | window type | size | quantity | window base height (cm from floor). For example:
living room | west | fixed | (130, 130) | 1 | 50

I am now designing a living room. The wall height is 250 cm. The walls available for window installation (direction, width in cm) in each room are:
living room: west, 600 cm; east, 600 cm; south, 700 cm; 

Please note: It is not mandatory to install windows on every available wall. Within the same room, all windows must be the same type and size.
Also, adhere to these additional requirements: Only one wall of each room should have windows.

Provide a concise response, omitting any additional text at the beginning or end. 

AI: Here is the window plan:
living room | south | fixed | (240, 180) | 2 | 50

AI: Selecting objects for living room...
YueYANG1996 commented 4 weeks ago

Could you refer to this issue to turn off the multiprocessing?

arjuntheprogrammer commented 3 weeks ago

I was able to skip this error by setting multiprocessing = False for:

  1. ObjectSelector
  2. WallObjectGenerator (had to add my own code)
  3. SmallObjectGenerator (had to add my own code)

image image image