alexa / teach

TEACh is a dataset of human-human interactive dialogues to complete tasks in a simulated household environment.
132 stars 26 forks source link

No valid positions to place object found when placing slices on Bowl or Plate #32

Open Gabesarch opened 8 months ago

Gabesarch commented 8 months ago

Hello,

We have found a problem with interaction when attempting to place many objects on the same plate or bowl. We have found that when one or more object (e.g., slices) are already on a bowl or plate, attempting to place another slice on the plate often causes action failure with error message "No valid positions to place object found":

<ai2thor.server.Event at 0x7fd33070e4f0
    .metadata["lastAction"] = PutObject
    .metadata["lastActionSuccess"] = False
    .metadata["errorMessage"] = "No valid positions to place object found
    .metadata["actionReturn"] = None

test

We have also found this error persists when not only specifying an x,y position (see image) with the teach controller but also directly calling the simulator via:

self.controller.step(
                action="PutObject",
                objectId='Bowl|-01.86|+00.92|+01.80',
                forceAction=True,
            )

The above example is from TfD instance: 9f0fa54e2587998b_97c6

This error significantly limits success on many of the tasks, as they require multiple objects to be placed on same receptacle for task success. Any help with this would be greatly appreciated! Thank you so much!