search

google-deepmind / open_x_embodiment

Apache License 2.0
623 stars 41 forks source link

The model doesn't work in real world #19

Closed datonefaridze closed 7 months ago

datonefaridze commented 7 months ago

Hello, i deployed the model on my lewansoul Xarm robot, but it can't pick up a object in front of it. This is a small drive data that i have collected to demonstrate faliure of the model (there are frames of each time and delta x,y,z (haven't used rotations yet)).

This is the small script, which i am currently using.

Do you have any examples of model deployment in real world robot so that i can mimick? (actually i have been trying to accomplish a task on simple robot for about a year, but i had no success). Any kind of suggestion would be helpful @kpertsch

quanvuong commented 7 months ago

For the RT-1-X model, we currently do not expect the model to zero-shot solve manipulation problems in a new domain that the model was not trained on.