Inquiry of robustness of model with humanoid robot

[PhilipAmadasun]

Has the model been trained for use with humanoid robots with the ability to walk and hold objects?

[open-x-embodiment]

No, the RT-*-X models have not been trained with humanoids. That being said, the models are trained with end-effector delta as the action space. So if you have the data from humanoids, it will be very useful if you share it with the community or try finetuning the model with your data.

On Sun, Mar 24, 2024 at 2:38 PM 'Philip Amadasun' via Open X-Embodiment Core @.***> wrote:

Has the model been trained for use with humanoid robots with the ability to walk and hold objects?

— Reply to this email directly, view it on GitHub https://github.com/google-deepmind/open_x_embodiment/issues/51, or unsubscribe https://github.com/notifications/unsubscribe-auth/BDPTRVMAQU737WEV4XKSCPLYZ5BUBAVCNFSM6AAAAABFGAIBVGVHI2DSMVQWIX3LMV43ASLTON2WKOZSGIYDINJWG42TEMY . You are receiving this because you are subscribed to this thread.Message ID: @.***>

-- You received this message because you are subscribed to the Google Groups "Open X-Embodiment Core" group. To unsubscribe from this group and stop receiving emails from it, send an email to @.*** To view this discussion on the web visit https://groups.google.com/d/msgid/open-x-embodiment/google-deepmind/open_x_embodiment/issues/51%40github.com https://groups.google.com/d/msgid/open-x-embodiment/google-deepmind/open_x_embodiment/issues/51%40github.com?utm_medium=email&utm_source=footer .

[PhilipAmadasun]

@open-x-embodiment Thanks for the feedback. Would you happen to know of any models that already have some pretraining on this?

[XibalbaTechSol]

Couldn't one create synthetic data using computer models of various robots?