thu-ml / RoboticsDiffusionTransformer

RDT-1B: a Diffusion Foundation Model for Bimanual Manipulation
MIT License
494 stars 42 forks source link

Applicability of RDT-1B on UR5 Robotic Arm and Fine-Tuning Requirements #11

Closed SupritYoung closed 1 week ago

SupritYoung commented 2 weeks ago

Hi,

First, congratulations on the excellent work with RDT-1B! 🥳 Your approach to diffusion-based bimanual manipulation and the introduction of a unified action space are both impressive and inspiring.

I am interested in adapting your method for use on a different robotic setup, specifically a UR5 robotic arm. I have a few questions regarding this adaptation:

Any insights or recommendations would be greatly appreciated. Thank you again for your work on this exciting project! 🙏

csuastt commented 2 weeks ago

Thanks for your attention!

Compatibility: Yes, it is compatible. No adjustment is needed. You can control a UR5 with either a joint-based or EEF-based controller. Fine-Tuning Requirements: At least 24GB VRAM.