google-deepmind / open_x_embodiment

Apache License 2.0
623 stars 41 forks source link

What is the intuition behind all three keys inside action? #39

Open Lazyass66 opened 4 months ago

Lazyass66 commented 4 months ago

In the below function , what does world_vector , rotation_delta , gripper_closedness_action mean ??

def step_map_fn(step): return { 'observation': { 'image': tf.image.resize(step['observation']['image'], (128, 128)), }, 'action': tf.concat([ step['action']['world_vector'], step['action']['rotation_delta'], step['action']['gripper_closedness_action'], ], axis=-1) }

safsin commented 4 months ago

These are the descriptions I could find in the README of RT1 dataset: