ARISE-Initiative / robosuite

robosuite: A Modular Simulation Framework and Benchmark for Robot Learning
https://robosuite.ai
Other
1.34k stars 414 forks source link

Confusion about the action space of the controller #474

Closed Victeldo closed 2 months ago

Victeldo commented 6 months ago

Hi,

I'm currently using Robosuite for the simulation environment to train a policy for the Kinova gen 3 arm, as part of my Probabilistic Robotics final project. I'm planning on using the trained policy on the real robot; however, I was facing difficulties in understanding the action space of the robot.

In the Robosuite environment, it appears that the actions are in terms of an array of joint (and gripper) velocities with a range of [-1,1] each. However, I'm a little unsure if I'm to interpret it as a percent of the max RPM of the joint, or if I'm meant to interpret it another way. If it does mean joint velocities, what is the expected duration of each action? Additionally, is there any way to get actions in terms of joint positions instead?

Thanks, Prithvi

zhuyifengzju commented 6 months ago

Hi, In robosuite you can specify the controller to be joint position. I am not sure why you would need to condition on max RPM. Whether joint positions or velocities should be based on the unit of rad or rad/s. THe duration of each action is typically the loop of env.step you invoke, so you would need to write your own logic to achieve some closed-loop behavior.