search

hsp-iit / project-ergocub

A demonstration of human-robot interaction on the ergoCub through vision.
1 stars 0 forks source link

WalkingModule+Bimanual Manipulation Integration in Simulation and Real Robot. #108

Closed vigisushrutha23 closed 1 year ago

vigisushrutha23 commented 1 year ago

This issue is to keep track of the integration of the Walking module with the Bimanual manipulation. With the help of @mebbaid ,we were able to test his module and observe that the robot performs reasonably stable walking with the hands at various poses. Now the next step is to integrate the walking module with @Woolfrey 's module.

Current issue I face is that when i called the grasping module after doing prepareRobot and startWalking, the arms flailed and yarpmotorgui showed hardware fault on the simulated robot. The progress of the resolution of this issue will be tracked here.

vigisushrutha23 commented 1 year ago

Had a meeting with @mebbaid. He said the walking controller can be modified in a way such that they use references from @Woolfrey's module for the arms and torso like they do when they are using the suit and teleoperation. The modifications will be added to @SimoneMic version/fork of the walking controller (navigation_unicycle branch) most likely through a temporary branch for testing.

vigisushrutha23 commented 1 year ago

Progress as of 5-09: With the help of Mohamed, dirty version of the joint-retargetting has been implemented. There seem to be some segmentation issues + config file issues causing behaviors as seen in the video below, when @Woolfrey's module sends joint references. Fix is underway.

https://github.com/hsp-iit/project-ergocub/assets/5215434/2682815b-7ee2-4c01-9fe0-a083f99449f3

vigisushrutha23 commented 1 year ago

With the help of Mohamed, we added a thrift interface message to bimanual manipulation to send upper bodies joint references to the walking controller. Software integration is complete and the result can be seen in the video below. Sometimes there seem to be joint configs in which the walking controller seems to fail inconsistently which needs be re-tested to re-produce the error reliably, but the software integration is now complete.

https://github.com/hsp-iit/project-ergocub/assets/5215434/5356354c-8927-4379-a809-2152caedd574

vigisushrutha23 commented 1 year ago

A somewhat successful simulation video combining walking + object manipulation. We move the object relatively left and right and the roll it in two directions.

https://github.com/hsp-iit/project-ergocub/assets/5215434/b8050dc4-28d7-47c2-8761-acc43da75ec0

vigisushrutha23 commented 1 year ago

With @mebbaid , we run some tests of the integration of bimanual+walking on the real robot. We observed joint tracking errors on the following 4 joints.

L_SHOULDER_PITCH l_shoulder_pitch

R_SHOULDER_PITCH r_shoulder_pitch

L_SHOULDER_ROLL l_shoulder_roll

R_SHOULDER_ROLL r_shoulder_roll

We think it the low-level PID tuning that is the most likely issue as the errors are somewhat similar in profile. We hope to solve this on Wednesday when Mohamed, @SimoneMic and I have the robot booked for almost the whole day depending on the situation on that day's experiments.

vigisushrutha23 commented 1 year ago

Below is a shot video of a somewhat successful walking+bimanual experiment which was performed yesterday with @mebbaid. The robot walks while the instruction is to move the object left is sent to it.

https://github.com/hsp-iit/project-ergocub/assets/5215434/44f0a469-598c-4176-92f9-f4239f108a99

vigisushrutha23 commented 1 year ago

Software wise, integration is complete in both simulation and real robot.. Now the performance needs to be tuned so that we can see better grasping results and hence closing the issue.