huangwl18 / ReKep

ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulation
https://rekep-robot.github.io/
542 stars 55 forks source link

About multiple cameras #18

Open yanrihong opened 1 month ago

yanrihong commented 1 month ago

Dear authors, while reading the paper, I am very interested in the use of multiple cameras, especially in the part regarding the processing of camera outputs. I have the following questions:

When dealing with the RGB outputs of multiple cameras, how is the selection of RGB images achieved? Is it based on certain specific criteria or algorithms to choose the RGB image of one particular camera, or is there a fusion process for the RGB images from multiple cameras? If it is a fusion process, what kind of fusion method is used?

ef6ff5ebcad217ffe8371d4adaed08f f8d9c15b33953fb1970b9a7214746ca