search

huangwl18 / ReKep

ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulation
https://rekep-robot.github.io/
532 stars 54 forks source link

segment anything is not used in code. #7

Open Gumpest opened 2 months ago

Gumpest commented 2 months ago

It is not the same with paper.

woltium commented 2 months ago

It seems that they directly used the camera segmentation renderer provided by Isaac Sim in their code. I believe they use Segment Anything in their real-world experiments.

Everloom-129 commented 1 month ago

It seems that they directly used the camera segmentation renderer provided by Isaac Sim in their code. I believe they use Segment Anything in their real-world experiments.

could you tell me the data shape for SAM?

I tried to reproduce it with SAM2, the input mask shape is uint8, binary mask, which doesn't seem to fit well with the pipeline