Are there any trained models that support input of images and robot states?

ankile / robust-rearrangement

From Imitation to Refinement -- Residual RL for Precise Visual Assembly

https://residual-assembly.github.io/

MIT License

55 stars 3 forks source link

Are there any trained models that support input of images and robot states? #33

Open letsgofeng opened 1 month ago

letsgofeng commented 1 month ago

Hi, First of all thank you for your great work.

I downloaded the model you provided via the contents of the bucket here and tested. I found that the training model only supports inputs of part poses and robot states. I would like to ask if the same trained models can be provided to support input of images and robot states, or can you provide training commands?

Looking forward to receiving your reply.

Best regards, xiongfeng

ankile commented 3 weeks ago

Hi xiongfeng,

Yes, I can definitely provide commands and see if there are any image-based model weights it would make sense to share as well. It would probably only be ones trained on image data from simulation only.

Lars