lucidrains / robotic-transformer-pytorch

Implementation of RT1 (Robotic Transformer) in Pytorch
MIT License
375 stars 31 forks source link

Is it possible to load the weights from pre-trained Tensorflow model? #2

Open taozhuo opened 1 year ago

taozhuo commented 1 year ago

Google provides pre-trained SavedModel files.

dtch1997 commented 1 year ago

Seconded!

Also, I would be interested in doing the implementation and submitting the PR. @lucidrains is the architecture used in your implementation exactly the same as the original?

andyoung009 commented 1 year ago

Based on the origin paper and this code, the pytorch version of image backbone is MaxViT, different from the efficientnet.

LumenYoung commented 1 year ago

I would also be interested at this. Would like to help if needed. I think here is an example of such conversion, the only thing need to be sure is that 1) both implementations are identical 2) each components in each of the framework with the same name are having the identical structure.

SamuelSchmidgall commented 11 months ago

Any progress on this?

lunalulu commented 11 months ago

someone can provide a model? thanks very much