palme in model is not work

kyegomez / RT-2

Democratization of RT-2 "RT-2: New model translates vision and language into action"

https://discord.gg/qUtxnK2NMf

MIT License

367 stars 50 forks source link

palme in model is not work #3

Closed yeyan00 closed 1 year ago

yeyan00 commented 1 year ago

rt2 model use PALME

in palme project, palme forward params as follow:

but in rt2 model，use like this, params is not same.

kyegomez commented 1 year ago

@yeyan00 Hey please excuse me! I was trying to integrate the cond_drop into palm e but I have delayed it further, now I just implemented everything from scratch but I will soon implement PalmE again.