How do you load weights for your implementation of ViT?

jankrepl / mildlyoverfitted

Paper implementations from scratch and machine learning tutorials

MIT License

340 stars 124 forks source link

How do you load weights for your implementation of ViT? #12

Closed Gullesh closed 2 years ago

Gullesh commented 2 years ago

Hi Jan, thanks for the great work.

I found the answer so I am closing this. However, in case anyone has the same question and read this, it is from the following line: p_c.data[:] = p_o.data