ziqipang / LM4VisualEncoding

[ICLR 2024 (Spotlight)] "Frozen Transformers in Language Models are Effective Visual Encoder Layers"
https://arxiv.org/abs/2310.12973
MIT License
219 stars 6 forks source link

About importing pre-trained weights for the LLaMA model #3

Closed Changwei-Ouyang closed 11 months ago

Changwei-Ouyang commented 11 months ago
  1. In the code for action recognition, I'm a bit confused about the part where pre-trained weights for the LLaMA model are imported. Can you please point out the section of code that handles the import of pre-trained weights for the LLaMA model?
  2. Can you provide the pre-trained weights for the LLaMA model you are using?
ziqipang commented 11 months ago

@Changwei-Ouyang Thanks for the question!

Changwei-Ouyang commented 11 months ago

Thank you for your response, very interesting work! Now I understand.