yifan-h / Multilingual_Space

Source Code for "Adapters for Enhanced Modeling of Multilingual Knowledge and Text"
MIT License
12 stars 0 forks source link

Llama 3.2 support #1

Open stelmath opened 1 month ago

stelmath commented 1 month ago

Hello there and thanks for sharing the code!

Will this solution work when using the latest Llama 3.2?

yifan-h commented 1 month ago

Hi,

Thanks for the question. For a new model, you may have to train it by yourself. Intuitively, I feel LLaMA 3.2 is powerful enough. Enhancing it with widely used knowledge may not improve its performance much.