AGI-Edgerunners / LLM-Adapters

Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"
https://arxiv.org/abs/2304.01933
Apache License 2.0
1.05k stars 99 forks source link

How to use llama-13B or bigger models? #27

Open feiyuehchen opened 1 year ago

feiyuehchen commented 1 year ago

I'm currently running this repo in my local computer and the base model 'yahma/llama-7b-hf' works fine. I wonder if there is a command for llama-13B or other huggingface checkpoint (ex: https://huggingface.co/decapoda-research/llama-65b-hf).

Thank you!

HZQ950419 commented 1 year ago

Hi, For llama-13b or larger models, you can simply replace yahma/llama-7b-hf with other checkpoint names, like yahma/llama-13b-hf.