The LoRA hyper-parameters?

LHRLAB / ChatKBQA

[ACL 2024] Official resources of "ChatKBQA: A Generate-then-Retrieve Framework for Knowledge Base Question Answering with Fine-tuned Large Language Models".

https://arxiv.org/abs/2310.08975

MIT License

225 stars 21 forks source link

The LoRA hyper-parameters? #6

Open JBoRu opened 6 months ago

JBoRu commented 6 months ago

Hi, What are the hyper-parameters of rank and alpha?

LHRLAB commented 6 months ago

You can find them at https://github.com/LHRLAB/ChatKBQA/tree/main/LLMs/LLaMA/src/llmtuner/hparams.