search

zjunlp / AutoAct

[ACL 2024] AUTOACT: Automatic Agent Learning from Scratch for QA via Self-Planning
https://zjunlp.github.io/project/AutoAct
Apache License 2.0
183 stars 11 forks source link

How to deploy llama2-13b-chat + lora via fastchat? #14

Closed ro-ko closed 1 month ago

ro-ko commented 1 month ago

Hello! I have finished training and am now trying to run run_eval.sh. Could you tell me how to deploy the trained llama model with lora? I checked the reference docs in here, but still I don't know how to do and met too many errors.

Rolnand commented 1 month ago

replace the model path in https://github.com/zjunlp/AutoAct/blob/main/Scripts/model_bash/single_model.sh with your lora file path

ro-ko commented 1 month ago

Oh, I missed the model_bash directory. Apologies I’m asking something too simple. Now I'm encountered the same issue here I'll close this issue for now