search

ProjectD-AI / llama_inference

llama inference for tencentpretrain
GNU General Public License v3.0
95 stars 11 forks source link

模型分片了怎么指定load_model_path #18

Open caowenhero opened 1 year ago

caowenhero commented 1 year ago

HF都是001-003.bin这样的文件。。。。

fengyh3 commented 1 year ago

直接制定模型的文件夹就行，参考： https://github.com/ProjectD-AI/llama_inference/blob/main/utils.py#L114C35-L114C35