search

bigcode-project / bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.
Apache License 2.0
698 stars 180 forks source link

How to use my local model files to run the program? I cant download the model online #205

Closed virt9 closed 3 months ago

virt9 commented 4 months ago

thx for the work, i just want use the model downloading from hugging face(codellama-13B-python) and i dont know how to do this

loubnabnl commented 4 months ago

Hi, you can provide te path to your model in --model instead of HF repo name:

accelerate launch  main.py \
    --model PATH  \
    ...
virt9 commented 3 months ago

thank you for your help! i have another quesion. may i modify the "get_promt" function to implement few-shot in MBPP dataset? i wonder if there is someting else i need to attention

loubnabnl commented 3 months ago

Yes you can just change get_prompt. You can see how it's done for GSM8K for example https://github.com/bigcode-project/bigcode-evaluation-harness/blob/e54f33d093f342ffc0c5c057910c00aa2081515d/bigcode_eval/tasks/gsm.py#L125

virt9 commented 3 months ago

thank you very much！i get it !!