python inference.py -m Llama-2-7b-hf -d cola -shots 0
Our results: 30.97.
one-shot
python inference.py -m Llama-2-7b-hf -d cola -shots 1
Our results: 30.87.
32-shot
python inference.py -m Llama-2-7b-hf -d cola -shots 32
Our results: 30.87.
Attention: most prediction labels of which have been set to 0 (unacceptable) with ppl, thus the accuracy is around 30.9% (proportion of label unacceptable) in all results
Cola
zero-shot
Our results: 30.97.
one-shot
Our results: 30.87.
32-shot
Our results: 30.87.
Attention: most prediction labels of which have been set to 0 (unacceptable) with ppl, thus the accuracy is around 30.9% (proportion of label unacceptable) in all results