Closed mianqiu00 closed 3 months ago
Sst2
choices: [negative, positive]
zero-shot
python inference.py -m Llama-2-7b-hf -d sst2 -shots 0 --ranking_type prob
Our results: 59.75.
python inference.py -m Meta-Llama-3-8B -d sst2 -shots 0 --ranking_type prob
Our results: 74.89.
one-shot
python inference.py -m Llama-2-7b-hf -d sst2 -shots 1 --ranking_type prob
Our results: 49.08.
python inference.py -m Meta-Llama-3-8B -d sst2 -shots 1 --ranking_type prob
Our results: 92.43.
32-shot
python inference.py -m Llama-2-7b-hf -d sst2 -shots 32 --ranking_type prob
Our results: 87.16.
python inference.py -m Meta-Llama-3-8B -d sst2 -shots 32 --ranking_type prob
Our results: 94.72.
Sst2
choices: [negative, positive]
zero-shot
Our results: 59.75.
Our results: 74.89.
one-shot
Our results: 49.08.
Our results: 92.43.
32-shot
Our results: 87.16.
Our results: 94.72.