Open Hukongtao opened 1 year ago
I followed the tutorial in the README to run the code,But when I run this sentence
CUDA_VISIBLE_DEVICES=0 python llama.py ${MODEL_DIR} c4 --wbits 4 --groupsize 128 --load llama7b-4bit-128g.pt --benchmark 2048 --check
I got an error:
I followed the tutorial in the README to run the code,But when I run this sentence
I got an error: