Closed timfpark closed 12 months ago
Did you convert the the model files to burn's format?
Getting the same error @Gadersd
I downloaded the official weights from llama.
checkpoints = sorted(Path(model_dir).glob("*.safetensors"))
if len(checkpoints) == 0:
raise ValueError(f"No checkpoint files found in {model_dir}")
But in the test.py
script the load_model
method searches for *.safetensors
.
The Llama team probably compressed all the weights in a single file consolidated.00.pth
I created a PR (#7)
I had accidentally modified test.py to use safetensors. The issue is now resolved.
I'm attempting to try
llama2-burn
with the standardllama2
model downloaded from Facebook and I'm seeing the following error when runningtest.py
:Where
llama2
is the directory for the cloned https://github.com/facebookresearch/llama repo and which has haddownload.sh
run on it.Environment: Ubuntu 22.04 on Intel i9