Open LeMoussel opened 2 months ago
When loading the model unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit, I have the error : AssertionError: model.safetensors.index.json should exist.
AssertionError: model.safetensors.index.json should exist.
from airllm import AutoModel model = AutoModel.from_pretrained("unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit")
Indeed in this model there is no file model.safetensors.index.json The same goes for the model unsloth/Meta-Llama-3.1-70B-bnb-4bit The file model.safetensors.index.json is present in the model unsloth/Meta-Llama-3.1-405B-Instruct-bnb-4bit
model.safetensors.index.json
I get the same error. Could you fix this?
I get the same error
Same error
When loading the model unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit, I have the error :
AssertionError: model.safetensors.index.json should exist.
Indeed in this model there is no file
model.safetensors.index.json
The same goes for the model unsloth/Meta-Llama-3.1-70B-bnb-4bit The filemodel.safetensors.index.json
is present in the model unsloth/Meta-Llama-3.1-405B-Instruct-bnb-4bit