Keyerror when load galactica-30b

paperswithcode / galai

Model API for GALACTICA

Apache License 2.0

2.68k stars 276 forks source link

Keyerror when load galactica-30b #47

Closed BruceStayHungry closed 1 year ago

BruceStayHungry commented 1 year ago

Great work! When I load galactica-30b, it shows KeyError: 'decoder.layers.34.final_layer_norm.bias'

I have downloaded the model into my disk. The key error occurred when running the following code:

model_path = "local-model-path"
tokenizer = AutoTokenizer.from_pretrained(model_path)
model = OPTForCausalLM.from_pretrained(model_path, device_map="auto",  torch_dtype=torch.float16)

Thanks for any help!

mkardas commented 1 year ago

Hi @BruceStayHungry, we fixed the 30B checkpoint. Can you check if it works now?