thread '<unnamed>' panicked at 'called `Result::unwrap()` on an `Err` value: InvalidMagic { path: "model_merak.bin" }', src/model.rs:47:12

[widyaputeriaulia10]

Hi Author, I tried to implement llm-rs in my jupyter. After i installed RUST the error still occured :

thread '' panicked at 'called Result::unwrap() on an Err value: InvalidMagic { path: "model_merak.bin" }', src/model.rs:47:12

PanicException Traceback (most recent call last) Cell In[9], line 4 1 from llama_rs_python import Model 3 #load the model ----> 4 model = Model("model_merak.bin") 6 #generate 7 print(model.generate("Arti kehidupan adalah"))

PanicException: called Result::unwrap() on an Err value: InvalidMagic { path: "model_merak.bin" }

i saved my model (LLAMA based) in the same directory with the notebook file

[LLukas22]

What format has your model? rustformers currently only supports GGJT models. GGUF support still needs some more time. The error your getting means your model has an unknown file type.

[QtRoS]

GGUF support still needs some more time.

How can I help or track progress on this?

[LLukas22]

This is the related PR in the rustformers repo https://github.com/rustformers/llm/pull/412