Open widyaputeriaulia10 opened 11 months ago
What format has your model? rustformers
currently only supports GGJT
models. GGUF
support still needs some more time.
The error your getting means your model has an unknown file type.
GGUF support still needs some more time.
How can I help or track progress on this?
This is the related PR in the rustformers repo https://github.com/rustformers/llm/pull/412
Hi Author, I tried to implement llm-rs in my jupyter. After i installed RUST the error still occured :
thread '' panicked at 'called
Result::unwrap()
on anErr
value: InvalidMagic { path: "model_merak.bin" }', src/model.rs:47:12PanicException Traceback (most recent call last) Cell In[9], line 4 1 from llama_rs_python import Model 3 #load the model ----> 4 model = Model("model_merak.bin") 6 #generate 7 print(model.generate("Arti kehidupan adalah"))
PanicException: called
Result::unwrap()
on anErr
value: InvalidMagic { path: "model_merak.bin" }i saved my model (LLAMA based) in the same directory with the notebook file