search

Mozilla-Ocho / llamafile

Distribute and run LLMs with a single file.
https://llamafile.ai
Other
16.75k stars 830 forks source link

May I ask how to export and use LORA? I cannot use the BIN file converted with llama.cpp on my end #431

Open cwyou123 opened 1 month ago

cwyou123 commented 1 month ago

May I ask how to export and use LORA? I cannot use the BIN file converted with llama.cpp on my end, which will result in an error message😆 8141716280528_ pic

jart commented 1 month ago

Could you try using the --unsecure flag and let me know if that fixes it?

cwyou123 commented 1 month ago

Could you try using the --unsecure flag and let me know if that fixes it?

Is adding an --unsecure flag using the command line like this？ /Users/llamafile-0.8.4.exe --port 13333 -m /Users/RoleLLM -c 2048 -b 512 --nobrowser -np 1 --lora /Users/ggml-adapter-mode.bin -ngl 33 --unsecure The final result obtained is consistent with the previous one