ml-explore / mlx-examples

Examples in the MLX framework
MIT License
5.5k stars 791 forks source link

[Feature] Export Lora Adapters as GGML #848

Closed rmarnold closed 6 days ago

rmarnold commented 4 weeks ago

llama.cpp dropped support for converting lora to ggml, it would be very useful if I could use adapters with llama.cpp instead of fusing or merging the fine tuned model.

awni commented 6 days ago

Closing as dup of #816