search

sozercan / aikit

🏗️ Fine-tune, build, and deploy open-source LLMs easily!
https://sozercan.github.io/aikit/
MIT License
358 stars 27 forks source link

[REQ] fine tune output to exl2 or awq #213

Open sozercan opened 4 months ago

sozercan commented 4 months ago

What kind of request is this?

New feature

What is your request or suggestion?

finetune output should support output to EXL2 or AWQ to be used with exllama2 or other backends

Are you willing to submit PRs to contribute to this feature request?