search

Pan-ML / panml

PanML is a high level generative AI/ML development and analysis library designed for ease of use and fast experimentation.
MIT License
113 stars 16 forks source link

add QLoRA finetuning #66

Closed emekaokoli19 closed 1 year ago

emekaokoli19 commented 1 year ago

For #33 @wanoz I decided to follow Huggingface and make this inclusion as simple as possible. I think the user can use QLoRA without this PR by just adding quantization_config to the **model_args. Let me know what you think