search

artidoro / qlora

QLoRA: Efficient Finetuning of Quantized LLMs
https://arxiv.org/abs/2305.14314
MIT License
9.96k stars 820 forks source link

add ZeRO to QloRA #230

Closed hzg0601 closed 1 year ago

hzg0601 commented 1 year ago
  1. add a function to recursively download dataset;
  2. add ZeRO to QLoRA;
  3. add example scripts