OpenThaiGPT / openthaigpt-pretraining

Apache License 2.0
21 stars 10 forks source link

Add qlora_vs_lora test #254

Closed Wintoplay closed 1 year ago

Wintoplay commented 1 year ago

Add experiment result of QLoRA vs LoRA in term of training speed and tflops

directory of interest: openthaigpt-pretraining\src\model\notebook\QLoRA_vs_LoRA Report(Training time + tflops)

Wintoplay commented 1 year ago

done