search

ssbuild / chatglm2_finetuning

chatglm2 6b finetuning and alpaca finetuning
Apache License 2.0
146 stars 17 forks source link

请问作者是否意愿实现qlora. #19

Open wellcasa opened 1 year ago

wellcasa commented 1 year ago

请问作者是否意愿实现qlora。

ssbuild commented 1 year ago

https://github.com/ssbuild/chatglm2_finetuning/blob/686e2fce80d60e90e7e4e501204f29109110b674/config/main.py#L12 load_in_bit=4 即 qlora