search

shibing624 / MedicalGPT

MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. 训练医疗大模型，实现了包括增量预训练(PT)、有监督微调(SFT)、RLHF、DPO、ORPO。
Apache License 2.0
2.94k stars 452 forks source link

Please provide an offload_folder #335

Closed cove1011 closed 4 months ago

cove1011 commented 4 months ago

ValueError: The current device_map had weights offloaded to the disk. Please provide an offload_folder for them. Alternatively, make sure you have safetensors installed if the model you are using offers the weights in this format.

shibing624 commented 4 months ago

原因：机器显存不足，1.换个小模型（2B的）；2.使用int4量化模型。