lora微调占用显存**逐渐增大**直到**爆炸**

modelscope / ms-swift

Use PEFT or Full-parameter to finetune 400+ LLMs or 100+ MLLMs. (LLM: Qwen2.5, Llama3.2, GLM4, Internlm2.5, Yi1.5, Mistral, Baichuan2, DeepSeek, Gemma2, ...; MLLM: Qwen2-VL, Qwen2-Audio, Llama3.2-Vision, Llava, InternVL2, MiniCPM-V-2.6, GLM4v, Xcomposer2.5, Yi-VL, DeepSeek-VL, Phi3.5-Vision, ...)

Apache License 2.0

4.2k stars 369 forks source link

lora微调qwen2.5-7b逐渐爆显存

版本 torch 2.4.0 transformers 4.46.1 ms-swift 2.5.1.post1
报错 torch.OutOfMemoryError: CUDA out of memory. Tried to allocate 2.07 GiB. GPU 0 has a total capacity of 23.68 GiB of which 609.81 MiB is free. Process 10405 has 23.08 GiB memory in use. Of the allocated memory 20.90 GiB is allocated by PyTorch, and 1.87 GiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True to avoid fragmentation. See documentation for Memory Management (https://pytorch.org/docs/stable/notes/cuda.html#environment-variables) Train: 18%|████████████████ | 88/494 [04:04<18:48, 2.78s/it]
显存占用

modelscope / ms-swift

lora微调占用显存**逐渐增大**直到**爆炸** #2364

lora微调qwen2.5-7b逐渐爆显存

lora微调占用显存逐渐增大直到爆炸 #2364