torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 68.00 MiB (GPU 0; 10.75 GiB total capacity; 10.17 GiB already allocated; 47.94 MiB free; 10.17 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF
使用 13B 模型,並用以下指令:
最終出現這樣錯誤:
顯卡是使用 RTX 2080 11G
有設置過
依然無用
也有至 generate.py 把 batch_size = 2 使用依然無效
有什麼建議嗎?