Baichuan2-13b-chat-v2版本训练无法进行

baichuan-inc / Baichuan2

A series of large language models developed by Baichuan Intelligent Technology

https://huggingface.co/baichuan-inc

Apache License 2.0

4.08k stars 293 forks source link

Baichuan2-13b-chat-v2版本训练无法进行 #381

Open Taskii-Lei opened 7 months ago

Taskii-Lei commented 7 months ago

我想用数据微调baichuan2-13b-chat-v2版本，但是一直报错：

 line 331, in get_alibi_mask
    alibi = slopes.unsqueeze(1).unsqueeze(1) * position_point
RuntimeError: [enforce fail at alloc_cpu.cpp:75] err == 0. DefaultCPUAllocator: can't allocate memory: you tried to allocate 671088640 bytes. Error code 12 (Cannot allocate memory)

不知道是什么问题...