search

GanjinZero / RRHF

[NIPS2023] RRHF & Wombat
780 stars 49 forks source link

如果我想将模型更改为baichuan2-7b-chat，需要做哪些方面的变动？ #52

Closed IT-five closed 6 months ago

GanjinZero commented 6 months ago

换一个load model就行了？

GanjinZero commented 6 months ago

tokenizer可能也需要注意下有没有什么区别

GanjinZero commented 6 months ago

https://huggingface.co/baichuan-inc/Baichuan2-7B-Base/blob/main/modeling_baichuan.py 你填DecoderLayer就行吧