Open BrownSweater opened 5 months ago
请参考:https://github.com/FlagOpen/FlagEmbedding/tree/master/examples/pretrain#3-train 可以替换为rope,但需要修改模型代码。
请参考:https://github.com/FlagOpen/FlagEmbedding/tree/master/examples/pretrain#3-train 可以替换为rope,但需要修改模型代码。