baichuan-inc / Baichuan2

A series of large language models developed by Baichuan Intelligent Technology
https://huggingface.co/baichuan-inc
Apache License 2.0
4.08k stars 293 forks source link

V2版本中模型处理长度提升到8192 #337

Closed hediyuan closed 9 months ago

hediyuan commented 9 months ago

但是我看huggingface里的v2.0里的config.json文件,里面的"model_max_length": 4096。 仍然是4096,请问这个参数是否代表了模型的处理长度?这里仍然是4096会不会有什么影响?

baichuan-assistant commented 9 months ago

最新的huggingface已经是8192了,可以下载最新版本:

https://huggingface.co/baichuan-inc/Baichuan2-13B-Chat/tree/v2.0