cli_demo.py 切换Baichuan-13B-Base 问答异常

[cgq0816]

加载模型方式 config = GenerationConfig.from_pretrained( "/data/model/Baichuan-13B-Base" ) model = AutoModelForCausalLM.from_pretrained( "/data/model/Baichuan-13B-Base", torch_dtype=torch.float16, device_map="auto", trust_remote_code=True ) model.generation_config = config tokenizer = AutoTokenizer.from_pretrained( "/data/model/Baichuan-13B-Base", use_fast=False, trust_remote_code=True ) 也按照其他人issues的问题进行了配置 但是还是会报如下错误 请问我该如何使用Baichuan-13B-Base做问答呢？

[Liu-Tianmeng]

我也报了相同的错，请问有解决方法吗~

[yangbiaoqiange]

同问，如何用basemodel做问答呢？