Open zhengyangyong opened 11 months ago
想确定是如下哪一种:
现象如图:
这个参数,如果设置得比输入小会报错:Input length of input_ids is 2183, but max_length is set to 500. This can lead to unexpected behavior. You should consider increasing max_new_tokens
max_length
max_new_tokens
从这个表现可以看出这个参数是限制输入长度的,但是很多模型此参数是 限制输出长度 的,如果限制输出长度,又应该如何设置
无
Is there an existing issue for this?
Current Behavior
想确定是如下哪一种:
现象如图:
这个参数,如果设置得比输入小会报错:Input length of input_ids is 2183, but
max_length
is set to 500. This can lead to unexpected behavior. You should consider increasingmax_new_tokens
从这个表现可以看出这个参数是限制输入长度的,但是很多模型此参数是 限制输出长度 的,如果限制输出长度,又应该如何设置
Expected Behavior
无
Steps To Reproduce
无
Environment
Anything else?
无