Hi, I found that there are some wrong arguments. in inference_poems_iprompt.py, line 357 the code is:
logits, *mem_kv = model(
tokens[:, index:],
position_ids[..., index: counter+1],
attention_mask[..., index: counter+1, :counter+1], # TODO memlen
mems=mems,
log_attention_weights=log_attention_weights_part
)
but model got an unexpected keyword argument 'mems'
Hi, I found that there are some wrong arguments. in inference_poems_iprompt.py, line 357 the code is: logits, *mem_kv = model( tokens[:, index:], position_ids[..., index: counter+1], attention_mask[..., index: counter+1, :counter+1], # TODO memlen mems=mems, log_attention_weights=log_attention_weights_part ) but model got an unexpected keyword argument 'mems'