thunlp / InfLLM

The code of our paper "InfLLM: Unveiling the Intrinsic Capacity of LLMs for Understanding Extremely Long Sequences with Training-Free Memory"
MIT License
269 stars 21 forks source link

长文本报错 #1

Closed majia1984 closed 5 months ago

majia1984 commented 5 months ago

调用chat.py往里面写入内容后,报错。

UnicodeDecodeError: 'utf-8' codec can't decode bytes in position 4093-4094: unexpected end of data

xcjthu commented 5 months ago

您好,这应该是文本编码问题,可能您的输入中包含一些特殊字符~