search

thunlp / InfLLM

The code of our paper "InfLLM: Unveiling the Intrinsic Capacity of LLMs for Understanding Extremely Long Sequences with Training-Free Memory"
MIT License
309 stars 29 forks source link

长文本报错 #1

Closed majia1984 closed 8 months ago

majia1984 commented 8 months ago

调用chat.py往里面写入内容后，报错。

UnicodeDecodeError: 'utf-8' codec can't decode bytes in position 4093-4094: unexpected end of data

xcjthu commented 8 months ago

您好，这应该是文本编码问题，可能您的输入中包含一些特殊字符~