Closed aofengdaxia closed 7 months ago
把llm.py第185行进行以下修改后测试暂时正常。 修改内容如下
if "tokenizer_decode_token__output_buffer" not in dir(self.thread_local_obj) or self.thread_local_obj.tokenizer_decode_token__output_buffer is None:
self.thread_local_obj.tokenizer_decode_token__output_buffer = ctypes.create_string_buffer(output_buffer_init_len)
已经通过递交PR解决
出错的情况
错误如下: