search

lm-sys / FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
Apache License 2.0
36.59k stars 4.52k forks source link

使用gpt-3.5-turbo llm_api报错 #2301

Open zqt996 opened 1 year ago

zqt996 commented 1 year ago

2023-08-24 11:10:06 | ERROR | stderr | Process model_worker(27196): 2023-08-24 11:10:06 | ERROR | stderr | Traceback (most recent call last): 2023-08-24 11:10:06 | ERROR | stderr | File "D:\env\miniconda3\envs\langchain-ChatGLM\lib\multiprocessing\process.py", line 314, in _bootstrap 2023-08-24 11:10:06 | ERROR | stderr | self.run() 2023-08-24 11:10:06 | ERROR | stderr | File "D:\env\miniconda3\envs\langchain-ChatGLM\lib\multiprocessing\process.py", line 108, in run 2023-08-24 11:10:06 | ERROR | stderr | self._target(*self._args, *self._kwargs) 2023-08-24 11:10:06 | ERROR | stderr | File "D:\job\langchain-ChatGLM\server\llm_api.py", line 194, in run_model_worker 2023-08-24 11:10:06 | ERROR | stderr | app = create_model_worker_app(args, **kwargs) 2023-08-24 11:10:06 | ERROR | stderr | File "D:\job\langchain-ChatGLM\server\llm_api.py", line 128, in create_model_worker_app 2023-08-24 11:10:06 | ERROR | stderr | worker = ModelWorker( 2023-08-24 11:10:06 | ERROR | stderr | File "D:\env\miniconda3\envs\langchain-ChatGLM\lib\site-packages\fastchat\serve\model_worker.py", line 196, in init 2023-08-24 11:10:06 | ERROR | stderr | super().init( 2023-08-24 11:10:06 | ERROR | stderr | File "D:\env\miniconda3\envs\langchain-ChatGLM\lib\site-packages\fastchat\serve\model_worker.py", line 84, in init 2023-08-24 11:10:06 | ERROR | stderr | self.conv.sep_style = int(self.conv.sep_style) 2023-08-24 11:10:06 | ERROR | stderr | TypeError: int() argument must be a string, a bytes-like object or a real number, not 'NoneType'

Meidanlong commented 1 year ago

+1

thinkinds commented 1 year ago

+1

HarikrishnanBalagopal commented 3 months ago

The error seems to be coming from this line https://github.com/lm-sys/FastChat/blob/e5dc446f54b37adc11eff37b6fc941ab66fbfa00/fastchat/serve/base_model_worker.py#L49

I have added some debug print statements and here's the traceback.

2024-06-29 22:30:29 | INFO | stdout | ================== DEBUG ==================
2024-06-29 22:30:29 | INFO | stdout | self.conv Conversation(name='chatgpt', system_template='{system_message}', system_message='You are a helpful assistant.', roles=('user', 'assistant'), messages=[], offset=0, sep_style=None, sep=None, sep2=None, stop_str=None, stop_token_ids=None)
2024-06-29 22:30:29 | INFO | stdout | self.conv.sep_style None
2024-06-29 22:30:29 | INFO | stdout | ================== DEBUG ==================
2024-06-29 22:30:29 | ERROR | stderr | Traceback (most recent call last):
2024-06-29 22:30:29 | ERROR | stderr |   File "/usr/lib/python3.9/runpy.py", line 197, in _run_module_as_main
2024-06-29 22:30:29 | ERROR | stderr |     return _run_code(code, main_globals, None,
2024-06-29 22:30:29 | ERROR | stderr |   File "/usr/lib/python3.9/runpy.py", line 87, in _run_code
2024-06-29 22:30:29 | ERROR | stderr |     exec(code, run_globals)
2024-06-29 22:30:29 | ERROR | stderr |   File "/root/evaluation/venv/lib/python3.9/site-packages/fastchat/serve/model_worker.py", line 414, in <module>
2024-06-29 22:30:29 | ERROR | stderr |     args, worker = create_model_worker()
2024-06-29 22:30:29 | ERROR | stderr |   File "/root/evaluation/venv/lib/python3.9/site-packages/fastchat/serve/model_worker.py", line 385, in create_model_worker
2024-06-29 22:30:29 | ERROR | stderr |     worker = ModelWorker(
2024-06-29 22:30:29 | ERROR | stderr |   File "/root/evaluation/venv/lib/python3.9/site-packages/fastchat/serve/model_worker.py", line 66, in __init__
2024-06-29 22:30:29 | ERROR | stderr |     super().__init__(
2024-06-29 22:30:29 | ERROR | stderr |   File "/root/evaluation/venv/lib/python3.9/site-packages/fastchat/serve/base_model_worker.py", line 64, in __init__
2024-06-29 22:30:29 | ERROR | stderr |     self.conv.sep_style = int(self.conv.sep_style)
2024-06-29 22:30:29 | ERROR | stderr | TypeError: int() argument must be a string, a bytes-like object or a number, not 'NoneType'

Seems this line was updated to have the correct sep_style https://github.com/lm-sys/FastChat/blame/2d9e2a6111ebe2f9ecc334af3fb5356cc6ee41cc/fastchat/conversation.py#L785 in the recent versions https://github.com/lm-sys/FastChat/blob/e5dc446f54b37adc11eff37b6fc941ab66fbfa00/fastchat/conversation.py#L1021