Open SmileLollipop opened 9 months ago
python -m fastchat.serve.openai_api_server --host localhost --port 8000 INFO: Started server process [17636] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://localhost:8000 (Press CTRL+C to quit) INFO: 127.0.0.1:12208 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request INFO: 127.0.0.1:12215 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request INFO: 127.0.0.1:12219 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request INFO: 127.0.0.1:12222 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
It's supported by https://github.com/lm-sys/FastChat/pull/2622. can you try this command?
python3 -m fastchat.serve.cli --model-path THUDM/chatglm3-6b
python -m fastchat.serve.openai_api_server --host localhost --port 8000 INFO: Started server process [17636] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://localhost:8000 (Press CTRL+C to quit) INFO: 127.0.0.1:12208 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request INFO: 127.0.0.1:12215 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request INFO: 127.0.0.1:12219 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request INFO: 127.0.0.1:12222 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request