API控制台:
Loading checkpoint shards: 100%|█████████████████████████████████████████████████████████| 7/7 [02:18<00:00, 19.81s/it]
INFO: Started server process [4312]
INFO: Waiting for application startup.
INFO: Application startup complete.
INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit)
INFO: 127.0.0.1:53040 - "POST /v1/chat/completions/chat/completions HTTP/1.1" 404 Not Found
调用代码:
import openai
if name == "main":
openai.api_base = "http://localhost:8000/v1"
openai.api_key = "none"
for chunk in openai.ChatCompletion.create(
model="chatglm2-6b",
messages=[
{"role": "user", "content": "你好"}
],
stream=True
):
if hasattr(chunk.choices[0].delta, "content"):
print(chunk.choices[0].delta.content, end="", flush=True)
报错信息:
Traceback (most recent call last):
File "D:\Software\Py310\lib\site-packages\openai\api_requestor.py", line 413, in handle_error_response
error_data = resp["error"]
KeyError: 'error'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "d:\Users\Desktop\import openasdai.py", line 5, in
for chunk in openai.ChatCompletion.create(
File "D:\Software\Py310\lib\site-packages\openai\api_resources\chat_completion.py", line 25, in create
return super().create(*args, **kwargs)
File "D:\Software\Py310\lib\site-packages\openai\api_resources\abstract\engine_apiresource.py", line 155, in create
response, , api_key = requestor.request(
File "D:\Software\Py310\lib\site-packages\openai\api_requestor.py", line 299, in request
resp, got_stream = self._interpret_response(result, stream)
File "D:\Software\Py310\lib\site-packages\openai\api_requestor.py", line 710, in _interpret_response
self._interpret_response_line(
File "D:\Software\Py310\lib\site-packages\openai\api_requestor.py", line 775, in _interpret_response_line
raise self.handle_error_response(
File "D:\Software\Py310\lib\site-packages\openai\api_requestor.py", line 415, in handle_error_response
raise error.APIError(
openai.error.APIError: Invalid response object from API: '{"detail":"Not Found"}' (HTTP response code was 404)
Expected Behavior
No response
Steps To Reproduce
python运行openai_api.py,使用官方文档中的调用方式报错notfound
Environment
- OS:Windows10
- Python:3.10
- Transformers:
- PyTorch:
- CUDA Support (`python -c "import torch; print(torch.cuda.is_available())"`) :Yes
Is there an existing issue for this?
Current Behavior
API控制台: Loading checkpoint shards: 100%|█████████████████████████████████████████████████████████| 7/7 [02:18<00:00, 19.81s/it] INFO: Started server process [4312] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 127.0.0.1:53040 - "POST /v1/chat/completions/chat/completions HTTP/1.1" 404 Not Found
调用代码: import openai if name == "main": openai.api_base = "http://localhost:8000/v1" openai.api_key = "none" for chunk in openai.ChatCompletion.create( model="chatglm2-6b", messages=[ {"role": "user", "content": "你好"} ], stream=True ): if hasattr(chunk.choices[0].delta, "content"): print(chunk.choices[0].delta.content, end="", flush=True)
报错信息: Traceback (most recent call last): File "D:\Software\Py310\lib\site-packages\openai\api_requestor.py", line 413, in handle_error_response error_data = resp["error"] KeyError: 'error'
During handling of the above exception, another exception occurred:
Traceback (most recent call last): File "d:\Users\Desktop\import openasdai.py", line 5, in
for chunk in openai.ChatCompletion.create(
File "D:\Software\Py310\lib\site-packages\openai\api_resources\chat_completion.py", line 25, in create
return super().create(*args, **kwargs)
File "D:\Software\Py310\lib\site-packages\openai\api_resources\abstract\engine_apiresource.py", line 155, in create
response, , api_key = requestor.request(
File "D:\Software\Py310\lib\site-packages\openai\api_requestor.py", line 299, in request
resp, got_stream = self._interpret_response(result, stream)
File "D:\Software\Py310\lib\site-packages\openai\api_requestor.py", line 710, in _interpret_response
self._interpret_response_line(
File "D:\Software\Py310\lib\site-packages\openai\api_requestor.py", line 775, in _interpret_response_line
raise self.handle_error_response(
File "D:\Software\Py310\lib\site-packages\openai\api_requestor.py", line 415, in handle_error_response
raise error.APIError(
openai.error.APIError: Invalid response object from API: '{"detail":"Not Found"}' (HTTP response code was 404)
Expected Behavior
No response
Steps To Reproduce
python运行openai_api.py,使用官方文档中的调用方式报错notfound
Environment
Anything else?
No response