返回格式上的一些问题

[lvguanjun]

pandoraNext 的 /v1/chat/completions 接口响应如下

b'data: {"id":"chatcmpl-oh0UFdq9cCceAKWoS4e3LyDxojf8V","object":"chat.completion.chunk","created":1703783665,"model":"gpt-4-32k","choices":[{"delta":{"role":"assistant"},"index":0,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-oh0UFdq9cCceAKWoS4e3LyDxojf8V","object":"chat.completion.chunk","created":1703783665,"model":"gpt-4-32k","choices":[{"delta":{"content":"Hello"},"index":0,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-oh0UFdq9cCceAKWoS4e3LyDxojf8V","object":"chat.completion.chunk","created":1703783665,"model":"gpt-4-32k","choices":[{"delta":{"content":"!"},"index":0,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-oh0UFdq9cCceAKWoS4e3LyDxojf8V","object":"chat.completion.chunk","created":1703783665,"model":"gpt-4-32k","choices":[{"delta":{"content":" How"},"index":0,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-oh0UFdq9cCceAKWoS4e3LyDxojf8V","object":"chat.completion.chunk","created":1703783665,"model":"gpt-4-32k","choices":[{"delta":{"content":" can"},"index":0,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-oh0UFdq9cCceAKWoS4e3LyDxojf8V","object":"chat.completion.chunk","created":1703783665,"model":"gpt-4-32k","choices":[{"delta":{"content":" I"},"index":0,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-oh0UFdq9cCceAKWoS4e3LyDxojf8V","object":"chat.completion.chunk","created":1703783665,"model":"gpt-4-32k","choices":[{"delta":{"content":" assist"},"index":0,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-oh0UFdq9cCceAKWoS4e3LyDxojf8V","object":"chat.completion.chunk","created":1703783665,"model":"gpt-4-32k","choices":[{"delta":{"content":" you"},"index":0,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-oh0UFdq9cCceAKWoS4e3LyDxojf8V","object":"chat.completion.chunk","created":1703783665,"model":"gpt-4-32k","choices":[{"delta":{"content":" today"},"index":0,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-oh0UFdq9cCceAKWoS4e3LyDxojf8V","object":"chat.completion.chunk","created":1703783665,"model":"gpt-4-32k","choices":[{"delta":{"content":"?"},"index":0,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-oh0UFdq9cCceAKWoS4e3LyDxojf8V","object":"chat.completion.chunk","created":1703783665,"model":"gpt-4-32k","choices":[{"delta":{},"index":0,"finish_reason":"stop"}]}\n\ndata: [DONE]\n\n'

本项目响应如下：

b'data:{"id": "chatcmpl-f0a45ac3f5f04e80aad66500c9be45fb", "object": "chat.completion.chunk", "created": 1703783102, "model": "gpt-4", "choices": [{"index": 0, "delta": {"content": ""}, "finish_reason": null}]}\n\ndata: {"id": "chatcmpl-f0a45ac3f5f04e80aad66500c9be45fb", "object": "chat.completion.chunk", "created": 1703783102, "model": "gpt-4", "choices": [{"index": 0, "delta": {"content": "Hello"}, "finish_reason": null}]}\n\ndata: {"id": "chatcmpl-f0a45ac3f5f04e80aad66500c9be45fb", "object": "chat.completion.chunk", "created": 1703783102, "model": "gpt-4", "choices": [{"index": 0, "delta": {"content": "!"}, "finish_reason": null}]}\n\ndata: {"id": "chatcmpl-f0a45ac3f5f04e80aad66500c9be45fb", "object": "chat.completion.chunk", "created": 1703783102, "model": "gpt-4", "choices": [{"index": 0, "delta": {"content": " How"}, "finish_reason": null}]}\n\ndata: {"id": "chatcmpl-f0a45ac3f5f04e80aad66500c9be45fb", "object": "chat.completion.chunk", "created": 1703783102, "model": "gpt-4", "choices": [{"index": 0, "delta": {"content": " can"}, "finish_reason": null}]}\n\ndata: {"id": "chatcmpl-f0a45ac3f5f04e80aad66500c9be45fb", "object": "chat.completion.chunk", "created": 1703783102, "model": "gpt-4", "choices": [{"index": 0, "delta": {"content": " I"}, "finish_reason": null}]}\n\ndata: {"id": "chatcmpl-f0a45ac3f5f04e80aad66500c9be45fb", "object": "chat.completion.chunk", "created": 1703783102, "model": "gpt-4", "choices": [{"index": 0, "delta": {"content": " assist"}, "finish_reason": null}]}\n\ndata: {"id": "chatcmpl-f0a45ac3f5f04e80aad66500c9be45fb", "object": "chat.completion.chunk", "created": 1703783102, "model": "gpt-4", "choices": [{"index": 0, "delta": {"content": " you"}, "finish_reason": null}]}\n\ndata: {"id": "chatcmpl-f0a45ac3f5f04e80aad66500c9be45fb", "object": "chat.completion.chunk", "created": 1703783102, "model": "gpt-4", "choices": [{"index": 0, "delta": {"content": " today"}, "finish_reason": null}]}\n\ndata: {"id": "chatcmpl-f0a45ac3f5f04e80aad66500c9be45fb", "object": "chat.completion.chunk", "created": 1703783102, "model": "gpt-4", "choices": [{"index": 0, "delta": {"content": "?"}, "finish_reason": null}]}\n\ndata: [DONE]\n\n'

可以发现相对于 pandoraNext 的接口，少了第一行关于 "choices":[{"delta":{"role":"assistant"},"index":0,"finish_reason":null}] 的响应，和最后一行关于 "choices":[{"delta":{},"index":0,"finish_reason":"stop"}] 的响应，在某些平台可能出错。

[lvguanjun]

整个花活

[Ink-Osier]

最新版已修复该问题，请升级最新版再试一下

[Ink-Osier]

整个花活

酷