search

heurist-network / miner-release

Stable Diffusion and LLM miner for Heurist
Other
40 stars 34 forks source link

fix: check second chunk #18

Closed tsubasakong closed 5 months ago

tsubasakong commented 5 months ago

when steam, the content in first chunk of response is None, though the contents in the following chunks are normal. 

ChatCompletionChunk(id='cmpl-5b95e0b0571d430883db767ae35a48ae', choices=[Choice(delta=ChoiceDelta(content=None, function_call=None, role='assistant', tool_calls=None), finish_reason=None, index=0, logprobs=None)], created=2674287, model='openhermes-2.5-mistral-7b-gptq', object='chat.completion.chunk', system_fingerprint=None)

ChatCompletionChunk(id='cmpl-5b95e0b0571d430883db767ae35a48ae', choices=[Choice(delta=ChoiceDelta(content='Conf', function_call=None, role=None, tool_calls=None), finish_reason=None, index=0, logprobs=None)], created=2674287, model='openhermes-2.5-mistral-7b-gptq', object='chat.completion.chunk', system_fingerprint=None)

ChatCompletionChunk(id='cmpl-5b95e0b0571d430883db767ae35a48ae', choices=[Choice(delta=ChoiceDelta(content='ident', function_call=None, role=None, tool_calls=None), finish_reason=None, index=0, logprobs=None)], created=2674287, model='openhermes-2.5-mistral-7b-gptq', object='chat.completion.chunk', system_fingerprint=None)