[FEAT] Streaming Response support - Githubissues

NeonGeckoCom / neon_solvers

Other

0 stars 1 forks source link

[FEAT] Streaming Response support #7

Open NeonDaniel opened 1 year ago

NeonDaniel commented 1 year ago

Objective

Implement a method to allow for streaming responses.

Initial Implementation Requirements

Define an iterator method that yields partial responses
Define methods for defining a response is complete
Define methods for terminating a response early(?)

Other Considerations

Relating to https://github.com/NeonGeckoCom/neon-llm-chatgpt/issues/2

JarbasAl commented 1 month ago

we have this in OVOS https://github.com/OpenVoiceOS/ovos-plugin-manager/pull/213

and used already in our ChatGPT skill etc