MyIntelligenceAgency / semantic-fleet

Semantic-Fleet serves as a specialized extension hub for the Semantic-Kernel ecosystem. It houses a diverse array of connectors designed to interface with lightweight language models (LLMs).
MIT License
26 stars 2 forks source link

Oobabooga chat streaming behavior isn't aligned with ChatGPT's #17

Closed jsboige closed 11 months ago

jsboige commented 11 months ago

Oobabooga chat completion streams cumulative chunks whereas ChatGPT streams only new message chunks. Behavior should be aligned to ChatGPT's. See Notebook #2 to experience Oobabooga's behavior.