Chat: Streaming Support

[feapaydin]

Story

As a developer, I must be able to receive streaming data from OpenAI Chat (Text Generation) APIs.

Implementation Plan

• Update Rubygpt::Requester::ChatRequester#create to handle streaming from the given arguments
• Pass a streaming flag down to client.post, which should also pass it to connection.post object
• As we're using Faraday as the default adapter, we could use it's request.options.on_data callback to catch chunks
• Each chunk then must be converted into a Rubygpt::Response::ChatCompletion object
  • Merge chunks together (add + operation between Response::ChatCompletion objects?)
  • We must also allow end users to manage chunks at will (ChatRequester#create to accept a block?)

References

• https://platform.openai.com/docs/api-reference/chat/create (See "Streaming" tab and streaming flag in the request body)
• https://platform.openai.com/docs/api-reference/chat/streaming (Chunk Structure - same as normal requests)
• https://lostisland.github.io/faraday/#/adapters/custom/streaming (Faraday docs on streaming)
• https://github.com/feapaydin/rubygpt/pull/3 (Chat module implementation PR)
• https://github.com/feapaydin/rubygpt/pull/3/files#diff-6be4d3e3716368e8a7b6b2ce610ee12d8d91a7b02853dcd3427cc44f2a15a648R26 (TODO in the code that refers to this)