Chat Stream Integration

[kevinthedang]

Added

• streamResponse and blockResponse as two ways of generating a response from Ollama. It must be done this way for some reason or else it provides an error by putting the following:

await ollama.chat({
    model: tokens.model,
    messages: msgHist.getItems(),
    options: {
        num_thread: 8, // remove if optimization needed further
        mirostat: 1,
        mirostat_tau: 2.0,
        top_k: 70
    },
    stream: <some_var_name>
})

It does not like the fact that you put a variable there... sad, but it still works otherwise.

• This feature applies to both embedded and normal styles.
• ChatParams type found in utils/events.ts that holds the "preferred" model, ollama client, and the message history.

Removed

• Axios dependency
• streamParse.ts file that only worked with the Axios package.