Add the ability to stream `ai.chat()` responses

casual-simulation / casualos

Casual Open Simulation for the Web

https://ab1.bot

MIT License

48 stars 8 forks source link

Add the ability to stream `ai.chat()` responses #467

Closed KallynGowdy closed 1 month ago

KallynGowdy commented 1 month ago

Currently, ai.chat() only supports transactional HTTP requests. This means that AI responses will only be available to the user once they are complete. Instead, it would be great if there was an additional function ai.stream.chat() that was able to stream responses from the AI model.