[feature] Streaming Functionality?

PenguinAI-Ext / extension

PenguinAI Extension

MIT License

2 stars 0 forks source link

[feature] Streaming Functionality? #5

Closed blazgocompany closed 1 day ago

blazgocompany commented 1 day ago

I would really appreciate it if there was a way to enable streaming (stream: True?) . That would be helpful for a lot of free AI projects. I am willing to work on it.

cicerorph commented 1 day ago

It's probably impossible to implement something like it, only if it was a reporter that you needed to check every second, and it couldn't have multiple requests at once.