search

alexanderatallah / window.ai

Use your own AI models on the web
https://windowai.io
MIT License
839 stars 79 forks source link

Endpoint to see if a model supports streaming #64

Open alexanderatallah opened 1 year ago

alexanderatallah commented 1 year ago

Currently, there isn't an endpoint for checking on streaming support, but that's a good idea. right now, if models can't stream, onStreamResult will just never fire, but the overall promise will resolve with the full completion at the end, so at that point you'll know that streaming isn't supported