swapped asyncio for thread

BoundaryML / baml

BAML is a templating language to write typed LLM functions. Check out the promptfiddle.com playground

https://docs.boundaryml.com

Apache License 2.0

467 stars 13 forks source link

Closed anish-palakurthi closed 2 weeks ago

anish-palakurthi commented 2 weeks ago

Fixed streaming buffer delay by separating stream handler to another thread.

vercel[bot] commented 2 weeks ago

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
baml	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Jun 28, 2024 1:16am

sxlijin commented 2 weeks ago

verified this works with tracing