defenseunicorns / leapfrogai

Production-ready Generative AI for local, cloud native, airgap, and edge deployments.
https://leapfrog.ai
Apache License 2.0
250 stars 28 forks source link

Creating queue/processing system that performs `runs` #482

Open YrrepNoj opened 4 months ago

YrrepNoj commented 4 months ago

User Story

When a POST https://api.openai.com/v1/threads/{thread_id}/runs request is made, a {RUN_OBJECT} is created and stored in our database.

We need to have Business Logic that executes the {RUN_OBJECT}.

gphorvath commented 4 months ago

Might be able to use Supabase Realtime to address this: https://supabase.com/docs/guides/realtime

justinthelaw commented 1 week ago

Blocked by #968