livepeer / ai-worker

https://livepeer.ai
MIT License
17 stars 27 forks source link

Fix external containers #72

Closed ad-astra-video closed 3 weeks ago

ad-astra-video commented 5 months ago

The changes in this PR allow connection to external containers and selection of the external containers by an orchestrator more efficiently. Limit of 1 request per container at a time initially. A 1 request queue would be a nice addition but I think is not needed right now.

Note: the go-livepeer/ai-video for selection updates relies on this update to ai-worker.

rickstaa commented 4 months ago

Dependent on https://github.com/livepeer/go-livepeer/pull/3033.

ad-astra-video commented 3 weeks ago

Closing this. The multiple containers per pipeline/model is merged separately as well.