search

livepeer / ai-worker

https://livepeer.ai
MIT License
17 stars 27 forks source link

Livepool llm rebased #210

Closed ad-astra-video closed 4 days ago

ad-astra-video commented 1 week ago

Rebase Livepool LLM PR showing updates to rebase to current ai-worker and couple fixes:

  1. return managed container after stream response is completed rather than immediately.
  2. fix containerHosts port to match to route for managed containers.
  3. move check_torch_cuda.py helper file to dev folder
ad-astra-video commented 4 days ago

Closing,LLM PR by Livepool is updated