Support async predictors (✨ again ✨)

replicate / cog

Containers for machine learning

https://cog.run

Apache License 2.0

8.1k stars 564 forks source link

Closed meatballhat closed 3 weeks ago

meatballhat commented 4 weeks ago

Reverts #2022 to restore #2010

plus:

use async stream redirector in setup, which means writes from C will not be captured
switch to sync stream redirector when not running in async mode
adjusting accordingly for tests

Closes PLAT-373

meatballhat commented 3 weeks ago

(now rebased with the stream redirection integration tests)