replicate / cog

Containers for machine learning
https://cog.run
Apache License 2.0
8.1k stars 564 forks source link

Add serve command #2040

Closed meatballhat closed 2 weeks ago

meatballhat commented 3 weeks ago

to run an HTTP server command very similar to what is used in Replicate production. By making this command more within reach, my hope is that not only is it easier and more clear to run Cog in its HTTP server mode, but also that more Cog users will build familiarity with and opinions about the HTTP server interface.

Connected to PLAT-259

superhighfives commented 2 weeks ago

Agreed that this makes sense—I think my only request would be to add the details to the README.

bfirsh commented 2 weeks ago

Love it!