search

beam-cloud / beta9

The open-source serverless GPU container runtime.
https://docs.beta9.beam.cloud
GNU Affero General Public License v3.0
297 stars 12 forks source link

Add timeouts to endpoint and taskqueue serves #331

Closed jsun-m closed 6 days ago

jsun-m commented 1 week ago

Serves will timeout after 10 minutes of activity. File changes will refresh this timer.

Users can set their own timeout through the cli command beta9 serve file.py:func --timeout 600 Timeout value of 0 will use the default timeout Timeout value of -1 will remove the timeout and persist the container for as long as the user is connected