beam-cloud / beta9

Run GPU Workloads Across Multiple Clouds
https://docs.beam.cloud
GNU Affero General Public License v3.0
408 stars 20 forks source link

Revise autoscaling interface #325

Closed luke-lombardi closed 3 months ago

luke-lombardi commented 3 months ago
from beta9 import Image, QueueDepthAutoscaler, task_queue

@task_queue(
    workers=2,
    image=Image(python_version="python3.8", python_packages=["pandas", "csaps"]),
    autoscaler=QueueDepthAutoscaler(max_containers=5, tasks_per_container=1),
)
def process_file(path: str):
    import pandas as pd

    print(pd)

    print("yep...")
    import time

    time.sleep(35)

    return {"path": path, "result": True}