beam-cloud / beta9

Run GPU Workloads Across Multiple Clouds
https://docs.beam.cloud
GNU Affero General Public License v3.0
408 stars 20 forks source link

Add GPU availability endpoint for providers #345

Closed nickpetrovic closed 2 months ago

nickpetrovic commented 3 months ago

Resolve BE-1499

nickpetrovic commented 3 months ago

@luke-lombardi @jsun-m Could use some thoughts/opinions on whether or not machines should be an abstraction. Should we consider a new category?

~Oh just FYI I still need to test the abstraction.~

nickpetrovic commented 3 months ago

~Example of one can use this in their handler code.~

@endpoint()
def func():
    gpus = machines.gpus_available()
    print(f"{gpus=}")
    return {"gpus": gpus}

EDIT: We're no longer going to have an abstraction for this.