Garden-AI / garden

https://garden-ai.readthedocs.io
MIT License
21 stars 4 forks source link

Integrate async Modal invocation with SDK #552

Closed WillEngler closed 5 days ago

WillEngler commented 1 week ago

A number of tickets will make it possible to execute Modal functions asynchronously via the API. We need to take advantage of this from the SDK.

Assumptions:

  1. This will work similarly to how we currently run Globus Compute functions - from the SDK caller's perspective this will be a blocking call. Behind the scenes the SDK will grab a job id and poll for it to be done.

Acceptance Criteria

Given I am trying to execute a Modal function that takes more than 30 seconds to execute, when I execute it, then it runs and gives me a result instead of timing out.