leaf-ai / studio-go-runner

ML/ENN Runner for privately hosted, cloud, and data-center production deployments of StudioML.
https://studio.ml
Other
1 stars 9 forks source link

Azure native queue and storage support #162

Open karlmutch opened 6 years ago

karlmutch commented 6 years ago

As a user of the Azure cloud platform I want to have StudioML and Go runner use Azure native queues and storage In order that scaling objectives can be met for Azure deployments

RabbitMQ and Minio work to 110-150 machines but dont scale well above that unless clustering is used at which point it would be better to have the cloud native implementation from the cloud provider.

This requirement is gated on our desire to have large scale Azure deployments which is not yet a clear priority but might be at some point.

karlmutch commented 5 years ago

This might be better supported by the Google Cloud SDK. https://gocloud.dev/