search

microsoftarchive / BatchAI

Repo for publishing code Samples and CLI samples for BatchAI service
MIT License
124 stars 62 forks source link

Support 'serverless' scenarios similar to ACI #32

Open damienpontifex opened 6 years ago

damienpontifex commented 6 years ago

Azure Container Instances allow you to spin up a container workload and just define memory and CPU requirements. It would be great if this was possible with BatchAI to remove the idea of having a cluster.

To be able to deploy a job and in there define memory, CPU and GPU or more generally machine requirements and they be managed for you. Allow the data scientist/developer to just focus on the job itself.

Looking into it a bit, this seems similar to how Google run their ML engine jobs defining a scale tier, although I much prefer Batch AIs method of using custom containers vs ML Engines runtime versions to actually run the jobs 😄

SenthuranSivananthan commented 6 years ago

There are some scenarios that AWS brought up at re:Invent that we can unlock through ACI.

Reference: https://fr.slideshare.net/AmazonWebServices/srv317unlocking-high-performance-computing-for-financial-services-with-serverless-compute