GoogleCloudPlatform / anthos-ai

AI and Machine Learning workflows on Anthos Bare Metal.
Apache License 2.0
11 stars 3 forks source link

Create Edge ML deployment using ABM and ACM #8

Open puneith opened 3 years ago

puneith commented 3 years ago

There has been current work going on with ABM Edge large scale rollout here. One of the common workloads we've been seeing on the Edge is the deployment of ML models (like serving ML models for image classification).

Deploying these pre-trained models on the Edge involves complex software systems. ABM 1.8.0+ provides an Edge profile with minimal vCPU and Mem resource requirements and therefore well suited to deploy appropriate size ML models. Once the rollout work is finished we'd like to replace that work with an ML workload.

puneith commented 3 years ago

@Shabirmean just FYI for now, but this is something which can be a natural extension to the Edge rollout ACM work.