fcabrera23
commented
8 months ago - Deploy OpenVino Model Server (OVMS) using AKS-EE
- Node setup with OpeVino Operator Toolkit
- Model downloading into Linux node(3 diff models)
- Model configurations using configMap
- Model serving using PV and PVC (local-path)
- LoadBalancer configuration for services (gRPC = 8000, Http = 8001)
- Inferencing demo using resnet-50 (~8GB of memory required)