aws-samples / eks-kubeflow-workshop

Kubeflow workshop on EKS. Mainly focus on AWS integration examples. Please go check kubeflow website http://kubeflow.org for other examples
Apache License 2.0
96 stars 56 forks source link

Add example on how to use elastic inference #60

Open dalbhanj opened 4 years ago

dalbhanj commented 4 years ago

Customers want to use Elastic Inference (https://aws.amazon.com/machine-learning/elastic-inference/) to save cost while running inference. An example showcasing this in a notebook would be great. Also, would be good to highlight some limitations customers may run into while using Elastic Inference

PatrickXYS commented 4 years ago

I think we could bring up an example of Elastic Inference services.

@Jeffwan what do you think?

Jeffwan commented 4 years ago

Here's the example from blog post

This is kind of hack and I am still waiting for more native kubernetes integrations. We can design a device plugin for this. For short term, we can consider to add an example for this in serving section. I suggest to check with internal team first.