search

awslabs / keras-apache-mxnet

[DEPRECATED] Amazon Deep Learning's Keras with Apache MXNet support
https://github.com/awslabs/keras-apache-mxnet/wiki
Other
290 stars 65 forks source link

Support for Amazon Elastic Inference for prediction - Keras and MXNet backend #236

Closed sandeep-krishnamurthy closed 5 years ago

sandeep-krishnamurthy commented 5 years ago

Summary

This PR adds support for running Keras prediction with Apache MXNet backend utilizing Amazon Elastic Inference Accelerator.

This functionality is currently supported with MXNet backend only. I have included tests and a tutorial to show how to use.

@roywei @samskalicky - Can you please review this changes?

roywei commented 5 years ago

How do I test this? where can I get "eia" context? -Update: Now i get it, will follow the tutorial and try it out!

sandeep-krishnamurthy commented 5 years ago

How do I test this? where can I get "eia" context? -Update: Now i get it, will follow the tutorial and try it out!

I referred this blog, it gives a simple script to launch an EC2 instance with EI attached - https://aws.amazon.com/blogs/machine-learning/launch-ei-accelerators-in-minutes-with-the-amazon-elastic-inference-setup-tool-for-ec2/

Without this script, it is bit of hassle to get EI working easily.

sandeep-krishnamurthy commented 5 years ago

@samskalicky - Addressed your comments. Thanks for your review.

sandeep-krishnamurthy commented 5 years ago

Thanks for this nice feature, one comment. not sure if this is related to PR test failure.

PR tests were failing because, I had not rebase to latest master which had all cached op bug fixes.

sandeep-krishnamurthy commented 5 years ago

@roywei - thanks for reviewing. Addressed your comments.