Allow use of GPU for inference jobs

nginyc / rafiki

Rafiki is a distributed system that supports training and deployment of machine learning models using AutoML, built with ease-of-use in mind.

Apache License 2.0

36 stars 23 forks source link

Allow use of GPU for inference jobs #158

Closed nginyc closed 5 years ago

nginyc commented 5 years ago

Fixes #141

Inference job workers (which make predictions with trained models) can now be configured to use GPUs by passing an optional budget argument to the client.create_inference_job method. Refer to the documentation changes in this PR.