search

tobegit3hub / simple_tensorflow_serving

Generic and easy-to-use serving service for machine learning models
https://stfs.readthedocs.io
Apache License 2.0
757 stars 193 forks source link

gpu support #12

Closed fighting-liu closed 6 years ago

fighting-liu commented 6 years ago

From your introduction, it says "support inference with accelerated GPU". How to make it happen? Thanks!

tobegit3hub commented 6 years ago

Sorry for the late reply.

It does support GPU inference because we use TensorFlow Python APIs which supports GPU. You can install tensorflow-gpu and configure CUDA dependencies before running simple_tensorflow_serving.

PurvangL commented 1 year ago

can it support GPU vendor other than Nvidia such as AMD?