search

tobegit3hub / simple_tensorflow_serving

Generic and easy-to-use serving service for machine learning models
https://stfs.readthedocs.io
Apache License 2.0
757 stars 195 forks source link

batching feature #79

Open wykdg opened 4 years ago

wykdg commented 4 years ago

Is there a feature of batch merge calculation to improve GPU utilization? There is a batch merge in tensorflow-serving, which is very helpful for development and deployment. thanks