In the sence of image recognize. tps of simple_tensorflow_serving not very well ,below 10.

tobegit3hub / simple_tensorflow_serving

Generic and easy-to-use serving service for machine learning models

https://stfs.readthedocs.io

Apache License 2.0

757 stars 195 forks source link

Open w279805299 opened 5 years ago

w279805299 commented 5 years ago

the test pic is about 1160*640

tobegit3hub commented 5 years ago

It may be the problem of the complex of you model.

Can you try to inference one image with the pure TensorFlow Session.run()?

w279805299 commented 5 years ago

Just use Session.run.The model is mobile-SSD-FON. But，Inference machine uses CPU model and It has 64 cores