search

xmartlabs / Bender

Easily craft fast Neural Networks on iOS! Use TensorFlow models. Metal under the hood.
https://xmartlabs.github.io/Bender/
MIT License
1.8k stars 90 forks source link

Batch inference API #77

Open karthikv2k opened 6 years ago

karthikv2k commented 6 years ago

Is there a batch inference API available? In our use case, we need to perform inference on several (up to 100+) cropped parts of an image. A batch inference API would make this operation efficient. Thanks.

bryant1410 commented 6 years ago

We currently don't support batch processing. But it's something we will add in the future, albeit there's no ETA.

On vie., 22 sept. 2017 18:52 Karthik Ramasamy notifications@github.com wrote:

Is there a batch inference API available? In our use case, we need to perform inference on several (up to 100+) cropped parts of an image. A batch inference API would make this operation efficient. Thanks.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/xmartlabs/Bender/issues/77, or mute the thread https://github.com/notifications/unsubscribe-auth/ADuX3fT7op6cYtD2o3tFgDSO2mhOK4uBks5slCwPgaJpZM4PhSJR .