saidinesh5
commented
3 years ago We now have feature flags:
- edgetpu_acceleration
- gpu_acceleration
That can be used to enable hardware acceleration, whenever the environment permits.
So closing this issue now, thanks to https://github.com/hotg-ai/librunecoral/pull/18
https://www.tensorflow.org/lite/performance/gpu_advanced
On Mobile devices and even on devices like raspberry pi this can bring us significant speed ups and power savings. But this needs to be parameterized, because there is no point in trying to use GPU for simpler models.