search

terryky / tflite_gles_app

GPU accelerated deep learning inference applications for RaspberryPi / JetsonNano / Linux PC using TensorflowLite GPUDelegate / TensorRT
MIT License
488 stars 130 forks source link

OpenCL backend tflite gpu delegate #15

Open rose-jinyang opened 3 years ago

rose-jinyang commented 3 years ago

Hello How are you? Thanks for contributing to this project. I am going to use the OpenCL backend tflite runtime on RK3399 Ubuntu 18.04 aarch64. I found that u provided a script to build tflite gpu delegate so file for aarch64. (https://github.com/terryky/tflite_gles_app/blob/master/tools/scripts/tf2.4/build_libtflite_r2.4_aarch64.sh) Do u think that the gpu delegate so file built by your script can use the OpenCL on RK3399 Mali T860? Thanks

terryky commented 3 years ago

yes, I think it will works although I've never tested it on RK3399.

rose-jinyang commented 3 years ago

I got the built gpu delegate so file "libtensorflowlite_gpu_delegate.so" BTW where can I get the built main tensorflowlite library file? I could not find the file.

terryky commented 3 years ago

./tensorflow/bazel-bin/tensorflow/lite/libtensorflowlite.so could you read README.md?

rose-jinyang commented 3 years ago

thanks

rose-jinyang commented 3 years ago

Did u try to build/use the GPU enabled tflite runtime for Python? if so, could u let me know about the steps/methods? Thanks

terryky commented 3 years ago

Unfortunatelly, no. I'm not familiar with tflite-python-API.

aidlearning commented 3 years ago

Did u try to build/use the GPU enabled tflite runtime for Python? if so, could u let me know about the steps/methods? Thanks

you can refer aid learning . it make Python calling gpu in tflite directly