Integrating arm nn's tflite delegate to my android project

ARM-software / armnn

Arm NN ML Software. The code here is a read-only mirror of https://review.mlplatform.org/admin/repos/ml/armnn

https://developer.arm.com/products/processors/machine-learning/arm-nn

MIT License

1.18k stars 310 forks source link

Integrating arm nn's tflite delegate to my android project #788

Open mattewpsys opened 1 week ago

mattewpsys commented 1 week ago

I am working on ASR , i have converted whisper-base-en model into tflite. I wanted to decrease the inference time by using th GPU delegate, I tried with LiteRT gpu delegate it didn't work as there are many layers that are not supported by it. I wanted to integrate arm nn gpu delegate to my project. Can some guide me with that.

orlmon01 commented 1 day ago

Hiya, I would recommend you start with our documentation here. https://arm-software.github.io/armnn/24.08/