search

ARM-software / armnn

Arm NN ML Software. The code here is a read-only mirror of https://review.mlplatform.org/admin/repos/ml/armnn
https://developer.arm.com/products/processors/machine-learning/arm-nn
MIT License
1.17k stars 310 forks source link

ARM NN hint with scheduling #540

Closed Rahn80643 closed 3 years ago

Rahn80643 commented 3 years ago

Hi,

We had separate the model into two parts and executed on different backends through "hint": the first part is executed with GpuAcc, and the second part is executed with CpuAcc.

Since both parts in the model are separated, is it possible to schedule both parts? For example, the first part which is executed on Gpu infers t frame; meanwhile, the second part which is executed on Cpu infers the (t-1) frame.

Best regards, Rahn

MikeJKelly commented 3 years ago

Hi @Rahn80643

ArmNN cannot currently schedule model execution like that.

Best regards, Mike

keidav01 commented 3 years ago

Hi @Rahn80643

Thank you for reaching out! Based on the updated README.md found here under the "How to get involved" section we will be closing GitHub issues labeled with "Feature Request". Instead, we will be tracking the issue and adding the "Help wanted" label. All the issues with this label can be found here. We would much appreciate your help to add these features. If you would like investigate a fix for this issue feel free to reopen the ticket and let us know you are working on it with a quick comment. We will then track the updates and help you get your additions into our codebase.

Below you will find our contributors guide. If you have any questions feel free to ask here or by creating a new Issue. Thank you!

https://www.mlplatform.org/contributing

Kind regards, Keith