Do you have any workarounds about pooling layer?

[y-ich]

Hello, Hollemans san.

Thank you for your useful repository!

I found that a pooling layer which follows a convolution prevents the convolution to run on ANE. Do you know any workarounds to avoid it?

The pooling layer is actually a global average pooling layer. I tried to turn on/off globalPooling and to replace it with reduce mean, but no better effects.

Thanks.

[Additional Information] I found that padding="VALID" causes the problem. If you use padding="SAME", the model runs on ANE, but you know it is useless since the activation outputs an output with different shape.

[hollance]

Ah interesting. I don't think I've used a model with VALID padding on the ANE before.

[y-ich]

Thank you for your comment!

I will investigate further.

[teijeong]

I noticed similar problem. While running the model with profiler on, os_log output says something like "kernel size > 13 is not supported in ANE". Setting globalPooling to true also didn't work.

[hollance]

@teijeong Interesting, thanks!

By the way, what do you mean by "While running the model with profiler on"? Which profiler is this?

[teijeong]

Oh I mean, the Xcode Instruments tool

[hollance]

@teijeong System Trace or another instrument?

[teijeong]

There's an instrument called os_log. (as seen here: https://developer.apple.com/videos/play/wwdc2018/405/)

[hollance]

Great, thanks. I don't think I've used that one before, should come in handy. 😄

[teijeong]

Great! Hope you enjoy the power 😎

[y-ich]

Neural Engine on A14 seems to have a unit for pooling. Models with pooling layers run super fast on it. Amazing.

[andrewBatutin]

wonder if there is a benchmark for such models