prefetch in Stream implementation for ARM can significantly degrade performance.

google / highway

Performance-portable, length-agnostic SIMD with runtime dispatch

Apache License 2.0

4.26k stars 322 forks source link

prefetch in Stream implementation for ARM can significantly degrade performance. #2370

Open gmh42 opened 3 weeks ago

gmh42 commented 3 weeks ago

The prefetch in Stream here: https://github.com/google/highway/blob/master/hwy/ops/arm_neon-inl.h#L4061 in the ARM implementation of Stream can degrade throughput. On a Jetson Nano, I have a Memset-like operation that can achieve 11 GB/s with Store, and is reduced to ~3.5 GB/s with Stream unless I remove the prefetch. Can the prefetch be removed or made optional?

jan-wassenberg commented 3 weeks ago

Hi, thanks for reporting. Are you aware of another way to implement the non-temporal behavior? Data Cache Clean is a system instruction. If not, we'd welcome a pull request to remove the prefetch.