Closed rsuderman closed 2 weeks ago
@ commit 44f1998c89fc32d895077473488e8d0c7c98a6f0 (vs. base d7744b74023c6096d6d11c97d9d0f0277edda28a)
Benchmark Name | Average Latency (ms) | Median Latency (ms) | Latency Standard Deviation (ms) |
---|---|---|---|
MobileBertSquad\_int8(tflite) [arm-valhall-vulkan\_android31-vulkan\_spirv][default-flags] vulkan(none)[full-inference,default-flags] with default @ pixel-6-pro[gpu] | 87.564 (vs. 81.545, 7.38%↑) | 87.911 | 2.812 |
Benchmark Name | Average Latency (ms) | Median Latency (ms) | Latency Standard Deviation (ms) |
---|---|---|---|
GPT2\_117M\_TF\_1X4XI32(stablehlo) [armv8.2-a-generic-linux\_android29-llvm\_cpu][default-flags,dt-uk] local\_task(embedded\_elf)[1-thread,full-inference,system-scheduling] with default @ pixel-6-pro[big-cores] | 28.935 (vs. 31.372, 7.77%↓) | 29.285 | 0.789 |
GPT2\_117M\_TF\_1X4XI32(stablehlo) [armv8.2-a-generic-linux\_android29-llvm\_cpu][experimental-flags,dt-only] local\_task(embedded\_elf)[1-thread,full-inference,system-scheduling] with default @ pixel-6-pro[big-cores] | 29.537 (vs. 31.888, 7.37%↓) | 29.573 | 0.573 |
DeepLabV3\_fp32(tflite) [armv8.2-a-generic-linux\_android29-llvm\_cpu][default-flags,dt-uk] local\_task(embedded\_elf)[2-thread,full-inference,system-scheduling] with default @ pixel-6-pro[big-cores] | 27.664 (vs. 29.607, 6.56%↓) | 27.931 | 0.669 |
[Top 3 out of 18 results showed]
No improved or regressed compilation metrics 🏖️
For more information:
Includes bump of torch-mlir@e07a0bfc5464c3f2cd3f3a7e2a581f55ea99e176