Closed lialan closed 1 week ago
problem arose while working on https://github.com/iree-org/iree/pull/17601 So hopefully this can unblock.
@ commit 321942b57009a194b4b74b08f95149d1946d7be4 (vs. base eede9f26b2e5a593eebe4362cd0de389dc01d8af)
Benchmark Name | Average Latency (ms) | Median Latency (ms) | Latency Standard Deviation (ms) |
---|---|---|---|
GPT2\_117M\_TF\_1X4XI32(stablehlo) [armv8.2-a-generic-linux\_android29-llvm\_cpu][experimental-flags,no-dt] local\_task(embedded\_elf)[1-thread,full-inference,system-scheduling] with default @ pixel-6-pro[big-cores] | 142.375 (vs. 130.251, 9.31%↑) | 142.178 | 0.448 |
Benchmark Name | Average Latency (ms) | Median Latency (ms) | Latency Standard Deviation (ms) |
---|---|---|---|
GPT2\_117M\_TF\_1X4XI32(stablehlo) [armv8.2-a-generic-linux\_android29-llvm\_cpu][default-flags,dt-uk] local\_task(embedded\_elf)[1-thread,full-inference,system-scheduling] with default @ pixel-6-pro[big-cores] | 29.047 (vs. 31.018, 6.35%↓) | 29.158 | 0.751 |
Vit\_int8(tflite) [armv8.2-a-generic-linux\_android29-llvm\_cpu][default-flags,dt-uk] local\_task(embedded\_elf)[2-thread,full-inference,system-scheduling] with default @ pixel-6-pro[big-cores] | 183.807 (vs. 195.052, 5.77%↓) | 184.228 | 5.141 |
DeepLabV3\_fp32(tflite) [armv8.2-a-generic-linux\_android29-llvm\_cpu][default-flags,dt-uk] local\_sync(embedded\_elf)[full-inference,default-flags] with default @ pixel-6-pro[big-cores] | 43.532 (vs. 46.083, 5.53%↓) | 43.533 | 0.321 |
[Top 3 out of 5 results showed]
No improved or regressed compilation metrics 🏖️
For more information:
This is respond to https://github.com/iree-org/iree/issues/17641