Closed Delaunay closed 2 months ago
================= Benchmark results ================= bench | fail | n | perf | sem% | std% | peak_memory | score | weight brax | 0 | 1 | 724034.46 | 0.5% | 4.2% | 6448 | 724034.46 | 1.00 dlrm | 0 | 1 | 389259.69 | 0.7% | 5.3% | 7624 | 389259.69 | 1.00 bf16 | 0 | 8 | 293.38 | 0.3% | 7.2% | 5688 | 2362.93 | 0.00 fp16 | 0 | 8 | 290.09 | 0.2% | 4.3% | 5688 | 2330.33 | 0.00 fp32 | 0 | 8 | 19.13 | 0.0% | 0.8% | 6066 | 153.18 | 0.00 tf32 | 0 | 8 | 146.85 | 0.2% | 4.5% | 6066 | 1179.77 | 0.00 bert-fp16 | 0 | 8 | 161.63 | 0.9% | 13.5% | nan | 1322.86 | 0.00 bert-fp32 | 0 | 8 | 40.11 | 0.5% | 8.2% | 35464 | 325.34 | 0.00 bert-tf32 | 0 | 8 | 130.62 | 0.9% | 13.5% | 1504 | 1068.94 | 0.00 bert-tf32-fp16 | 0 | 8 | 161.43 | 0.9% | 14.4% | nan | 1323.11 | 3.00 reformer | 0 | 8 | 62.26 | 0.3% | 5.9% | 29304 | 501.64 | 1.00 t5 | 0 | 8 | 51.27 | 0.4% | 9.8% | 5462 | 414.95 | 2.00 whisper | 0 | 8 | 162.55 | 2.3% | 51.4% | 36724 | 1305.80 | 1.00 llama | 0 | 8 | 471.59 | 4.5% | 80.5% | 32326 | 3580.15 | 1.00 opt-1_3b | 0 | 1 | 30.24 | 1.3% | 6.7% | 41854 | 30.24 | 5.00 opt-6_7b | 0 | 1 | 13.64 | 0.0% | 0.2% | 55202 | 13.64 | 5.00 stargan | 0 | 8 | 53.89 | 2.4% | 52.8% | 40710 | 432.30 | 1.00 super-slomo | 0 | 8 | 31.33 | 2.6% | 56.3% | 69972 | 250.82 | 1.00 davit_large | 0 | 8 | 322.84 | 0.6% | 13.4% | 34118 | 2614.22 | 1.00 davit_large-multi | 0 | 1 | 2187.11 | 2.1% | 16.7% | nan | 2187.11 | 5.00 focalnet | 0 | 8 | 376.81 | 0.7% | 15.5% | 27464 | 3052.06 | 2.00 resnet152 | 0 | 8 | 519.42 | 0.9% | 21.6% | 31216 | 4196.06 | 1.00 resnet152-multi | 0 | 1 | 3490.39 | 3.5% | 27.7% | nan | 3490.39 | 5.00 convnext_large-fp16 | 0 | 8 | 306.49 | 2.1% | 32.5% | 31292 | 2503.00 | 0.00 convnext_large-fp32 | 0 | 8 | 60.60 | 0.8% | 12.6% | 51200 | 495.10 | 0.00 convnext_large-tf32 | 0 | 8 | 158.14 | 0.9% | 14.6% | 53566 | 1296.65 | 0.00 convnext_large-tf32-fp16 | 0 | 8 | 315.07 | 1.9% | 29.4% | 31292 | 2574.94 | 3.00 regnet_y_128gf | 0 | 8 | 115.83 | 0.5% | 10.1% | 35514 | 937.53 | 2.00 resnet152-ddp | 0 | 1 | 4305.36 | 4.3% | 32.4% | 31740 | 4305.36 | 0.00 resnet50 | 0 | 8 | 906.21 | 2.4% | 52.1% | 14686 | 7311.99 | 1.00 resnet50-noio | 0 | 8 | 1161.23 | 0.3% | 7.3% | 31350 | 9370.68 | 0.00 Scores ------ Failure rate: 0.00% (PASS) Score: 802.90
Delaunay
commented
2 months ago Delaunay
commented
2 months ago