A small OpenCL benchmark program to measure peak GPU/CPU performance.
Works with any GPU in Windows, Linux, macOS and Android.
FP64, FP32, FP16, INT64, INT32, INT16, INT8)
measured compute performance divided by reported theoretical FP32 performance is shown in (round brackets)19.492 TFLOPs/s theoretical FP32, and the benchmark measures 9.512 TFLOPs/s for FP64, the ratio of (measured FP64)/(theoretical FP32) = 9.512/19.492 = 1/2.05 is rounded to the next possible value of 1/2 and reported as such1/64, 1/32, 1/24, 1/16, 1/12, 1/8, 1/4, 1/3, 1/2, 2/3, 1x, 2x, 4x, 8x, 16x, 32x, 64x, and nothing in betweencoalesced/misaligned read/write)send/receive/bidirectional)
OpenCL-Benchmark.sln in Visual Studio Community.OpenCL-Benchmark folder (type cmd in File Explorer in the directory field and press Enter), then run
OpenCL-Benchmark.exegit clone https://github.com/ProjectPhysX/OpenCL-Benchmark.git
cd OpenCL-Benchmark
chmod +x make.sh
./make.shbin/OpenCL-Benchmarkbin\OpenCL-Benchmark.exe 0 2 5 (Windows) or bin/OpenCL-Benchmark 0 2 5 (Linux/macOS) with the number(s) being the device IDs to be benchmarked.-----------------------------------------------------------------------------.
|----------------.------------------------------------------------------------|
| Device ID 0 | NVIDIA A100-PCIE-40GB |
| Device ID 1 | NVIDIA GeForce RTX 2080 Ti |
| Device ID 2 | NVIDIA GeForce RTX 2080 Ti |
| Device ID 3 | NVIDIA GeForce RTX 2080 Ti |
| Device ID 4 | NVIDIA GeForce RTX 2080 Ti |
| Device ID 5 | NVIDIA GeForce RTX 2080 Ti |
| Device ID 6 | NVIDIA GeForce RTX 2080 Ti |
| Device ID 7 | NVIDIA GeForce RTX 2080 Ti |
|----------------'------------------------------------------------------------|
|----------------.------------------------------------------------------------|
| Device ID | 0 |
| Device Name | NVIDIA A100-PCIE-40GB |
| Device Vendor | NVIDIA Corporation |
| Device Driver | 525.89.02 |
| OpenCL Version | OpenCL C 1.2 |
| Compute Units | 108 at 1410 MHz (6912 cores, 19.492 TFLOPs/s) |
| Memory, Cache | 40513 MB, 3024 KB global / 48 KB local |
| Buffer Limits | 10128 MB global, 64 KB constant |
|----------------'------------------------------------------------------------|
| Info: OpenCL C code successfully compiled. |
| FP64 compute 9.512 TFLOPs/s (1/2 ) |
| FP32 compute 19.283 TFLOPs/s ( 1x ) |
| FP16 compute not supported |
| INT64 compute 2.664 TIOPs/s (1/8 ) |
| INT32 compute 19.245 TIOPs/s ( 1x ) |
| INT16 compute 15.397 TIOPs/s (2/3 ) |
| INT8 compute 18.052 TIOPs/s ( 1x ) |
| Memory Bandwidth ( coalesced read ) 1350.39 GB/s |
| Memory Bandwidth ( coalesced write) 1503.39 GB/s |
| Memory Bandwidth (misaligned read ) 1226.41 GB/s |
| Memory Bandwidth (misaligned write) 210.83 GB/s |
| PCIe Bandwidth (send ) 22.06 GB/s |
| PCIe Bandwidth ( receive ) 21.16 GB/s |
| PCIe Bandwidth ( bidirectional) (Gen4 x16) 8.77 GB/s |
|-----------------------------------------------------------------------------|
|----------------.------------------------------------------------------------|
| Device ID | 1 |
| Device Name | NVIDIA GeForce RTX 2080 Ti |
| Device Vendor | NVIDIA Corporation |
| Device Driver | 525.89.02 |
| OpenCL Version | OpenCL C 1.2 |
| Compute Units | 68 at 1545 MHz (4352 cores, 13.448 TFLOPs/s) |
| Memory, Cache | 11011 MB, 2176 KB global / 48 KB local |
| Buffer Limits | 2752 MB global, 64 KB constant |
|----------------'------------------------------------------------------------|
| Info: OpenCL C code successfully compiled. |
| FP64 compute 0.507 TFLOPs/s (1/24) |
| FP32 compute 16.450 TFLOPs/s ( 1x ) |
| FP16 compute not supported |
| INT64 compute 3.524 TIOPs/s (1/4 ) |
| INT32 compute 16.265 TIOPs/s ( 1x ) |
| INT16 compute 12.897 TIOPs/s ( 1x ) |
| INT8 compute 10.158 TIOPs/s (2/3 ) |
| Memory Bandwidth ( coalesced read ) 533.08 GB/s |
| Memory Bandwidth ( coalesced write) 550.67 GB/s |
| Memory Bandwidth (misaligned read ) 533.38 GB/s |
| Memory Bandwidth (misaligned write) 156.57 GB/s |
| PCIe Bandwidth (send ) 12.87 GB/s |
| PCIe Bandwidth ( receive ) 12.86 GB/s |
| PCIe Bandwidth ( bidirectional) (Gen4 x16) 6.35 GB/s |
|-----------------------------------------------------------------------------|
|-----------------------------------------------------------------------------|
| Done. Press Enter to exit. |
'-----------------------------------------------------------------------------'.-----------------------------------------------------------------------------.
|----------------.------------------------------------------------------------|
| Device ID 0 | gfx906:sramecc+:xnack- |
| Device ID 1 | gfx906:sramecc+:xnack- |
| Device ID 2 | gfx906:sramecc+:xnack- |
| Device ID 3 | gfx906:sramecc+:xnack- |
| Device ID 4 | gfx906:sramecc+:xnack- |
| Device ID 5 | gfx906:sramecc+:xnack- |
| Device ID 6 | gfx90a:sramecc+:xnack- |
| Device ID 7 | gfx906:sramecc+:xnack- |
|----------------'------------------------------------------------------------|
|----------------.------------------------------------------------------------|
| Device ID | 6 |
| Device Name | gfx90a:sramecc+:xnack- |
| Device Vendor | Advanced Micro Devices, Inc. |
| Device Driver | 3513.0 (HSA1.1,LC) |
| OpenCL Version | OpenCL C 2.0 |
| Compute Units | 104 at 1700 MHz (6656 cores, 22.630 TFLOPs/s) |
| Memory, Cache | 65520 MB, 16 KB global / 64 KB local |
| Buffer Limits | 55692 MB global, 57028608 KB constant |
|----------------'------------------------------------------------------------|
| Info: OpenCL C code successfully compiled. |
| FP64 compute 17.356 TFLOPs/s (2/3 ) |
| FP32 compute 19.995 TFLOPs/s ( 1x ) |
| FP16 compute 39.680 TFLOPs/s ( 2x ) |
| INT64 compute 1.511 TIOPs/s (1/16) |
| INT32 compute 18.441 TIOPs/s (2/3 ) |
| INT16 compute 19.679 TIOPs/s ( 1x ) |
| INT8 compute 13.294 TIOPs/s (2/3 ) |
| Memory Bandwidth ( coalesced read ) 967.34 GB/s |
| Memory Bandwidth ( coalesced write) 979.27 GB/s |
| Memory Bandwidth (misaligned read ) 1302.28 GB/s |
| Memory Bandwidth (misaligned write) 634.80 GB/s |
| PCIe Bandwidth (send ) 17.66 GB/s |
| PCIe Bandwidth ( receive ) 17.60 GB/s |
| PCIe Bandwidth ( bidirectional) (Gen4 x16) 17.30 GB/s |
|-----------------------------------------------------------------------------|
|----------------.------------------------------------------------------------|
| Device ID | 7 |
| Device Name | gfx906:sramecc+:xnack- |
| Device Vendor | Advanced Micro Devices, Inc. |
| Device Driver | 3513.0 (HSA1.1,LC) |
| OpenCL Version | OpenCL C 2.0 |
| Compute Units | 60 at 1801 MHz (3840 cores, 13.832 TFLOPs/s) |
| Memory, Cache | 16368 MB, 16 KB global / 64 KB local |
| Buffer Limits | 13912 MB global, 14246707 KB constant |
|----------------'------------------------------------------------------------|
| Info: OpenCL C code successfully compiled. |
| FP64 compute 3.130 TFLOPs/s (1/4 ) |
| FP32 compute 12.440 TFLOPs/s ( 1x ) |
| FP16 compute 24.593 TFLOPs/s ( 2x ) |
| INT64 compute 0.809 TIOPs/s (1/16) |
| INT32 compute 6.273 TIOPs/s (1/2 ) |
| INT16 compute 12.488 TIOPs/s ( 1x ) |
| INT8 compute 8.314 TIOPs/s (2/3 ) |
| Memory Bandwidth ( coalesced read ) 693.40 GB/s |
| Memory Bandwidth ( coalesced write) 654.52 GB/s |
| Memory Bandwidth (misaligned read ) 805.20 GB/s |
| Memory Bandwidth (misaligned write) 400.12 GB/s |
| PCIe Bandwidth (send ) 10.36 GB/s |
| PCIe Bandwidth ( receive ) 10.28 GB/s |
| PCIe Bandwidth ( bidirectional) (Gen4 x16) 10.32 GB/s |
|-----------------------------------------------------------------------------|
|-----------------------------------------------------------------------------|
| Done. Press Enter to exit. |
'-----------------------------------------------------------------------------'.-----------------------------------------------------------------------------.
|----------------.------------------------------------------------------------|
| Device ID 0 | Intel(R) FPGA Emulation Device |
| Device ID 1 | Intel(R) Xeon(R) Platinum 8480+ |
| Device ID 2 | Intel(R) Data Center GPU Max 1100 |
| Device ID 3 | Intel(R) Data Center GPU Max 1100 |
| Device ID 4 | Intel(R) Data Center GPU Max 1100 |
| Device ID 5 | Intel(R) Data Center GPU Max 1100 |
|----------------'------------------------------------------------------------|
|----------------.------------------------------------------------------------|
| Device ID | 2 |
| Device Name | Intel(R) Data Center GPU Max 1100 |
| Device Vendor | Intel(R) Corporation |
| Device Driver | 23.17.26241.33 |
| OpenCL Version | OpenCL C 1.2 |
| Compute Units | 448 at 1550 MHz (7168 cores, 22.221 TFLOPs/s) |
| Memory, Cache | 46679 MB, 196608 KB global / 128 KB local |
| Buffer Limits | 46679 MB global, 47799500 KB constant |
|----------------'------------------------------------------------------------|
| Info: OpenCL C code successfully compiled. |
| FP64 compute 16.314 TFLOPs/s ( 1x ) |
| FP32 compute 21.932 TFLOPs/s ( 2x ) |
| FP16 compute 41.413 TFLOPs/s ( 4x ) |
| INT64 compute 1.082 TIOPs/s (1/12) |
| INT32 compute 7.028 TIOPs/s (2/3 ) |
| INT16 compute 60.320 TIOPs/s ( 4x ) |
| INT8 compute 38.822 TIOPs/s ( 4x ) |
| Memory Bandwidth ( coalesced read ) 739.91 GB/s |
| Memory Bandwidth ( coalesced write) 888.49 GB/s |
| Memory Bandwidth (misaligned read ) 718.96 GB/s |
| Memory Bandwidth (misaligned write) 319.63 GB/s |
| PCIe Bandwidth (send ) 25.42 GB/s |
| PCIe Bandwidth ( receive ) 23.10 GB/s |
| PCIe Bandwidth ( bidirectional) (Gen4 x16) 32.31 GB/s |
|-----------------------------------------------------------------------------|
|-----------------------------------------------------------------------------|
| Done. Press Enter to exit. |
'-----------------------------------------------------------------------------'.-----------------------------------------------------------------------------.
|----------------.------------------------------------------------------------|
| Device ID 0 | NVIDIA TITAN Xp |
| Device ID 1 | Tesla K40m |
| Device ID 2 | Tesla K40m |
| Device ID 3 | Tesla K40m |
|----------------'------------------------------------------------------------|
|----------------.------------------------------------------------------------|
| Device ID | 1 |
| Device Name | Tesla K40m |
| Device Vendor | NVIDIA Corporation |
| Device Driver | 470.103.01 |
| OpenCL Version | OpenCL C 1.2 |
| Compute Units | 15 at 745 MHz (2880 cores, 4.291 TFLOPs/s) |
| Memory, Cache | 11441 MB, 240 KB global / 48 KB local |
| Buffer Limits | 2860 MB global, 64 KB constant |
|----------------'------------------------------------------------------------|
| Info: OpenCL C code successfully compiled. |
| FP64 compute 1.213 TFLOPs/s (1/4 ) |
| FP32 compute 2.437 TFLOPs/s (1/2 ) |
| FP16 compute not supported |
| INT64 compute 0.618 TIOPs/s (1/8 ) |
| INT32 compute 0.714 TIOPs/s (1/8 ) |
| INT16 compute 0.689 TIOPs/s (1/8 ) |
| INT8 compute 0.679 TIOPs/s (1/8 ) |
| Memory Bandwidth ( coalesced read ) 175.44 GB/s |
| Memory Bandwidth ( coalesced write) 191.03 GB/s |
| Memory Bandwidth (misaligned read ) 41.45 GB/s |
| Memory Bandwidth (misaligned write) 37.91 GB/s |
| PCIe Bandwidth (send ) 7.67 GB/s |
| PCIe Bandwidth ( receive ) 4.35 GB/s |
| PCIe Bandwidth ( bidirectional) (Gen3 x16) 5.79 GB/s |
|-----------------------------------------------------------------------------|
|-----------------------------------------------------------------------------|
| Done. Press Enter to exit. |
'-----------------------------------------------------------------------------'.-----------------------------------------------------------------------------.
|----------------.------------------------------------------------------------|
| Device ID 0 | NVIDIA TITAN Xp |
| Device ID 1 | Intel(R) UHD Graphics 630 |
| Device ID 2 | Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz |
|----------------'------------------------------------------------------------|
|----------------.------------------------------------------------------------|
| Device ID | 0 |
| Device Name | NVIDIA TITAN Xp |
| Device Vendor | NVIDIA Corporation |
| Device Driver | 531.18 |
| OpenCL Version | OpenCL C 1.2 |
| Compute Units | 30 at 1582 MHz (3840 cores, 12.150 TFLOPs/s) |
| Memory, Cache | 12287 MB, 1440 KB global / 48 KB local |
| Buffer Limits | 3071 MB global, 64 KB constant |
|----------------'------------------------------------------------------------|
| Info: OpenCL C code successfully compiled. |
| FP64 compute 0.441 TFLOPs/s (1/32) |
| FP32 compute 12.880 TFLOPs/s ( 1x ) |
| FP16 compute not supported |
| INT64 compute 1.436 TIOPs/s (1/8 ) |
| INT32 compute 4.001 TIOPs/s (1/3 ) |
| INT16 compute 12.733 TIOPs/s ( 1x ) |
| INT8 compute 13.148 TIOPs/s ( 1x ) |
| Memory Bandwidth ( coalesced read ) 415.77 GB/s |
| Memory Bandwidth ( coalesced write) 475.51 GB/s |
| Memory Bandwidth (misaligned read ) 168.69 GB/s |
| Memory Bandwidth (misaligned write) 104.66 GB/s |
| PCIe Bandwidth (send ) 11.40 GB/s |
| PCIe Bandwidth ( receive ) 11.06 GB/s |
| PCIe Bandwidth ( bidirectional) (Gen4 x16) 11.22 GB/s |
|-----------------------------------------------------------------------------|
|----------------.------------------------------------------------------------|
| Device ID | 1 |
| Device Name | Intel(R) UHD Graphics 630 |
| Device Vendor | Intel(R) Corporation |
| Device Driver | 31.0.101.2114 |
| OpenCL Version | OpenCL C 1.2 |
| Compute Units | 24 at 1200 MHz (192 cores, 0.461 TFLOPs/s) |
| Memory, Cache | 6500 MB, 768 KB global / 64 KB local |
| Buffer Limits | 3250 MB global, 3328048 KB constant |
|----------------'------------------------------------------------------------|
| Info: OpenCL C code successfully compiled. |
| FP64 compute 0.112 TFLOPs/s (1/4 ) |
| FP32 compute 0.454 TFLOPs/s ( 1x ) |
| FP16 compute 0.781 TFLOPs/s ( 2x ) |
| INT64 compute 0.016 TIOPs/s (1/32) |
| INT32 compute 0.153 TIOPs/s (1/3 ) |
| INT16 compute 0.863 TIOPs/s ( 2x ) |
| INT8 compute 0.151 TIOPs/s (1/3 ) |
| Memory Bandwidth ( coalesced read ) 20.14 GB/s |
| Memory Bandwidth ( coalesced write) 22.94 GB/s |
| Memory Bandwidth (misaligned read ) 34.83 GB/s |
| Memory Bandwidth (misaligned write) 12.64 GB/s |
| PCIe Bandwidth (send ) 14.46 GB/s |
| PCIe Bandwidth ( receive ) 14.48 GB/s |
| PCIe Bandwidth ( bidirectional) (Gen4 x16) 9.38 GB/s |
|-----------------------------------------------------------------------------|
|----------------.------------------------------------------------------------|
| Device ID | 2 |
| Device Name | Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz |
| Device Vendor | Intel(R) Corporation |
| Device Driver | 2022.14.11.0.01_160000.xmain-hotfix |
| OpenCL Version | OpenCL C 3.0 |
| Compute Units | 12 at 3700 MHz (6 cores, 0.710 TFLOPs/s) |
| Memory, Cache | 16250 MB, 256 KB global / 32 KB local |
| Buffer Limits | 8125 MB global, 128 KB constant |
|----------------'------------------------------------------------------------|
| Info: OpenCL C code successfully compiled. |
| FP64 compute 0.179 TFLOPs/s (1/4 ) |
| FP32 compute 0.176 TFLOPs/s (1/4 ) |
| FP16 compute not supported |
| INT64 compute 0.053 TIOPs/s (1/12) |
| INT32 compute 0.061 TIOPs/s (1/12) |
| INT16 compute 0.222 TIOPs/s (1/3 ) |
| INT8 compute 0.242 TIOPs/s (1/3 ) |
| Memory Bandwidth ( coalesced read ) 22.74 GB/s |
| Memory Bandwidth ( coalesced write) 11.16 GB/s |
| Memory Bandwidth (misaligned read ) 41.23 GB/s |
| Memory Bandwidth (misaligned write) 14.21 GB/s |
| PCIe Bandwidth (send ) 15.45 GB/s |
| PCIe Bandwidth ( receive ) 14.96 GB/s |
| PCIe Bandwidth ( bidirectional) (Gen4 x16) 15.02 GB/s |
|-----------------------------------------------------------------------------|
|-----------------------------------------------------------------------------|
| Done. Press Enter to exit. |
'-----------------------------------------------------------------------------'.-----------------------------------------------------------------------------.
|----------------.------------------------------------------------------------|
| Device ID 0 | Intel(R) Arc(TM) A750 Graphics |
|----------------'------------------------------------------------------------|
|----------------.------------------------------------------------------------|
| Device ID | 0 |
| Device Name | Intel(R) Arc(TM) A750 Graphics |
| Device Vendor | Intel(R) Corporation |
| Device Driver | 23.05.25593.18 |
| OpenCL Version | OpenCL C 1.2 |
| Compute Units | 448 at 2400 MHz (3584 cores, 17.203 TFLOPs/s) |
| Memory, Cache | 8127 MB, 512 KB global / 64 KB local |
| Buffer Limits | 3860 MB global, 3953458 KB constant |
|----------------'------------------------------------------------------------|
| Info: OpenCL C code successfully compiled. |
| FP64 compute not supported |
| FP32 compute 10.254 TFLOPs/s (2/3 ) |
| FP16 compute 15.629 TFLOPs/s ( 1x ) |
| INT64 compute 1.032 TIOPs/s (1/16) |
| INT32 compute 3.896 TIOPs/s (1/4 ) |
| INT16 compute 25.614 TIOPs/s ( 1x ) |
| INT8 compute 9.434 TIOPs/s (1/2 ) |
| Memory Bandwidth ( coalesced read ) 198.56 GB/s |
| Memory Bandwidth ( coalesced write) 407.12 GB/s |
| Memory Bandwidth (misaligned read ) 384.15 GB/s |
| Memory Bandwidth (misaligned write) 285.33 GB/s |
| PCIe Bandwidth (send ) 1.33 GB/s |
| PCIe Bandwidth ( receive ) 1.28 GB/s |
| PCIe Bandwidth ( bidirectional) (Gen1 x16) 1.34 GB/s |
|-----------------------------------------------------------------------------|
|-----------------------------------------------------------------------------|
| Done. Press Enter to exit. |
'-----------------------------------------------------------------------------'