mtreinish
commented
2 years ago Running this locally with qiskit-terra 0.20.1 returned:
Benchmark: Bernstein Vazirani
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━┓
┃ Name ┃ Min ┃ Max ┃ Mean ┃ depth ┃ size ┃ xi ┃ fidelity ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━╇━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━┩
│ qiskit (Optimization level: 1 on fake_guadalupe) │ 0.03523 (1.58) │ 0.04925 (1.40) │ 0.04072 (1.50) │ 25 (3.12) │ 73 (2.70) │ 0.3731 (3.51) │ 0.7093 (10.17) │
│ qiskit (Optimization level: 3 on fake_melbourne) │ 0.1041 (4.66) │ 0.1254 (3.57) │ 0.116 (4.28) │ 17 (2.12) │ 42 (1.56) │ 0.1944 (1.83) │ 0.5685 (8.15) │
│ qiskit (Optimization level: 1 on fake_melbourne) │ 0.05919 (2.65) │ 0.07311 (2.08) │ 0.06686 (2.46) │ 26 (3.25) │ 71 (2.63) │ 0.3538 (3.33) │ 0.4784 (6.86) │
│ qiskit (Optimization level: 0 on fake_melbourne) │ 0.04867 (2.18) │ 0.06364 (1.81) │ 0.05506 (2.03) │ 40 (5.00) │ 107 (3.96) │ 0.3663 (3.44) │ 0.2877 (4.12) │
│ qiskit (Optimization level: 1 on fake_toronto) │ 0.03718 (1.67) │ 0.0539 (1.53) │ 0.04427 (1.63) │ 20 (2.50) │ 67 (2.48) │ 0.3115 (2.93) │ 0.4348 (6.23) │
│ qiskit (Optimization level: 2 on fake_guadalupe) │ 0.03539 (1.59) │ 0.05893 (1.68) │ 0.05025 (1.85) │ 25 (3.12) │ 73 (2.70) │ 0.3731 (3.51) │ 0.7093 (10.17) │
│ qiskit (Optimization level: 2 on fake_melbourne) │ 0.06089 (2.73) │ 0.08169 (2.32) │ 0.07417 (2.73) │ 26 (3.25) │ 71 (2.63) │ 0.3538 (3.33) │ 0.4784 (6.86) │
│ qiskit (Optimization level: 3 on fake_guadalupe) │ 0.06449 (2.89) │ 0.1004 (2.85) │ 0.07643 (2.82) │ 13 (1.62) │ 58 (2.15) │ 0.1923 (1.81) │ 0.7796 (11.17) │
│ qiskit (Optimization level: 2 on fake_toronto) │ 0.04346 (1.95) │ 0.1792 (5.10) │ 0.06885 (2.54) │ 18 (2.25) │ 65 (2.41) │ 0.2881 (2.71) │ 0.4671 (6.70) │
│ qiskit (Optimization level: 1 on fake_cairo) │ 0.0267 (1.20) │ 0.05647 (1.61) │ 0.04363 (1.61) │ 23 (2.88) │ 70 (2.59) │ 0.3438 (3.23) │ 0.8226 (11.79) │
│ qiskit (Optimization level: 3 on fake_toronto) │ 0.07028 (3.15) │ 0.3581 (10.18) │ 0.1256 (4.63) │ 13 (1.62) │ 55 (2.04) │ 0.1429 (1.34) │ 0.4108 (5.89) │
│ qiskit (Optimization level: 2 on fake_montreal) │ 0.04774 (2.14) │ 0.07485 (2.13) │ 0.05692 (2.10) │ 21 (2.62) │ 65 (2.41) │ 0.2881 (2.71) │ 0.7907 (11.33) │
│ qiskit (Optimization level: 1 on fake_brooklyn) │ 0.05781 (2.59) │ 0.07977 (2.27) │ 0.06935 (2.56) │ 25 (3.12) │ 73 (2.70) │ 0.3731 (3.51) │ 0.7111 (10.19) │
│ qiskit (Optimization level: 2 on fake_brooklyn) │ 0.0686 (3.07) │ 0.09067 (2.58) │ 0.0792 (2.92) │ 25 (3.12) │ 73 (2.70) │ 0.3731 (3.51) │ 0.7111 (10.19) │
│ qiskit (Optimization level: 0 on fake_brooklyn) │ 0.04347 (1.95) │ 0.06563 (1.87) │ 0.05685 (2.09) │ 30 (3.75) │ 87 (3.22) │ 0.4568 (4.29) │ 0.5205 (7.46) │
│ qiskit (Optimization level: 1 on fake_montreal) │ 0.03959 (1.77) │ 0.06999 (1.99) │ 0.04702 (1.73) │ 23 (2.88) │ 67 (2.48) │ 0.3115 (2.93) │ 0.7795 (11.17) │
│ qiskit (Optimization level: 1 on fake_rochester) │ 0.03989 (1.79) │ 0.06047 (1.72) │ 0.05215 (1.92) │ 19 (2.38) │ 42 (1.56) │ 0.6111 (5.74) │ 0.2261 (3.24) │
│ qiskit (Optimization level: 3 on fake_montreal) │ 0.06648 (2.98) │ 0.1682 (4.78) │ 0.09237 (3.40) │ 13 (1.62) │ 55 (2.04) │ 0.1429 (1.34) │ 0.8099 (11.61) │
│ qiskit (Optimization level: 3 on fake_brooklyn) │ 0.1008 (4.51) │ 0.1283 (3.65) │ 0.1131 (4.17) │ 12 (1.50) │ 53 (1.96) │ 0.1064 (1.0) │ 0.6497 (9.31) │
│ qiskit (Optimization level: 2 on fake_cairo) │ 0.04912 (2.20) │ 0.1649 (4.69) │ 0.06536 (2.41) │ 22 (2.75) │ 68 (2.52) │ 0.3226 (3.03) │ 0.8351 (11.97) │
│ qiskit (Optimization level: 3 on fake_cairo) │ 0.06448 (2.89) │ 0.2307 (6.56) │ 0.09957 (3.67) │ 13 (1.62) │ 55 (2.04) │ 0.1429 (1.34) │ 0.8926 (12.79) │
│ qiskit (Optimization level: 2 on fake_rochester) │ 0.05646 (2.53) │ 0.07924 (2.25) │ 0.06169 (2.27) │ 17 (2.12) │ 40 (1.48) │ 0.5882 (5.53) │ 0.241 (3.45) │
│ qiskit (Optimization level: 0 on fake_rochester) │ 0.03563 (1.60) │ 0.05599 (1.59) │ 0.04605 (1.70) │ 27 (3.38) │ 59 (2.19) │ 0.6981 (6.56) │ 0.06976 (1.0) │
│ qiskit (Optimization level: 3 on fake_rochester) │ 0.08373 (3.75) │ 0.1079 (3.07) │ 0.09478 (3.49) │ 8 (1.0) │ 27 (1.0) │ 0.3333 (3.13) │ 0.3585 (5.14) │
│ qiskit (Optimization level: 0 on fake_montreal) │ 0.02507 (1.12) │ 0.04255 (1.21) │ 0.03125 (1.15) │ 28 (3.50) │ 75 (2.78) │ 0.3623 (3.41) │ 0.6279 (9.00) │
│ qiskit (Optimization level: 0 on fake_toronto) │ 0.0271 (1.21) │ 0.04204 (1.20) │ 0.03219 (1.19) │ 28 (3.50) │ 75 (2.78) │ 0.3623 (3.41) │ 0.2482 (3.56) │
│ qiskit (Optimization level: 0 on fake_cairo) │ 0.0254 (1.14) │ 0.04624 (1.31) │ 0.03395 (1.25) │ 28 (3.50) │ 75 (2.78) │ 0.3623 (3.41) │ 0.6736 (9.66) │
│ qiskit (Optimization level: 0 on fake_guadalupe) │ 0.02233 (1.0) │ 0.03517 (1.0) │ 0.02714 (1.0) │ 28 (3.50) │ 75 (2.78) │ 0.3623 (3.41) │ 0.7046 (10.10) │
│ qiskit (Optimization level: 0 on fake_washington) │ 0.1509 (6.76) │ 0.8199 (23.31) │ 0.3293 (12.13) │ 30 (3.75) │ 87 (3.22) │ 0.4568 (4.29) │ 0.2717 (3.90) │
│ qiskit (Optimization level: 2 on fake_washington) │ 0.1243 (5.57) │ 0.4138 (11.77) │ 0.198 (7.29) │ 17 (2.12) │ 65 (2.41) │ 0.2881 (2.71) │ 0.8451 (12.11) │
│ qiskit (Optimization level: 3 on fake_washington) │ 0.1417 (6.34) │ 0.7914 (22.50) │ 0.4369 (16.10) │ 17 (2.12) │ 58 (2.15) │ 0.1923 (1.81) │ 0.7603 (10.90) │
│ qiskit (Optimization level: 1 on fake_washington) │ 0.1345 (6.02) │ 0.8205 (23.33) │ 0.483 (17.80) │ 19 (2.38) │ 67 (2.48) │ 0.3115 (2.93) │ 0.8364 (11.99) │
└───────────────────────────────────────────────────┴────────────────┴────────────────┴────────────────┴───────────┴────────────┴───────────────┴────────────────┘
Benchmark: Bernstein Vazirani (mid-circuit measurement)
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Name ┃ Min ┃ Max ┃ Mean ┃ depth ┃ size ┃ xi ┃ fidelity ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ qiskit (Optimization level: 0 on fake_toronto) │ 0.006731 (1.21) │ 0.009448 (1.0) │ 0.0081 (1.0) │ 44 (2.44) │ 44 (2.32) │ 0.125 (1.0) │ 0.5561 (3.30) │
│ qiskit (Optimization level: 0 on fake_melbourne) │ 0.02413 (4.33) │ 0.04867 (5.15) │ 0.02967 (3.66) │ 34 (1.89) │ 42 (2.21) │ 0.1333 (1.07) │ 0.736 (4.36) │
│ qiskit (Optimization level: 1 on fake_melbourne) │ 0.02618 (4.70) │ 0.04514 (4.78) │ 0.03372 (4.16) │ 18 (1.0) │ 19 (1.0) │ 0.5714 (4.57) │ 0.736 (4.36) │
│ qiskit (Optimization level: 1 on fake_guadalupe) │ 0.00841 (1.51) │ 0.02629 (2.78) │ 0.01519 (1.88) │ 43 (2.39) │ 43 (2.26) │ 0.129 (1.03) │ 0.8791 (5.21) │
│ qiskit (Optimization level: 2 on fake_melbourne) │ 0.02886 (5.18) │ 0.04091 (4.33) │ 0.03341 (4.13) │ 25 (1.39) │ 25 (1.32) │ 0.3077 (2.46) │ 0.7264 (4.31) │
│ qiskit (Optimization level: 0 on fake_guadalupe) │ 0.00557 (1.0) │ 0.01649 (1.75) │ 0.008331 (1.03) │ 44 (2.44) │ 44 (2.32) │ 0.125 (1.0) │ 0.8762 (5.19) │
│ qiskit (Optimization level: 2 on fake_guadalupe) │ 0.02105 (3.78) │ 0.03551 (3.76) │ 0.02641 (3.26) │ 39 (2.17) │ 39 (2.05) │ 0.1481 (1.19) │ 0.8442 (5.00) │
│ qiskit (Optimization level: 3 on fake_guadalupe) │ 0.02855 (5.13) │ 0.04534 (4.80) │ 0.03601 (4.45) │ 39 (2.17) │ 39 (2.05) │ 0.1481 (1.19) │ 0.8442 (5.00) │
│ qiskit (Optimization level: 2 on fake_toronto) │ 0.01776 (3.19) │ 0.03718 (3.94) │ 0.02663 (3.29) │ 39 (2.17) │ 39 (2.05) │ 0.1481 (1.19) │ 0.7982 (4.73) │
│ qiskit (Optimization level: 3 on fake_melbourne) │ 0.03822 (6.86) │ 0.05809 (6.15) │ 0.04903 (6.05) │ 25 (1.39) │ 25 (1.32) │ 0.3077 (2.46) │ 0.7264 (4.31) │
│ qiskit (Optimization level: 1 on fake_montreal) │ 0.01263 (2.27) │ 0.0226 (2.39) │ 0.01672 (2.06) │ 43 (2.39) │ 43 (2.26) │ 0.129 (1.03) │ 0.8953 (5.31) │
│ qiskit (Optimization level: 0 on fake_cairo) │ 0.00676 (1.21) │ 0.01667 (1.76) │ 0.01037 (1.28) │ 44 (2.44) │ 44 (2.32) │ 0.125 (1.0) │ 0.8659 (5.13) │
│ qiskit (Optimization level: 1 on fake_brooklyn) │ 0.01899 (3.41) │ 0.02092 (2.21) │ 0.01975 (2.44) │ 43 (2.39) │ 43 (2.26) │ 0.129 (1.03) │ 0.8475 (5.02) │
│ qiskit (Optimization level: 2 on fake_cairo) │ 0.01891 (3.39) │ 0.0336 (3.56) │ 0.02688 (3.32) │ 39 (2.17) │ 39 (2.05) │ 0.1481 (1.19) │ 0.9315 (5.52) │
│ qiskit (Optimization level: 2 on fake_brooklyn) │ 0.02881 (5.17) │ 0.04215 (4.46) │ 0.03632 (4.48) │ 39 (2.17) │ 39 (2.05) │ 0.1481 (1.19) │ 0.8815 (5.23) │
│ qiskit (Optimization level: 0 on fake_brooklyn) │ 0.01202 (2.16) │ 0.01871 (1.98) │ 0.01405 (1.73) │ 44 (2.44) │ 44 (2.32) │ 0.125 (1.0) │ 0.844 (5.00) │
│ qiskit (Optimization level: 0 on fake_montreal) │ 0.006123 (1.10) │ 0.01874 (1.98) │ 0.01056 (1.30) │ 44 (2.44) │ 44 (2.32) │ 0.125 (1.0) │ 0.8962 (5.31) │
│ qiskit (Optimization level: 2 on fake_montreal) │ 0.01948 (3.50) │ 0.03241 (3.43) │ 0.02525 (3.12) │ 39 (2.17) │ 39 (2.05) │ 0.1481 (1.19) │ 0.9102 (5.40) │
│ qiskit (Optimization level: 3 on fake_toronto) │ 0.02359 (4.23) │ 0.1202 (12.72) │ 0.05152 (6.36) │ 39 (2.17) │ 39 (2.05) │ 0.1481 (1.19) │ 0.7982 (4.73) │
│ qiskit (Optimization level: 3 on fake_rochester) │ 0.02512 (4.51) │ 0.03655 (3.87) │ 0.02947 (3.64) │ 25 (1.39) │ 25 (1.32) │ 0.3077 (2.46) │ 0.4967 (2.94) │
│ qiskit (Optimization level: 3 on fake_montreal) │ 0.03499 (6.28) │ 0.09908 (10.49) │ 0.04171 (5.15) │ 39 (2.17) │ 39 (2.05) │ 0.1481 (1.19) │ 0.9102 (5.40) │
│ qiskit (Optimization level: 1 on fake_cairo) │ 0.01236 (2.22) │ 0.04163 (4.41) │ 0.01683 (2.08) │ 43 (2.39) │ 43 (2.26) │ 0.129 (1.03) │ 0.8658 (5.13) │
│ qiskit (Optimization level: 1 on fake_rochester) │ 0.01388 (2.49) │ 0.0245 (2.59) │ 0.01733 (2.14) │ 25 (1.39) │ 25 (1.32) │ 0.3077 (2.46) │ 0.1708 (1.01) │
│ qiskit (Optimization level: 3 on fake_brooklyn) │ 0.04757 (8.54) │ 0.06076 (6.43) │ 0.0547 (6.75) │ 39 (2.17) │ 39 (2.05) │ 0.1481 (1.19) │ 0.8815 (5.23) │
│ qiskit (Optimization level: 0 on fake_rochester) │ 0.00616 (1.11) │ 0.01622 (1.72) │ 0.0108 (1.33) │ 26 (1.44) │ 26 (1.37) │ 0.2857 (2.29) │ 0.1687 (1.0) │
│ qiskit (Optimization level: 2 on fake_rochester) │ 0.0139 (2.50) │ 0.02754 (2.92) │ 0.01976 (2.44) │ 25 (1.39) │ 25 (1.32) │ 0.3077 (2.46) │ 0.4967 (2.94) │
│ qiskit (Optimization level: 1 on fake_toronto) │ 0.009187 (1.65) │ 0.04362 (4.62) │ 0.01623 (2.00) │ 43 (2.39) │ 43 (2.26) │ 0.129 (1.03) │ 0.5593 (3.32) │
│ qiskit (Optimization level: 3 on fake_cairo) │ 0.0245 (4.40) │ 0.07529 (7.97) │ 0.04084 (5.04) │ 39 (2.17) │ 39 (2.05) │ 0.1481 (1.19) │ 0.9315 (5.52) │
│ qiskit (Optimization level: 0 on fake_washington) │ 0.02968 (5.33) │ 0.2485 (26.30) │ 0.1283 (15.84) │ 44 (2.44) │ 44 (2.32) │ 0.125 (1.0) │ 0.8365 (4.96) │
│ qiskit (Optimization level: 1 on fake_washington) │ 0.02951 (5.30) │ 0.0991 (10.49) │ 0.06407 (7.91) │ 43 (2.39) │ 43 (2.26) │ 0.129 (1.03) │ 0.835 (4.95) │
│ qiskit (Optimization level: 3 on fake_washington) │ 0.1456 (26.14) │ 0.5636 (59.65) │ 0.3382 (41.75) │ 39 (2.17) │ 39 (2.05) │ 0.1481 (1.19) │ 0.953 (5.65) │
│ qiskit (Optimization level: 2 on fake_washington) │ 0.02469 (4.43) │ 0.05288 (5.60) │ 0.03567 (4.40) │ 39 (2.17) │ 39 (2.05) │ 0.1481 (1.19) │ 0.953 (5.65) │
└───────────────────────────────────────────────────┴─────────────────┴─────────────────┴─────────────────┴───────────┴───────────┴───────────────┴───────────────┘
TLDR
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Name ┃ Mean ┃ ┃ ┃ ┃ ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ qiskit (Optimization level: 0 on fake_brooklyn) │ 1 (1.88) │ 1 (2.57) │ 1 (2.38) │ 1 (1.90) │ 1 (6.11) │
│ qiskit (Optimization level: 0 on fake_cairo) │ 0.664 (1.25) │ 0.9661 (2.48) │ 0.9285 (2.21) │ 0.8906 (1.70) │ 1.152 (7.04) │
│ qiskit (Optimization level: 0 on fake_guadalupe) │ 0.5321 (1.0) │ 0.9661 (2.48) │ 0.9285 (2.21) │ 0.8906 (1.70) │ 1.185 (7.24) │
│ qiskit (Optimization level: 0 on fake_melbourne) │ 1.43 (2.69) │ 1.015 (2.61) │ 1.084 (2.58) │ 0.9249 (1.76) │ 0.6943 (4.24) │
│ qiskit (Optimization level: 0 on fake_montreal) │ 0.6427 (1.21) │ 0.9661 (2.48) │ 0.9285 (2.21) │ 0.8906 (1.70) │ 1.132 (6.92) │
│ qiskit (Optimization level: 0 on fake_rochester) │ 0.7891 (1.48) │ 0.7293 (1.87) │ 0.633 (1.51) │ 1.869 (3.56) │ 0.1637 (1.0) │
│ qiskit (Optimization level: 0 on fake_toronto) │ 0.5714 (1.07) │ 0.9661 (2.48) │ 0.9285 (2.21) │ 0.8906 (1.70) │ 0.5605 (3.42) │
│ qiskit (Optimization level: 0 on fake_washington) │ 7.274 (13.67) │ 1 (2.57) │ 1 (2.38) │ 1 (1.90) │ 0.7194 (4.40) │
│ qiskit (Optimization level: 1 on fake_brooklyn) │ 1.31 (2.46) │ 0.9024 (2.32) │ 0.9055 (2.16) │ 0.9183 (1.75) │ 1.171 (7.16) │
│ qiskit (Optimization level: 1 on fake_cairo) │ 0.959 (1.80) │ 0.8656 (2.22) │ 0.8867 (2.11) │ 0.8814 (1.68) │ 1.273 (7.78) │
│ qiskit (Optimization level: 1 on fake_guadalupe) │ 0.88 (1.65) │ 0.9024 (2.32) │ 0.9055 (2.16) │ 0.9183 (1.75) │ 1.191 (7.28) │
│ qiskit (Optimization level: 1 on fake_melbourne) │ 1.68 (3.16) │ 0.5954 (1.53) │ 0.5936 (1.41) │ 1.882 (3.58) │ 0.8953 (5.47) │
│ qiskit (Optimization level: 1 on fake_montreal) │ 0.9922 (1.86) │ 0.8656 (2.22) │ 0.8675 (2.07) │ 0.839 (1.60) │ 1.26 (7.70) │
│ qiskit (Optimization level: 1 on fake_rochester) │ 1.064 (2.00) │ 0.5999 (1.54) │ 0.5237 (1.25) │ 1.815 (3.45) │ 0.2965 (1.81) │
│ qiskit (Optimization level: 1 on fake_toronto) │ 0.9484 (1.78) │ 0.8072 (2.07) │ 0.8675 (2.07) │ 0.839 (1.60) │ 0.744 (4.55) │
│ qiskit (Optimization level: 1 on fake_washington) │ 6.225 (11.70) │ 0.7867 (2.02) │ 0.8675 (2.07) │ 0.839 (1.60) │ 1.261 (7.70) │
│ qiskit (Optimization level: 2 on fake_brooklyn) │ 1.898 (3.57) │ 0.8594 (2.21) │ 0.8624 (2.05) │ 0.9839 (1.87) │ 1.195 (7.30) │
│ qiskit (Optimization level: 2 on fake_cairo) │ 1.483 (2.79) │ 0.8062 (2.07) │ 0.8323 (1.98) │ 0.9149 (1.74) │ 1.331 (8.13) │
│ qiskit (Optimization level: 2 on fake_guadalupe) │ 1.289 (2.42) │ 0.8594 (2.21) │ 0.8624 (2.05) │ 0.9839 (1.87) │ 1.168 (7.13) │
│ qiskit (Optimization level: 2 on fake_melbourne) │ 1.762 (3.31) │ 0.7017 (1.80) │ 0.6809 (1.62) │ 1.381 (2.63) │ 0.8895 (5.43) │
│ qiskit (Optimization level: 2 on fake_montreal) │ 1.341 (2.52) │ 0.7877 (2.02) │ 0.8138 (1.94) │ 0.8646 (1.65) │ 1.28 (7.82) │
│ qiskit (Optimization level: 2 on fake_rochester) │ 1.235 (2.32) │ 0.5674 (1.46) │ 0.5111 (1.22) │ 1.78 (3.39) │ 0.522 (3.19) │
│ qiskit (Optimization level: 2 on fake_toronto) │ 1.515 (2.85) │ 0.7293 (1.87) │ 0.8138 (1.94) │ 0.8646 (1.65) │ 0.9213 (5.63) │
│ qiskit (Optimization level: 2 on fake_washington) │ 2.974 (5.59) │ 0.7087 (1.82) │ 0.8138 (1.94) │ 0.8646 (1.65) │ 1.354 (8.27) │
│ qiskit (Optimization level: 3 on fake_brooklyn) │ 2.783 (5.23) │ 0.5954 (1.53) │ 0.7348 (1.75) │ 0.5254 (1.0) │ 1.142 (6.98) │
│ qiskit (Optimization level: 3 on fake_cairo) │ 2.257 (4.24) │ 0.6198 (1.59) │ 0.7486 (1.78) │ 0.6088 (1.16) │ 1.376 (8.41) │
│ qiskit (Optimization level: 3 on fake_guadalupe) │ 1.856 (3.49) │ 0.6198 (1.59) │ 0.7687 (1.83) │ 0.7064 (1.34) │ 1.224 (7.48) │
│ qiskit (Optimization level: 3 on fake_melbourne) │ 2.669 (5.02) │ 0.5674 (1.46) │ 0.5237 (1.25) │ 1.024 (1.95) │ 0.9696 (5.92) │
│ qiskit (Optimization level: 3 on fake_montreal) │ 2.197 (4.13) │ 0.6198 (1.59) │ 0.7486 (1.78) │ 0.6088 (1.16) │ 1.296 (7.92) │
│ qiskit (Optimization level: 3 on fake_rochester) │ 1.87 (3.51) │ 0.3892 (1.0) │ 0.4199 (1.0) │ 1.34 (2.55) │ 0.6366 (3.89) │
│ qiskit (Optimization level: 3 on fake_toronto) │ 2.846 (5.35) │ 0.6198 (1.59) │ 0.7486 (1.78) │ 0.6088 (1.16) │ 0.864 (5.28) │
│ qiskit (Optimization level: 3 on fake_washington) │ 13.6 (25.56) │ 0.7087 (1.82) │ 0.7687 (1.83) │ 0.7064 (1.34) │ 1.284 (7.85) │
└───────────────────────────────────────────────────┴───────────────┴───────────────┴───────────────┴───────────────┴───────────────┘
(I think we should maybe add an option to the table change what the best result is for a field. For things like fidelity we want a higher value not a lower value)
This commit adds a new benchmark for bernstein vazirani circuit compilation comparing the output circuit at different optimization levels with Qiskit's compiler and also comparing the noisy simulation fidelity against an ideal result.