Update QV compile tests to use a real QV circuit

mtreinish commented 1 month ago

The previous QV transpile benchmarks were all loading the circuit from qasm2.0 files. However, a real quantum volume circuit should be defined with haar random SU(4) matrices and the compiler's job is to synthesize that to a realization that is executable on the hardware. With the exception of staq all the toolkit's we're running this benchmark on support representing a quantum circuit like this, and we already had code to generate a quantum volume circuit for construction benchmarks. Staq is the exception here as it is unable to represent an arbitrary 2q unitary operator as it only supports qasm 2.0 as the input format. This commit makes this test a hard failure as the library lacks support for this where everything else that has a transpiler supports it.

nonhermitian commented 1 month ago

This will have to wait until after we push a 1.0 version as we are nearly complete on the data collection for that.

mtreinish commented 13 hours ago

@nonhermitian now that we've branched 1.0 I think this should be ready

Qiskit / benchpress

Update QV compile tests to use a real QV circuit #76