Open mtreinish opened 10 months ago
probably related, test.python.synthesis.test_synthesis.TestTwoQubitWeylDecompositionSpecialization.test_weyl_specialize_mirror_ctrl
fails very similarly https://dev.azure.com/qiskit-ci/qiskit/_build/results?buildId=54080&view=logs&jobId=96a5c06e-ab32-5618-636f-7d7f3fce6d94&j=96a5c06e-ab32-5618-636f-7d7f3fce6d94&t=4dff3c95-38ec-5978-7d5b-48fc44b08b5d
Now that #11797 and #11798 have landed it will be good to capture more failing examples here (along with the numpy versioning info) and hopefully there's a pattern to spot
Ok, the recent Numpy / Python theories just went out the window because it's just happened on Numpy 1.24.4 with Python 3.8: https://dev.azure.com/qiskit-ci/qiskit/_build/results?buildId=55092&view=logs&j=80763036-ed5e-5d3e-143d-8ae8edc29f03&t=fbe37352-a804-5c65-db48-e3b769f64c22. (I've retained that log, so it should stick around.)
The VM in question has a SkylakeX. Copying in the relevant output from the logs:
2024-02-29T20:22:40.2793515Z openblas64__info:
2024-02-29T20:22:40.2794126Z libraries = ['openblas64_', 'openblas64_']
2024-02-29T20:22:40.2794383Z library_dirs = ['/usr/local/lib']
2024-02-29T20:22:40.2794515Z language = c
2024-02-29T20:22:40.2794763Z define_macros = [('HAVE_CBLAS', None), ('BLAS_SYMBOL_SUFFIX', '64_'), ('HAVE_BLAS_ILP64', None)]
2024-02-29T20:22:40.2795007Z runtime_library_dirs = ['/usr/local/lib']
2024-02-29T20:22:40.2795135Z blas_ilp64_opt_info:
2024-02-29T20:22:40.2795324Z libraries = ['openblas64_', 'openblas64_']
2024-02-29T20:22:40.2795505Z library_dirs = ['/usr/local/lib']
2024-02-29T20:22:40.2795619Z language = c
2024-02-29T20:22:40.2795873Z define_macros = [('HAVE_CBLAS', None), ('BLAS_SYMBOL_SUFFIX', '64_'), ('HAVE_BLAS_ILP64', None)]
2024-02-29T20:22:40.2796096Z runtime_library_dirs = ['/usr/local/lib']
2024-02-29T20:22:40.2796234Z openblas64__lapack_info:
2024-02-29T20:22:40.2796418Z libraries = ['openblas64_', 'openblas64_']
2024-02-29T20:22:40.2796603Z library_dirs = ['/usr/local/lib']
2024-02-29T20:22:40.2796717Z language = c
2024-02-29T20:22:40.2797001Z define_macros = [('HAVE_CBLAS', None), ('BLAS_SYMBOL_SUFFIX', '64_'), ('HAVE_BLAS_ILP64', None), ('HAVE_LAPACKE', None)]
2024-02-29T20:22:40.2797239Z runtime_library_dirs = ['/usr/local/lib']
2024-02-29T20:22:40.2797377Z lapack_ilp64_opt_info:
2024-02-29T20:22:40.2797561Z libraries = ['openblas64_', 'openblas64_']
2024-02-29T20:22:40.2797746Z library_dirs = ['/usr/local/lib']
2024-02-29T20:22:40.2797860Z language = c
2024-02-29T20:22:40.2798129Z define_macros = [('HAVE_CBLAS', None), ('BLAS_SYMBOL_SUFFIX', '64_'), ('HAVE_BLAS_ILP64', None), ('HAVE_LAPACKE', None)]
2024-02-29T20:22:40.2798372Z runtime_library_dirs = ['/usr/local/lib']
2024-02-29T20:22:40.2798514Z Supported SIMD extensions in this NumPy install:
2024-02-29T20:22:40.2798660Z baseline = SSE,SSE2,SSE3
2024-02-29T20:22:40.2798817Z found = SSSE3,SSE41,POPCNT,SSE42,AVX,F16C,FMA3,AVX2,AVX512F,AVX512CD,AVX512_SKX
2024-02-29T20:22:40.2799013Z not found = AVX512_KNL,AVX512_KNM,AVX512_CLX,AVX512_CNL,AVX512_ICL
2024-02-29T20:22:40.2799247Z [{'simd_extensions': {'baseline': ['SSE', 'SSE2', 'SSE3'],
2024-02-29T20:22:40.2799441Z 'found': ['SSSE3',
2024-02-29T20:22:40.2799603Z 'SSE41',
2024-02-29T20:22:40.2799955Z 'POPCNT',
2024-02-29T20:22:40.2800108Z 'SSE42',
2024-02-29T20:22:40.2800254Z 'AVX',
2024-02-29T20:22:40.2800414Z 'F16C',
2024-02-29T20:22:40.2800561Z 'FMA3',
2024-02-29T20:22:40.2800719Z 'AVX2',
2024-02-29T20:22:40.2800873Z 'AVX512F',
2024-02-29T20:22:40.2801041Z 'AVX512CD',
2024-02-29T20:22:40.2801201Z 'AVX512_SKX'],
2024-02-29T20:22:40.2801385Z 'not_found': ['AVX512_KNL',
2024-02-29T20:22:40.2801556Z 'AVX512_KNM',
2024-02-29T20:22:40.2801845Z 'AVX512_CLX',
2024-02-29T20:22:40.2802009Z 'AVX512_CNL',
2024-02-29T20:22:40.2802173Z 'AVX512_ICL']}},
2024-02-29T20:22:40.2802345Z {'architecture': 'SkylakeX',
2024-02-29T20:22:40.2802643Z 'filepath': '/home/vsts/work/1/s/test-job/lib/python3.8/site-packages/numpy.libs/libopenblas64_p-r0-15028c96.3.21.so',
2024-02-29T20:22:40.2802867Z 'internal_api': 'openblas',
2024-02-29T20:22:40.2803020Z 'num_threads': 2,
2024-02-29T20:22:40.2803179Z 'prefix': 'libopenblas',
2024-02-29T20:22:40.2803342Z 'threading_layer': 'pthreads',
2024-02-29T20:22:40.2803505Z 'user_api': 'blas',
2024-02-29T20:22:40.2803658Z 'version': '0.3.21'}]
2024-02-29T20:22:40.3661396Z /tmp/terra-tests ~/work/1/s
2024-02-29T20:22:40.3810428Z PYTHONHASHSEED=130251549
Failure:
2024-02-29T20:31:26.4426072Z test.python.synthesis.test_synthesis.TestTwoQubitWeylDecompositionSpecialization.test_weyl_specialize_fsim_abb
2024-02-29T20:31:26.4426483Z --------------------------------------------------------------------------------------------------------------
2024-02-29T20:31:26.4426970Z
2024-02-29T20:31:26.4427155Z Captured traceback:
2024-02-29T20:31:26.4427356Z ~~~~~~~~~~~~~~~~~~~
2024-02-29T20:31:26.4427564Z Traceback (most recent call last):
2024-02-29T20:31:26.4427698Z
2024-02-29T20:31:26.4428053Z File "/tmp/terra-tests/test/python/synthesis/test_synthesis.py", line 912, in test_weyl_specialize_fsim_abb
2024-02-29T20:31:26.4428321Z self.check_two_qubit_weyl_specialization(
2024-02-29T20:31:26.4428476Z
2024-02-29T20:31:26.4428813Z File "/tmp/terra-tests/test/python/synthesis/test_synthesis.py", line 256, in check_two_qubit_weyl_specialization
2024-02-29T20:31:26.4429086Z self.assertRoundTrip(decomp2)
2024-02-29T20:31:26.4429221Z
2024-02-29T20:31:26.4429536Z File "/tmp/terra-tests/test/python/synthesis/test_synthesis.py", line 167, in assertRoundTrip
2024-02-29T20:31:26.4429806Z self.assertEqual(weyl1.a, weyl2.a, msg=msg_base)
2024-02-29T20:31:26.4429952Z
2024-02-29T20:31:26.4430192Z File "/opt/hostedtoolcache/Python/3.8.18/x64/lib/python3.8/unittest/case.py", line 912, in assertEqual
2024-02-29T20:31:26.4430452Z assertion_func(first, second, msg=msg)
2024-02-29T20:31:26.4430590Z
2024-02-29T20:31:26.4430846Z File "/opt/hostedtoolcache/Python/3.8.18/x64/lib/python3.8/unittest/case.py", line 905, in _baseAssertEqual
2024-02-29T20:31:26.4431105Z raise self.failureException(msg)
2024-02-29T20:31:26.4431252Z
2024-02-29T20:31:26.4431458Z AssertionError: 0.43700000000000006 != 0.43699999999999994 : weyl1:
2024-02-29T20:31:26.4431696Z TwoQubitWeylfSimabbEquiv.from_bytes(
2024-02-29T20:31:26.4431906Z # TwoQubitWeylfSimabbEquiv(
2024-02-29T20:31:26.4432114Z # global phase: 0.32841
2024-02-29T20:31:26.4432549Z # ┌─────────────┐┌────────────┐┌────────────┐┌──────────────┐┌──────────────┐ ┌────────────┐┌─────────────┐┌─────────────┐
2024-02-29T20:31:26.4432987Z # q_0: ┤ Rx(-1.5717) ├┤ Ry(1.9416) ├┤ Rx(1.1555) ├┤0 ├┤0 ├─■───────────┤ Rx(3.1039) ├┤ Ry(0.78779) ├┤ Rx(0.48002) ├
2024-02-29T20:31:26.4433448Z # ├─────────────┤├────────────┤└────────────┘│ Rxx(-0.874) ││ Ryy(-0.303) │ │ZZ(-0.303) ├────────────┤├─────────────┤└┬────────────┤
2024-02-29T20:31:26.4433886Z # q_1: ┤ Rx(0.49803) ├┤ Ry(3.0773) ├──────────────┤1 ├┤1 ├─■───────────┤ Rx(2.4426) ├┤ Ry(0.44615) ├─┤ Rx(1.0949) ├
2024-02-29T20:31:26.4434432Z # └─────────────┘└────────────┘ └──────────────┘└──────────────┘ └────────────┘└─────────────┘ └────────────┘
2024-02-29T20:31:26.4434645Z # )
2024-02-29T20:31:26.4434953Z b'k05VTVBZAQB2AHsnZGVzY3InOiAnPGMxNicsICdmb3J0cmFuX29yZGVyJzogRmFsc2UsICdzaGFw'
2024-02-29T20:31:26.4435316Z b'ZSc6ICg0LCA0KSwgfSAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg'
2024-02-29T20:31:26.4435674Z b'ICAgICAgICAgICAgIArTMzZU31PKP+nSG0/0wsy/1pLLmFFd3L/yQfpYNPHovzNScZmz7cw/v+9s'
2024-02-29T20:31:26.4436025Z b'2csPwj/vQZQPoGewP1SB0kUfesW/kUsXBFA64L9egbafh4viP2kmx7dWZr+/bp67UHuJ0r/WDJ+s'
2024-02-29T20:31:26.4436473Z b'0MSHv91nmy6kh8I/lCzPukMT4L9MleEBK87HP534pGCzWdW/Lk2M2y+517+8VdsFL4m4v+3nhaqq'
2024-02-29T20:31:26.4436827Z b'3cC/4GX9mBgX1b9EI6NwjFa6P9KliVRl19M/zhMSIDfX5j+zq5tZ+evKvzsurnSbqMK/BK18Ikru'
2024-02-29T20:31:26.4437171Z b'0D/Q+/3PtJiYP8TCKGAkVuw/+Bs5eMhesb884+rnbGSbP86FtTHZd9E/',
2024-02-29T20:31:26.4437396Z requested_fidelity=None,
2024-02-29T20:31:26.4437616Z calculated_fidelity=0.99999640000675,
2024-02-29T20:31:26.4437830Z actual_fidelity=0.99999640000675,
2024-02-29T20:31:26.4438071Z abc=(0.43700000000000006, 0.1515000000000004, 0.1515000000000004))
2024-02-29T20:31:26.4438282Z weyl2:
2024-02-29T20:31:26.4438485Z TwoQubitWeylfSimabbEquiv.from_bytes(
2024-02-29T20:31:26.4438696Z # TwoQubitWeylfSimabbEquiv(
2024-02-29T20:31:26.4438903Z # global phase: 0.32841
2024-02-29T20:31:26.4439303Z # ┌─────────────┐┌────────────┐┌────────────┐┌──────────────┐┌──────────────┐ ┌────────────┐┌─────────────┐┌─────────────┐
2024-02-29T20:31:26.4439845Z # q_0: ┤ Rx(-1.5717) ├┤ Ry(1.9416) ├┤ Rx(1.1555) ├┤0 ├┤0 ├─■───────────┤ Rx(3.1039) ├┤ Ry(0.78779) ├┤ Rx(0.48002) ├
2024-02-29T20:31:26.4440287Z # ├─────────────┤├────────────┤└────────────┘│ Rxx(-0.874) ││ Ryy(-0.303) │ │ZZ(-0.303) ├────────────┤├─────────────┤└┬────────────┤
2024-02-29T20:31:26.4440757Z # q_1: ┤ Rx(0.49803) ├┤ Ry(3.0773) ├──────────────┤1 ├┤1 ├─■───────────┤ Rx(2.4426) ├┤ Ry(0.44615) ├─┤ Rx(1.0949) ├
2024-02-29T20:31:26.4441185Z # └─────────────┘└────────────┘ └──────────────┘└──────────────┘ └────────────┘└─────────────┘ └────────────┘
2024-02-29T20:31:26.4441393Z # )
2024-02-29T20:31:26.4441702Z b'k05VTVBZAQB2AHsnZGVzY3InOiAnPGMxNicsICdmb3J0cmFuX29yZGVyJzogRmFsc2UsICdzaGFw'
2024-02-29T20:31:26.4442052Z b'ZSc6ICg0LCA0KSwgfSAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg'
2024-02-29T20:31:26.4442410Z b'ICAgICAgICAgICAgIArTMzZU31PKP+nSG0/0wsy/1pLLmFFd3L/yQfpYNPHovzNScZmz7cw/v+9s'
2024-02-29T20:31:26.4442775Z b'2csPwj/vQZQPoGewP1SB0kUfesW/kUsXBFA64L9egbafh4viP2kmx7dWZr+/bp67UHuJ0r/WDJ+s'
2024-02-29T20:31:26.4443137Z b'0MSHv91nmy6kh8I/lCzPukMT4L9MleEBK87HP534pGCzWdW/Lk2M2y+517+8VdsFL4m4v+3nhaqq'
2024-02-29T20:31:26.4443558Z b'3cC/4GX9mBgX1b9EI6NwjFa6P9KliVRl19M/zhMSIDfX5j+zq5tZ+evKvzsurnSbqMK/BK18Ikru'
2024-02-29T20:31:26.4443899Z b'0D/Q+/3PtJiYP8TCKGAkVuw/+Bs5eMhesb884+rnbGSbP86FtTHZd9E/',
2024-02-29T20:31:26.4444126Z requested_fidelity=None,
2024-02-29T20:31:26.4444343Z calculated_fidelity=0.99999640000675,
2024-02-29T20:31:26.4444559Z actual_fidelity=0.9999964000067504,
2024-02-29T20:31:26.4444805Z abc=(0.43699999999999994, 0.1515000000000004, 0.1515000000000004))
I think we can probably close this as fixed by #11946 since I haven't seen this since that merged. However, I know #13176 is failing the merge queue with this issue but on the stable/0.46
branch which doesn't have #11946. That's (hopefully) the last PR before we retire the 0.46.x branch so I'll wait to close this until that release goes out.
Environment
What is happening?
There are several two qubit weyl decomposition tests failing in CI occasionally now. This has happened twice that I've observed and my guess is it's a numeric precision issue coming from some environment difference. Examples of the failures are:
and
How can we reproduce the issue?
Have CI fail, such as: https://dev.azure.com/qiskit-ci/qiskit/_build/results?buildId=53980&view=logs&jobId=42553bb7-c640-5e19-486b-534ade7d1f3b&j=42553bb7-c640-5e19-486b-534ade7d1f3b&t=ec81b5c9-a7aa-58a8-95bd-450209a80da7 (this link will expire eventually, but the failure output is above)
What should happen?
The tests should pass reliably on all supported platforms.
Any suggestions?
No response