Sporadic runtime failures in qblox acquisition

qiboteam / qibolab

Quantum hardware module and drivers for Qibo.

https://qibo.science

Apache License 2.0

40 stars 10 forks source link

Sporadic runtime failures in qblox acquisition #836

Closed hay-k closed 3 months ago

hay-k commented 3 months ago

Running experiments in the spinq10q setup (controlled by Qblox instruments) sporadically fails with the following error:

RuntimeError: "Execution error;(reason='module command SEQ#:ACQ:ALIS:ACQ:DATA failed on module in slot 18: Argument value out of range (-220): Unknown acquisition (name=scope_acquisition).', cmd='SLOT18:SEQuencer0:ACQ:ALISt:ACQuisition:DATA ""scope_acquisition"" ')"

hay-k commented 3 months ago

For now, the understanding is that this is neither an issue in the qibolab driver for qblox, nor an issue with qblox itself. It happened because two different slurm queues were used in parallel to run experiments which caused an inconsistent state of the instruments. Still need to get enough proof that this hypothesis is the correct one.

hay-k commented 3 months ago

Since the time everybody started using the same queue, this issue has not been reported anymore.
I was able to reproduce this issue twice by using two different queues on purpose.

I believe, for now this is enough proof that the original hypothesis is correct.