search

thegridelectric / gw-scada-spaceheat-python

GridWorks SCADA for space heating
MIT License
5 stars 2 forks source link

Intermitten failure in test_response_timeout #146

Open anschweitzer opened 1 year ago

anschweitzer commented 1 year ago

Seen in CI here

Log file: 1_tests.txt

Error message: 

2022-12-07 21:46:17.129 CommTestHelper caught error ERROR. [ERROR waiting for events to be acked] wait_for() timed out after 1.206885814666748 seconds
  [ERROR waiting for events to be acked]
  From test_proactor_comm.py:838
  wait function: <function test_response_timeout.<locals>.<lambda> at 0x7f98116e8ca0>
  ScadaRecorder2 Stats

  Global received by message_type:
        2: [mqtt_connected]
       35: [mqtt_message]
        1: [mqtt_suback]
  LinkStats [gridworks]  num_received: 35  timeouts: 10  comm events: 13
    Received by message_type:
       35: [gw]
       35: [mqtt_message]
    Received by topic:
       34: [gw/dw1-isone-ct-newhaven-orange1/gridworks-ack]
        1: [gw/dw1-isone-ct-newhaven-orange1/gridworks-ping]
    Comm event counts:
        1: [gridworks.event.comm.mqtt.connect]
        1: [gridworks.event.comm.mqtt.fully_subscribed]
        6: [gridworks.event.comm.peer_active]
        5: [gridworks.event.comm.response_timeout]
    Comm events:
      MessageId='11cca869-56d4-4212-af23-02cb4463cb85' TimeNS=1670449575319587585 Src='dw1.isone.ct.newhaven.orange1.ta.scada' TypeName='gridworks.event.comm.mqtt.connect' PeerName='gridworks'
      MessageId='1ab8d9cb-0e09-4f79-a7b0-f436760d5149' TimeNS=1670449575324411204 Src='dw1.isone.ct.newhaven.orange1.ta.scada' TypeName='gridworks.event.comm.mqtt.fully_subscribed' PeerName='gridworks'
      MessageId='be0bffee-b244-48df-86cf-91155b96bf12' TimeNS=1670449575559896224 Src='dw1.isone.ct.newhaven.orange1.ta.scada' TypeName='gridworks.event.comm.peer_active' PeerName='gridworks'
      MessageId='eb04cee9-0ae0-4d91-af0d-7ed77ac8d1c0' TimeNS=1670449575667916193 Src='dw1.isone.ct.newhaven.orange1.ta.scada' TypeName='gridworks.event.comm.response_timeout' PeerName='gridworks'
      MessageId='ebce2a01-72f7-40c1-9401-43501b3d4274' TimeNS=1670449575910233381 Src='dw1.isone.ct.newhaven.orange1.ta.scada' TypeName='gridworks.event.comm.peer_active' PeerName='gridworks'
      MessageId='37eb566b-9d2f-4959-b271-a6c74b2a1f95' TimeNS=1670449576172658566 Src='dw1.isone.ct.newhaven.orange1.ta.scada' TypeName='gridworks.event.comm.response_timeout' PeerName='gridworks'
      MessageId='76141320-6546-469e-ad33-75c780db2482' TimeNS=1670449576177404984 Src='dw1.isone.ct.newhaven.orange1.ta.scada' TypeName='gridworks.event.comm.peer_active' PeerName='gridworks'
      MessageId='4d9de389-da4d-4ad2-857f-ccb324b5822e' TimeNS=1670449576474023814 Src='dw1.isone.ct.newhaven.orange1.ta.scada' TypeName='gridworks.event.comm.response_timeout' PeerName='gridworks'
      MessageId='d248e1be-0ae9-459f-9063-748657f2d91d' TimeNS=1670449576478698729 Src='dw1.isone.ct.newhaven.orange1.ta.scada' TypeName='gridworks.event.comm.peer_active' PeerName='gridworks'
      MessageId='16eab97d-0b3b-4680-be2a-af65b86b99ab' TimeNS=1670449576799866966 Src='dw1.isone.ct.newhaven.orange1.ta.scada' TypeName='gridworks.event.comm.response_timeout' PeerName='gridworks'
      MessageId='10cf20c5-b5b1-4c8f-8971-3b03f79d9f4a' TimeNS=1670449576804663584 Src='dw1.isone.ct.newhaven.orange1.ta.scada' TypeName='gridworks.event.comm.peer_active' PeerName='gridworks'
      MessageId='76161e15-bbd1-4d21-8058-21fa6e18e2ab' TimeNS=1670449577102517245 Src='dw1.isone.ct.newhaven.orange1.ta.scada' TypeName='gridworks.event.comm.response_timeout' PeerName='gridworks'
      MessageId='7fae7bb2-100f-496a-9299-760785140721' TimeNS=1670449577108027281 Src='dw1.isone.ct.newhaven.orange1.ta.scada' TypeName='gridworks.event.comm.peer_active' PeerName='gridworks'
  LinkStats [local]  num_received: 0  timeouts: 0  comm events: 1
    Received by message_type:
        0: [gw]
    Comm event counts:
        1: [gridworks.event.comm.mqtt.connect]
    Comm events:
      MessageId='568d8132-7f68-476c-8fc1-9f1131cde077' TimeNS=1670449575318356155 Src='dw1.isone.ct.newhaven.orange1.ta.scada' TypeName='gridworks.event.comm.mqtt.connect' PeerName='local'
  subacks_paused: False  pending_subacks: 0
  Link states:
    local       awaiting_setup_and_peer
    gridworks   active
.
Working log dirs:
    [/tmp/pytest-of-runner/pytest-0/test_response_timeout_10_10_0/.local/state/gridworks/scada/log]
    [/tmp/pytest-of-runner/pytest-0/test_response_timeout_10_10_0/.local/state/gridworks/atn/log]