ISISComputingGroup / IBEX

Top level repository for IBEX stories
5 stars 2 forks source link

Riken RB2 communication issues #8260

Open FreddieAkeroyd opened 6 months ago

FreddieAkeroyd commented 6 months ago

Power supply DFKPS_34 (RB2_2) on RIKENFE computer keeps losing commands after an hour or so of communication, restarting the ioc recovers for another hour. It seems to get a sequence of mismatches on POL then after this has gone on for a while there is no furtehr communication until IOC is restarted

On IOC restart it sends the command

[2024-03-13 13:42:55] asynOctetWrite DFKINIT "ADR 029\n\r"
[2024-03-13 13:42:55] asynOctetWrite DFKINIT "UNLOCK\n\r"   
[2024-03-13 13:42:55] asynOctetWrite DFKINIT "REM\n\r"

maybe the device e.g. suddenly goes into local mode and hence stops communicating until REM is set? Of something went wrong with flow control e.g. noise was interpreted as an xon/xoff character (though i am not sure the device does xon/xoff - ibex doesn't request it)

Problem seems to have started on 6th march, but after restart on 2024-03-25 10:52:07 to it looks to have not lost communication again until 2024-04-08 11:56:10

[2024-03-13 06:09:36] 2024/03/13 06:09:36.217391 L0 IN:RIKENFE:DFKPS_34:POL: 2 bytes surplus input "+<0d>"
[2024-03-13 06:09:36] 2024/03/13 06:09:36.217796 L0 IN:RIKENFE:DFKPS_34:POL: after 1 byte: "+"
[2024-03-13 06:09:37] 2024/03/13 06:09:37.118150 L0 IN:RIKENFE:DFKPS_34:POL: Match passed again
[2024-03-13 06:18:26] 2024/03/13 06:18:26.245899 L0 IN:RIKENFE:DFKPS_34:POL: 2 bytes surplus input "+<0d>"
[2024-03-13 06:18:26] 2024/03/13 06:18:26.246364 L0 IN:RIKENFE:DFKPS_34:POL: after 1 byte: "+"
[2024-03-13 06:18:27] 2024/03/13 06:18:27.147425 L0 IN:RIKENFE:DFKPS_34:POL: Match passed again
[2024-03-13 06:29:20] 2024/03/13 06:29:20.277894 L0 IN:RIKENFE:DFKPS_34:POL: 2 bytes surplus input "+<0d>"
[2024-03-13 06:29:20] 2024/03/13 06:29:20.278303 L0 IN:RIKENFE:DFKPS_34:POL: after 1 byte: "+"
[2024-03-13 06:29:21] 2024/03/13 06:29:21.175869 L0 IN:RIKENFE:DFKPS_34:POL: Match passed again
[2024-03-13 06:30:07] 2024/03/13 06:30:07.958965 L0 IN:RIKENFE:DFKPS_34:RAW:SP:RBV: No reply within 1000 ms to "RA"
[2024-03-13 06:30:08] 2024/03/13 06:30:08.960044 L0 IN:RIKENFE:DFKPS_34:STATUS: No reply within 1000 ms to "S1"
[2024-03-13 06:30:09] 2024/03/13 06:30:09.828072 L0 IN:RIKENFE:DFKPS_34:RAW: Input ".!.!!!!." does not match format "%d"
[2024-03-13 06:30:10] 2024/03/13 06:30:10.828901 L0 IN:RIKENFE:DFKPS_34:POL: No reply within 1000 ms to "PO"
[2024-03-13 06:30:11] 2024/03/13 06:30:11.829096 L0 IN:RIKENFE:DFKPS_34:RAW:SP:RBV: No reply within 1000 ms to "RA"
[2024-03-13 06:30:12] 2024/03/13 06:30:12.829172 L0 IN:RIKENFE:DFKPS_34:STATUS: No reply within 1000 ms to "S1"
[2024-03-13 06:30:13] 2024/03/13 06:30:13.927035 L0 IN:RIKENFE:DFKPS_34:VRAW: No reply within 1000 ms to "AD 2"
[2024-03-13 06:30:14] 2024/03/13 06:30:14.926386 L0 IN:RIKENFE:DFKPS_34:RAW: No reply within 1000 ms to "AD 8"
[2024-03-13 06:30:15] 2024/03/13 06:30:15.928431 L0 IN:RIKENFE:DFKPS_34:POL: No reply within 1000 ms to "PO"
[2024-03-13 06:30:16] 2024/03/13 06:30:16.929231 L0 IN:RIKENFE:DFKPS_34:RAW:SP:RBV: No reply within 1000 ms to "RA"
[2024-03-13 06:30:17] 2024/03/13 06:30:17.931126 L0 IN:RIKENFE:DFKPS_34:STATUS: No reply within 1000 ms to "S1"