PepperDash / epi-biamp-tesira

Plugin for controlling Biamp Tesira DSPs from within Essentials.
0 stars 2 forks source link

[BUG]- v2.3.4 - CommandQueue error when many router updates occur at same time #89

Closed cdenig closed 5 months ago

cdenig commented 1 year ago

Describe the bug Basic symptom is that whenever a SIMPL Program conencted to the DSP bridge boot after the Essentials program, the CommandQueue starts filling up and does not clear.
The count of CommandQueue elements just keeps incrementing. I assume it keep incrementing until it the Essentials program fails because client has commented that some program fail after 1-2 months of running. Rebooting has seemed to resolve the issue.
I think when the SIMPL program restarts, it sets all switcher elements to '0' and the EPI is getting stuck processing all those requests in a short time. Confirmed with a fix in SIMPL program to prevent sending '0d' value cmd to all routes at program init that problem stopped.

Stacktrace See attached files for debugging while restarting Essentials(no err), then restarting all programs(err), and finally disabling 0d vale send on SIMPL prog init and restart all programs.

To Reproduce IOU steps to reproduce.... OuttaTime

Expected behavior When SIMPL program first comes online, ignore all incoming value change events until a Flag is raise enabling process of new bridge events. See RouteReady feature in Evertz Switcher EPI. TesiraQueue might also need update

Additional context 2023.05.04.13.34.03.-.2.3.4.RoutingFb.success.-.Plain.txt 2023.05.04.13.38.30.-.v2.3.4.RouterFB.CmdQueue.Fail.-.Plain.txt 2023.05.04.15.56.03.-.InitTestFix.-.Plain.txt

cdenig commented 7 months ago

Confirmed issue persists in v2.5.1

cdenig commented 7 months ago

To Reproduce

  1. Push many route commands at the same time from a Simpl program
  2. See that route feedback does not update
  3. See that future commands to route send
  4. DSP responds with same command back having been received and a +OK
  5. Plugin SHOULD now poll output for current route, but it does not

Additional Info

cdenig commented 7 months ago

Additional Context

2024.01.11 16.52.49 - TesiraRouterFb_CorrectPoll - Plain.txt

2024.01.11 16.47.57 - TesiraRouterFb_Error - Plain.txt

2024.01.11 16.56.13 - TesiraRouterFb_SetMany_Success - Plain.txt

2024.01.11 16.57.00 - TesiraRouterFb_SetMany_ERROR - Plain.txt

After inducing this error state, router communications will not function correct until Essentials is reset