search

teltek / Galicaster

The Galicaster Project is an open initiative to provide flexible, state-of-the-art solutions for recording educational multimedia contents like lectures and conferences
galicaster.teltek.es
Other
35 stars 31 forks source link

segfault in orcexec #485

Open smarquard opened 7 years ago

smarquard commented 7 years ago

We've seen this on a few capture agents across different hardware, Ubuntu 16.04 running GC 2.0.x.

Nov 3 14:11:46 mblt2-ca kernel: [26792.231474] queue8:src[2396]: segfault at 7fb700000000 ip 00007fb8cc1052d0 sp 00007fb8767fb218 error 4 in orcexec.xHDyJF (deleted)[7fb8cc105000+10000] 
Mar 27 08:00:00 kramlt1-ca kernel: [ 5385.837762] queue3:src[4093]: segfault at 7feb00000200 ip 00007fecc5a465e0 sp 00007fec697f1218 error 4 in orcexec.iYs63H (deleted)[7fecc5a46000+10000]

Not sure what the cause is.

smarquard commented 7 years ago

The common factor between affected CAs is that they all have Blackmagic Mini-Recorder cards, used either for HDMI capture or SDI video capture.

smarquard commented 7 years ago

This error appeared on a CA running gstreamer 1.8.3. We are testing updates to the latest Blackmagic firmware and drivers.

smarquard commented 7 years ago

We are still getting this issue with gstreamer 1.8.3 and these blackmagic driver versions. This CA has dual blackmagic cards for HDMI presentation capture at 720p.

Mar 29 08:59:59 kramlt2-ca kernel: [ 8984.734975] queue14:src[2306]: segfault at 7f96000002a0 ip 00007f98310112e3 sp 00007f97f5ff9218 error 6 in orcexec.3ArW1a (deleted)[7f9831011000+10000]
Mar 30 17:01:16 kramlt2-ca kernel: [37775.400347] queue8:src[2479]: segfault at 7fdb00000000 ip 00007fdcd018d2d0 sp 00007fdc7d7f9218 error 4 in orcexec.FGIv0S (deleted)[7fdcd018d000+10000]
# dmesg | grep -i blackmagic 
[ 13.386848] BlackmagicIO: Driver version 10.8.5a4 loading 
[ 13.387139] BlackmagicIO: Enabled device "DeckLink Mini Recorder" x1/5 Gbps (9a69486d,430300) FW Date: 11-28 11:51 
[ 13.387530] BlackmagicIO: DeckLink Mini Recorder as blackmagic!io0 [0000:03:00.0] 
[ 13.387532] BlackmagicIO: Initialised serial driver for blackmagic!io0 
[ 13.387754] BlackmagicIO: Enabled device "DeckLink Mini Recorder" x1/5 Gbps (9afe880b,430400) FW Date: 11-28 11:51 
[ 13.388141] BlackmagicIO: DeckLink Mini Recorder as blackmagic!io1 [0000:04:00.0] 
[ 13.388143] BlackmagicIO: Initialised serial driver for blackmagic!io1
smarquard commented 7 years ago

The segfault is here 1min16s into the recording, so possibly it is caused by some type of change on the input (although the input is from VP-242 scalers, so there's no change in resolution).

mliradelc commented 7 years ago

Here With a Blackmagic Design Decklink mini recorder, I had some hangs of the capture agent too.

Now I'm making stability tests to verify that this card is making the complete hangs of the pc.

One thing I have to note the hangs occur between 1 and 2:30 hours from the beginning of the recording

smarquard commented 7 years ago

We are testing disabling ORC for CAs with the blackmagic cards by adding this to our Galicaster startup script:

export ORC_CODE=backup

smarquard commented 7 years ago

We have not seen this issue recur since adding

export ORC_CODE=backup

to the galicaster start script on CAs with Blackmagic cards (gstreamer 1.82 / 1.83). So this looks like a gstreamer 1.8 bug that is avoided by disable the ORC code.