Panic - fatal error: unexpected signal during runtime execution

[creas002]

What version of protobuf and what language are you using? syncthing v1.20.2 "Fermium Flea" (go1.18.3 linux-arm) deb@build.syncthing.net

What did you do? Had been running fine for months and started getting panics and stops working. Stopped syncthing service and manually started it. Attached panic log

What did you expect to see? syncthing start and sync successfully

What did you see instead? runtime: bad pointer in frame github.com/AudriusButkevicius/pfilter.(*PacketFilter).readMsgUdp at 0x46c7c0c: 0x88 fatal error: invalid pointer found on stack

Make sure you include information that can help us de panic-20221004-112320.log bug (full error message, exception listing, stack trace, logs).

Anything else we should know about your project / environment? I have syncthing running on 3 Raspberry PI's and 2 PC's - The panic log is from the GOES16 RPi

Working - NOAA/M2 RPi - syncthing v1.12.1-ds1 "Fermium Flea" (go1.15.9 linux-arm) debian@debian 2021-07-23 20:27:51 UTC Working - GOES17 RPi - syncthing v1.12.1-ds1 "Fermium Flea" (go1.15.9 linux-arm) debian@debian 2021-07-23 20:27:51 UTC Panic - GOES16 RPi - syncthing v1.20.2 "Fermium Flea" (go1.18.3 linux-arm) deb@build.syncthing.net 2022-05-31 20:19:44 UTC [noupgrade] Working - PC 1 - v1.22.0, Windows (64-bit Intel/AMD) "Fermium Flea" Build 2022-10-02 Working - PC 2 - v1.22.0, Windows (64-bit Intel/AMD) "Fermium Flea" Build 2022-10-02

panic-20221004-110335.reported.log panic-20221004-110338.reported.log panic-20221004-110344.reported.log panic-20221004-111631.reported.log panic-20221004-112156.reported.log panic-20221002-225057.reported.log panic-20221002-225103.reported.log panic-20221002-225108.reported.log panic-20221002-225112.reported.log panic-20221002-225116.reported.log panic-20221004-110114.reported.log panic-20221004-110215.reported.log panic-20221004-110219.reported.log panic-20221004-110333.reported.log

[puellanivis]

Having downloaded all of your reports, and running:

$ grep -r protobuf *

I get zero references to an issue that might lie within this protobuf package. In fact, I see a lot of references in github.com/syncthing/syncthing to gogoproto an entirely different package not supported by the main protobuf team

[creas002]

Thanks for the follow up. I agree with you. Seems somehow I have a bigger problem and I have not been able to correct it.

On my RPi GOES16 image; It seems syncthing has upgraded its version from 1.12.1-ds1 to v1.20.2 without any action from me and problems have ensued since. I say this because my RPi GOES17 image is running Syncthing v1.12.1-ds1 and it was cloned from my RPi GOES16 image on June 15th, 2022.

I've tried to ensure Syncthing is up to date and any issues resolved, but it seems I'm at a loss as to how to resolve the errors I'm getting. See attached log

On Tue, Oct 4, 2022 at 2:23 PM Cassondra Foesch @.***> wrote:

Having downloaded all of your reports, and running:

$ grep -r protobuf *

I get zero references to an issue that might lie within this protobuf package. In fact, I see a lot of references in github.com/syncthing/syncthing to gogoproto an entirely different package not supported by the main protobuf team

— Reply to this email directly, view it on GitHub https://github.com/golang/protobuf/issues/1494#issuecomment-1267388027, or unsubscribe https://github.com/notifications/unsubscribe-auth/AQVTS6JQTZYUTU6ORJRNZJ3WBRY27ANCNFSM6AAAAAAQ4PODJM . You are receiving this because you authored the thread.Message ID: @.***>

Try to make sure Syncthing is update and installed correctly

@.***:/var/lib/dpkg/info$ sudo apt-get --only-upgrade install syncthing Reading package lists... Done Building dependency tree... Done Reading state information... Done You might want to run 'apt --fix-broken install' to correct these. The following packages have unmet dependencies: libc6-dev : Depends: libc6 (= 2.31-13+rpt2+rpi1+deb11u4) but 2.31-13+rpt2+rpi1+deb11u2 is to be installed E: Unmet dependencies. Try 'apt --fix-broken install' with no packages (or specify a solution).

Try to fix the broken packages

@.***:/var/lib/dpkg/info$ sudo apt --fix-broken install Reading package lists... Done Building dependency tree... Done Reading state information... Done Correcting dependencies... Done The following additional packages will be installed: libc6 libc6-dbg Suggested packages: glibc-doc Recommended packages: libnss-nis libnss-nisplus The following packages will be upgraded: libc6 libc6-dbg 2 upgraded, 0 newly installed, 0 to remove and 135 not upgraded. 4 not fully installed or removed. Need to get 0 B/8,681 kB of archives. After this operation, 6,144 B disk space will be freed. Do you want to continue? [Y/n] y Reading changelogs... Done Illegal instruction dpkg: warning: files list file for package 'libutempter0:armhf' missing; assuming package has no files currently installed (Reading database ... 72841 files and directories currently installed.) Preparing to unpack .../libc6-dbg_2.31-13+rpt2+rpi1+deb11u4_armhf.deb ... Unpacking libc6-dbg:armhf (2.31-13+rpt2+rpi1+deb11u4) over (2.31-13+rpt2+rpi1+deb11u2) ... dpkg: error processing archive /var/cache/apt/archives/libc6-dbg_2.31-13+rpt2+rpi1+deb11u4_armhf.deb (--unpack): unable to create '/usr/share/doc/libc6-dbg/changelog.Debian.gz.dpkg-new' (while processing './usr/share/doc/libc6-dbg/changelog.Debian.gz'): Structure needs cleaning dpkg-deb: error: paste subprocess was killed by signal (Broken pipe) Preparing to unpack .../libc6_2.31-13+rpt2+rpi1+deb11u4_armhf.deb ... Unpacking libc6:armhf (2.31-13+rpt2+rpi1+deb11u4) over (2.31-13+rpt2+rpi1+deb11u2) ... dpkg: error processing archive /var/cache/apt/archives/libc6_2.31-13+rpt2+rpi1+deb11u4_armhf.deb (--unpack): unable to create '/usr/share/doc/libc6/NEWS.Debian.gz.dpkg-new' (while processing './usr/share/doc/libc6/NEWS.Debian.gz'): Structure needs cleaning dpkg-deb: error: paste subprocess was killed by signal (Broken pipe) Errors were encountered while processing: /var/cache/apt/archives/libc6-dbg_2.31-13+rpt2+rpi1+deb11u4_armhf.deb /var/cache/apt/archives/libc6_2.31-13+rpt2+rpi1+deb11u4_armhf.deb E: Sub-process /usr/bin/dpkg returned an error code (1)

Try to clean the structure errors encountered

@.***:/var/lib/dpkg/info$ sudo dpkg -i --force-overwrite //var/cache/apt/archives/libc6-dbg_2.31-13+rpt2+rpi1+deb11u4_armhf.deb /var/cache/apt/archives/libc6_2.31-13+rpt2+rpi1+deb11u4_armhf.deb dpkg: warning: files list file for package 'libutempter0:armhf' missing; assuming package has no files currently installed (Reading database ... 72841 files and directories currently installed.) Preparing to unpack .../libc6-dbg_2.31-13+rpt2+rpi1+deb11u4_armhf.deb ... Unpacking libc6-dbg:armhf (2.31-13+rpt2+rpi1+deb11u4) over (2.31-13+rpt2+rpi1+deb11u2) ... dpkg: error processing archive //var/cache/apt/archives/libc6-dbg_2.31-13+rpt2+rpi1+deb11u4_armhf.deb (--install): unable to create '/usr/share/doc/libc6-dbg/changelog.Debian.gz.dpkg-new' (while processing './usr/share/doc/libc6-dbg/changelog.Debian.gz'): Structure needs cleaning dpkg-deb: error: paste subprocess was killed by signal (Broken pipe) Preparing to unpack .../libc6_2.31-13+rpt2+rpi1+deb11u4_armhf.deb ... Unpacking libc6:armhf (2.31-13+rpt2+rpi1+deb11u4) over (2.31-13+rpt2+rpi1+deb11u2) ... dpkg: error processing archive /var/cache/apt/archives/libc6_2.31-13+rpt2+rpi1+deb11u4_armhf.deb (--install): unable to create '/usr/share/doc/libc6/NEWS.Debian.gz.dpkg-new' (while processing './usr/share/doc/libc6/NEWS.Debian.gz'): Structure needs cleaning dpkg-deb: error: paste subprocess was killed by signal (Broken pipe) Processing triggers for libc-bin (2.31-13+rpt2+rpi1+deb11u2) ... Errors were encountered while processing: //var/cache/apt/archives/libc6-dbg_2.31-13+rpt2+rpi1+deb11u4_armhf.deb /var/cache/apt/archives/libc6_2.31-13+rpt2+rpi1+deb11u4_armhf.deb

Make sure all packages are updated

@.***:/var/lib/dpkg/info$ sudo apt update Hit:1 https://download.docker.com/linux/raspbian bullseye InRelease Get:2 http://raspbian.raspberrypi.org/raspbian bullseye InRelease [15.0 kB]
Get:3 http://archive.raspberrypi.org/debian bullseye InRelease [23.7 kB]
Hit:4 https://apt.syncthing.net syncthing InRelease
Get:5 http://archive.raspberrypi.org/debian bullseye/main armhf Packages [301 kB] Fetched 340 kB in 2s (175 kB/s)
Reading package lists... Done Building dependency tree... Done Reading state information... Done 137 packages can be upgraded. Run 'apt list --upgradable' to see them.

Installed updated packages

@.***:/var/lib/dpkg/info$ sudo apt upgrade Reading package lists... Done Building dependency tree... Done Reading state information... Done You might want to run 'apt --fix-broken install' to correct these. The following packages have unmet dependencies: libc6-dev : Depends: libc6 (= 2.31-13+rpt2+rpi1+deb11u4) but 2.31-13+rpt2+rpi1+deb11u2 is installed E: Unmet dependencies. Try 'apt --fix-broken install' with no packages (or specify a solution).

[creas002]

Tired of messing with it. I managed to completely trash the OS. Restoring backup to SD card.

[creas002]

Closing issue as Panic seems to have been unrelated to error it was reporting.