Grafana couldn't start Zabbix plugin

[LibiKorol]

After upgrading Grafana to ver 9.2.2, it couldn't start the plugin. In Grafana log the message was "Could not start plugin" with an error "unrecognized remote plugin message.."

Since the plugin couldn't be added we can't use zabbix as data source and all of our dashboards are with "No Data".

It didn't work with Grafana 9.1.4 as well.

Grafana 9.2.2 Zabbix 6.2.2 Grafana-Zabbix Plugin 4.2.10

[tikondrus]

we have the same issue

Grafana 9.2.1 Zabbix 6.2.4 Grafana-Zabbix Plugin 4.2.10

[ArsenyBelorukov]

/usr/share/grafana$ /var/lib/grafana/plugins/alexanderzobnin-zabbix-app/zabbix-plugin_linux_amd64
runtime/cgo: pthread_create failed: Operation not permitted
SIGABRT: abort
PC=0x7f58aea2519f m=0 sigcode=18446744073709551610

goroutine 0 [idle]:
runtime: unknown pc 0x7f58aea2519f
stack: frame={sp:0x7ffe385b7b70, fp:0x0} stack=[0x7ffe37db9118,0x7ffe385b8140)
0x00007ffe385b7a70:  0x0000000000000001  0x0000000000000000
0x00007ffe385b7a80:  0x00007f58ae9ade50  0x00007f58aea35c90
0x00007ffe385b7a90:  0x0000000000000000  0x00007ffe385b7e40
0x00007ffe385b7aa0:  0x000000ffffffffff  0x000000ffffffffff
0x00007ffe385b7ab0:  0x2525252525252525  0x2525252525252525
0x00007ffe385b7ac0:  0x00000000000000ff  0x0000000000000000
0x00007ffe385b7ad0:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7ae0:  0x000000ffffffffff  0x000000ffffffffff
0x00007ffe385b7af0:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7b00:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7b10:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7b20:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7b30:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7b40:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7b50:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7b60:  0x0000000000000000  0x00007f58aea25191
0x00007ffe385b7b70: <0x0000000000000000  0x0000000000000000
0x00007ffe385b7b80:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7b90:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7ba0:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7bb0:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7bc0:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7bd0:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7be0:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7bf0:  0x0000000000000000  0x1a34de13f45e7800
0x00007ffe385b7c00:  0x00007f58ae993740  0x0000000000000006
0x00007ffe385b7c10:  0x0000000000203000  0x0000000000203000
0x00007ffe385b7c20:  0x000000000122f800  0x00007f58ae9d8276
0x00007ffe385b7c30:  0x00007ffe385b7e50  0x00007f58ae9c27f7
0x00007ffe385b7c40:  0x0000000000000020  0x0000000000000000
0x00007ffe385b7c50:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7c60:  0x0000000000000000  0x0000000000000000
runtime: unknown pc 0x7f58aea2519f
stack: frame={sp:0x7ffe385b7b70, fp:0x0} stack=[0x7ffe37db9118,0x7ffe385b8140)
0x00007ffe385b7a70:  0x0000000000000001  0x0000000000000000
0x00007ffe385b7a80:  0x00007f58ae9ade50  0x00007f58aea35c90
0x00007ffe385b7a90:  0x0000000000000000  0x00007ffe385b7e40
0x00007ffe385b7aa0:  0x000000ffffffffff  0x000000ffffffffff
0x00007ffe385b7ab0:  0x2525252525252525  0x2525252525252525
0x00007ffe385b7ac0:  0x00000000000000ff  0x0000000000000000
0x00007ffe385b7ad0:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7ae0:  0x000000ffffffffff  0x000000ffffffffff
0x00007ffe385b7af0:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7b00:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7b10:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7b20:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7b30:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7b40:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7b50:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7b60:  0x0000000000000000  0x00007f58aea25191
0x00007ffe385b7b70: <0x0000000000000000  0x0000000000000000
0x00007ffe385b7b80:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7b90:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7ba0:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7bb0:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7bc0:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7bd0:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7be0:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7bf0:  0x0000000000000000  0x1a34de13f45e7800
0x00007ffe385b7c00:  0x00007f58ae993740  0x0000000000000006
0x00007ffe385b7c10:  0x0000000000203000  0x0000000000203000
0x00007ffe385b7c20:  0x000000000122f800  0x00007f58ae9d8276
0x00007ffe385b7c30:  0x00007ffe385b7e50  0x00007f58ae9c27f7
0x00007ffe385b7c40:  0x0000000000000020  0x0000000000000000
0x00007ffe385b7c50:  0x0000000000000000  0x0000000000000000
0x00007ffe385b7c60:  0x0000000000000000  0x0000000000000000

goroutine 1 [running]:
runtime.systemstack_switch()
    /usr/local/go/src/runtime/asm_amd64.s:350 fp=0xc00009e780 sp=0xc00009e778 pc=0x46a180
runtime.main()
    /usr/local/go/src/runtime/proc.go:174 +0x7b fp=0xc00009e7e0 sp=0xc00009e780 pc=0x43ae3b
runtime.goexit()
    /usr/local/go/src/runtime/asm_amd64.s:1581 +0x1 fp=0xc00009e7e8 sp=0xc00009e7e0 pc=0x46c3a1

rax    0x0
rbx    0xce
rcx    0x7f58aea2519f
rdx    0x6
rdi    0xce
rsi    0xce
rbp    0x6
rsp    0x7ffe385b7b70
r8     0x7ffe385b7c40
r9     0x7f58aeb4b0c0
r10    0x8
r11    0x246
r12    0x203000
r13    0x6
r14    0x122f800
r15    0x7f5887e2205b
rip    0x7f58aea2519f
rflags 0x246
cs     0x33
fs     0x0
gs     0x0

[docholiday]

I had the same problem. My solution was to remove the plugin completely from the server and then reinstall it. To me it looked like a new plugin version used different user rights on some files.

[LibiKorol]

@docholiday as you recommended, I removed the plugin and reinstall it, it didn't fix the issue. We still received the same error "Unrecognized remote plugin message.."

[ArsenyBelorukov]

@LibiKorol How do you run Grafana? If you use alpine docker image try to switch to ubuntu image