jenningsloy318 / panos_exporter

paloalto os expoter for prometheus
Apache License 2.0
19 stars 16 forks source link

PaloAlto 5450 bug #15

Open inetman28 opened 1 year ago

inetman28 commented 1 year ago

hi, I found one new bug out it affects at least palo alto 5450 which is a chassis firewall

with 5260 everythings are going well

An error has occurred while serving metrics:

14 error(s) occurred:
* [from Gatherer #2] collected metric "panos_interface_counter_hw_obytes" { label:<name:"category" value:"hw" > label:<name:"domain" value:"interface_counter" > label:<name:"name" value:"" > gauge:<value:0 > } was collected before with the same name and label values
* [from Gatherer #2] collected metric "panos_interface_counter_hw_idrops" { label:<name:"category" value:"hw" > label:<name:"domain" value:"interface_counter" > label:<name:"name" value:"" > gauge:<value:0 > } was collected before with the same name and label values
* [from Gatherer #2] collected metric "panos_interface_counter_hw_ipackets" { label:<name:"category" value:"hw" > label:<name:"domain" value:"interface_counter" > label:<name:"name" value:"" > gauge:<value:0 > } was collected before with the same name and label values
* [from Gatherer #2] collected metric "panos_interface_counter_hw_opackets" { label:<name:"category" value:"hw" > label:<name:"domain" value:"interface_counter" > label:<name:"name" value:"" > gauge:<value:0 > } was collected before with the same name and label values
* [from Gatherer #2] collected metric "panos_interface_counter_hw_ierrors" { label:<name:"category" value:"hw" > label:<name:"domain" value:"interface_counter" > label:<name:"name" value:"" > gauge:<value:0 > } was collected before with the same name and label values
* [from Gatherer #2] collected metric "panos_interface_counter_hw_ibytes" { label:<name:"category" value:"hw" > label:<name:"domain" value:"interface_counter" > label:<name:"name" value:"" > gauge:<value:0 > } was collected before with the same name and label values
* [from Gatherer #2] collected metric "panos_interface_counter_hw_tx_unicast" { label:<name:"category" value:"hw" > label:<name:"domain" value:"interface_counter" > label:<name:"name" value:"" > gauge:<value:0 > } was collected before with the same name and label values
* [from Gatherer #2] collected metric "panos_interface_counter_hw_tx_multicast" { label:<name:"category" value:"hw" > label:<name:"domain" value:"interface_counter" > label:<name:"name" value:"" > gauge:<value:0 > } was collected before with the same name and label values
* [from Gatherer #2] collected metric "panos_interface_counter_hw_rx_broadcast" { label:<name:"category" value:"hw" > label:<name:"domain" value:"interface_counter" > label:<name:"name" value:"" > gauge:<value:0 > } was collected before with the same name and label values
* [from Gatherer #2] collected metric "panos_interface_counter_hw_rx_unicast" { label:<name:"category" value:"hw" > label:<name:"domain" value:"interface_counter" > label:<name:"name" value:"" > gauge:<value:0 > } was collected before with the same name and label values
* [from Gatherer #2] collected metric "panos_interface_counter_hw_rx_multicast" { label:<name:"category" value:"hw" > label:<name:"domain" value:"interface_counter" > label:<name:"name" value:"" > gauge:<value:0 > } was collected before with the same name and label values
* [from Gatherer #2] collected metric "panos_interface_counter_hw_rx_bytes" { label:<name:"category" value:"hw" > label:<name:"domain" value:"interface_counter" > label:<name:"name" value:"" > gauge:<value:0 > } was collected before with the same name and label values
* [from Gatherer #2] collected metric "panos_interface_counter_hw_tx_broadcast" { label:<name:"category" value:"hw" > label:<name:"domain" value:"interface_counter" > label:<name:"name" value:"" > gauge:<value:0 > } was collected before with the same name and label values
* [from Gatherer #2] collected metric "panos_interface_counter_hw_tx_bytes" { label:<name:"category" value:"hw" > label:<name:"domain" value:"interface_counter" > label:<name:"name" value:"" > gauge:<value:0 > } was collected before with the same name and label values
zbbfufu commented 1 year ago

Hi @inetman28, Thanks for reporting this issue.

In a first analysis, it looks like you have multiple hardware interfaces with the same name.

Could you try to query your 5450 API to get more information about the hardware interface counter metrics ?

Regards,

inetman28 commented 1 year ago

hi thanks for your code and answer

that looks like

<response status="success"><result>
  <ifnet>
    <ifnet>
      <entry>
        <icmp_frag>0</icmp_frag>
        <ifwderrors>0</ifwderrors>
        <ierrors>0</ierrors>
        <macspoof>0</macspoof>
        <pod>0</pod>
        <flowstate>0</flowstate>
        <ipspoof>0</ipspoof>
        <teardrop>0</teardrop>
        <ibytes>0</ibytes>
        <noarp>0</noarp>
        <sctp_conn>0</sctp_conn>
        <noroute>0</noroute>
        <noneigh>0</noneigh>
        <nomac>0</nomac>
        <l2_encap>0</l2_encap>
        <zonechange>0</zonechange>
        <other_conn>0</other_conn>
        <obytes>0</obytes>
        <land>0</land>
        <name>ethernet1/2</name>
        <tcp_conn>0</tcp_conn>
        <neighpend>0</neighpend>
        <ipackets>0</ipackets>
        <opackets>0</opackets>
        <l2_decap>0</l2_decap>
        <udp_conn>0</udp_conn>
        <idrops>0</idrops>
      </entry>
      <entry>
        <icmp_frag>0</icmp_frag>
        <ifwderrors>0</ifwderrors>
        <ierrors>0</ierrors>
        <macspoof>0</macspoof>
        <pod>0</pod>
        <flowstate>0</flowstate>
        <ipspoof>0</ipspoof>
        <teardrop>0</teardrop>
        <ibytes>0</ibytes>
        <noarp>0</noarp>
        <sctp_conn>0</sctp_conn>
        <noroute>0</noroute>
        <noneigh>0</noneigh>
        <nomac>0</nomac>
        <l2_encap>0</l2_encap>
        <zonechange>0</zonechange>
        <other_conn>0</other_conn>
        <obytes>0</obytes>
        <land>0</land>
        <name>ethernet1/2.11</name>
        <tcp_conn>0</tcp_conn>
        <neighpend>0</neighpend>
        <ipackets>0</ipackets>
        <opackets>0</opackets>
        <l2_decap>0</l2_decap>
        <udp_conn>0</udp_conn>
        <idrops>0</idrops>
      </entry>
      <entry>
        <icmp_frag>0</icmp_frag>
        <ifwderrors>0</ifwderrors>
        <ierrors>0</ierrors>
        <macspoof>0</macspoof>
        <pod>0</pod>
        <flowstate>0</flowstate>
        <ipspoof>0</ipspoof>
        <teardrop>0</teardrop>
        <ibytes>0</ibytes>
        <noarp>0</noarp>
        <sctp_conn>0</sctp_conn>
        <noroute>0</noroute>
        <noneigh>0</noneigh>
        <nomac>0</nomac>
        <l2_encap>0</l2_encap>
        <zonechange>0</zonechange>
        <other_conn>0</other_conn>
        <obytes>0</obytes>
        <land>0</land>
        <name>ethernet1/2.12</name>
        <tcp_conn>0</tcp_conn>
        <neighpend>0</neighpend>
        <ipackets>0</ipackets>
        <opackets>0</opackets>
        <l2_decap>0</l2_decap>
        <udp_conn>0</udp_conn>
        <idrops>0</idrops>
      </entry>
      <entry>
        <icmp_frag>0</icmp_frag>
        <ifwderrors>0</ifwderrors>
        <ierrors>0</ierrors>
        <macspoof>0</macspoof>
        <pod>0</pod>
        <flowstate>0</flowstate>
        <ipspoof>0</ipspoof>
        <teardrop>0</teardrop>
        <ibytes>0</ibytes>
        <noarp>0</noarp>
        <sctp_conn>0</sctp_conn>
        <noroute>0</noroute>
        <noneigh>0</noneigh>
        <nomac>0</nomac>
        <l2_encap>0</l2_encap>
        <zonechange>0</zonechange>
        <other_conn>0</other_conn>
        <obytes>0</obytes>
        <land>0</land>
        <name>ethernet1/2.13</name>
        <tcp_conn>0</tcp_conn>
        <neighpend>0</neighpend>
        <ipackets>0</ipackets>
        <opackets>0</opackets>
        <l2_decap>0</l2_decap>
        <udp_conn>0</udp_conn>
        <idrops>0</idrops>
      </entry>
      <entry>
        <icmp_frag>0</icmp_frag>
        <ifwderrors>0</ifwderrors>
        <ierrors>0</ierrors>
        <macspoof>0</macspoof>
        <pod>0</pod>
        <flowstate>0</flowstate>
        <ipspoof>0</ipspoof>
        <teardrop>0</teardrop>
        <ibytes>0</ibytes>
        <noarp>0</noarp>
        <sctp_conn>0</sctp_conn>
        <noroute>0</noroute>
        <noneigh>0</noneigh>
        <nomac>0</nomac>
        <l2_encap>0</l2_encap>
        <zonechange>0</zonechange>
        <other_conn>0</other_conn>
        <obytes>0</obytes>
        <land>0</land>
        <name>ethernet1/2.14</name>
        <tcp_conn>0</tcp_conn>
        <neighpend>0</neighpend>
        <ipackets>0</ipackets>
        <opackets>0</opackets>
        <l2_decap>0</l2_decap>
        <udp_conn>0</udp_conn>
        <idrops>0</idrops>
      </entry>
      <entry>
        <icmp_frag>0</icmp_frag>
        <ifwderrors>0</ifwderrors>
        <ierrors>0</ierrors>
        <macspoof>0</macspoof>
        <pod>0</pod>
        <flowstate>0</flowstate>
        <ipspoof>0</ipspoof>
        <teardrop>0</teardrop>
        <ibytes>0</ibytes>
        <noarp>0</noarp>
        <sctp_conn>0</sctp_conn>
        <noroute>0</noroute>
        <noneigh>0</noneigh>
        <nomac>0</nomac>
        <l2_encap>0</l2_encap>
        <zonechange>0</zonechange>
        <other_conn>0</other_conn>
        <obytes>0</obytes>
        <land>0</land>
        <name>ae4</name>
        <tcp_conn>0</tcp_conn>
        <neighpend>0</neighpend>
        <ipackets>0</ipackets>
        <opackets>0</opackets>
        <l2_decap>0</l2_decap>
        <udp_conn>0</udp_conn>
        <idrops>0</idrops>
      </entry>
      <entry>
        <icmp_frag>0</icmp_frag>
        <ifwderrors>0</ifwderrors>
        <ierrors>0</ierrors>
        <macspoof>0</macspoof>
        <pod>0</pod>
        <flowstate>0</flowstate>
        <ipspoof>0</ipspoof>
        <teardrop>0</teardrop>
        <ibytes>5091540</ibytes>
        <noarp>0</noarp>
        <sctp_conn>0</sctp_conn>
        <noroute>0</noroute>
        <noneigh>0</noneigh>
        <nomac>0</nomac>
        <l2_encap>0</l2_encap>
        <zonechange>0</zonechange>
        <other_conn>0</other_conn>
        <obytes>0</obytes>
        <land>0</land>
        <name>ae4.101</name>
        <tcp_conn>0</tcp_conn>
        <neighpend>0</neighpend>
        <ipackets>84859</ipackets>
        <opackets>0</opackets>
        <l2_decap>0</l2_decap>
        <udp_conn>0</udp_conn>
        <idrops>0</idrops>
      </entry>
      <entry>
        <icmp_frag>0</icmp_frag>
        <ifwderrors>0</ifwderrors>
        <ierrors>0</ierrors>
        <macspoof>0</macspoof>
        <pod>0</pod>
        <flowstate>0</flowstate>
        <ipspoof>0</ipspoof>
        <teardrop>0</teardrop>
        <ibytes>5091540</ibytes>
        <noarp>0</noarp>
        <sctp_conn>0</sctp_conn>
        <noroute>0</noroute>
        <noneigh>0</noneigh>
        <nomac>0</nomac>
        <l2_encap>0</l2_encap>
        <zonechange>0</zonechange>
        <other_conn>0</other_conn>
        <obytes>0</obytes>
        <land>0</land>
        <name>ae4.114</name>
        <tcp_conn>0</tcp_conn>
        <neighpend>0</neighpend>
        <ipackets>84859</ipackets>
        <opackets>0</opackets>
        <l2_decap>0</l2_decap>
        <udp_conn>0</udp_conn>
        <idrops>0</idrops>
      </entry>
      <entry>
        <icmp_frag>0</icmp_frag>
        <ifwderrors>0</ifwderrors>
        <ierrors>0</ierrors>
        <macspoof>0</macspoof>
        <pod>0</pod>
        <flowstate>0</flowstate>
        <ipspoof>0</ipspoof>
        <teardrop>0</teardrop>
        <ibytes>5093040</ibytes>
        <noarp>0</noarp>
        <sctp_conn>0</sctp_conn>
        <noroute>0</noroute>
        <noneigh>0</noneigh>
        <nomac>0</nomac>
        <l2_encap>0</l2_encap>
        <zonechange>0</zonechange>
        <other_conn>0</other_conn>
        <obytes>0</obytes>
        <land>0</land>
        <name>ae4.1082</name>
        <tcp_conn>0</tcp_conn>
        <neighpend>0</neighpend>
        <ipackets>84884</ipackets>
        <opackets>0</opackets>
        <l2_decap>0</l2_decap>
        <udp_conn>0</udp_conn>
        <idrops>0</idrops>
      </entry>
      <entry>
        <icmp_frag>0</icmp_frag>
        <ifwderrors>0</ifwderrors>
        <ierrors>0</ierrors>
        <macspoof>0</macspoof>
        <pod>0</pod>
        <flowstate>0</flowstate>
        <ipspoof>0</ipspoof>
        <teardrop>0</teardrop>
        <ibytes>5092080</ibytes>
        <noarp>0</noarp>
        <sctp_conn>0</sctp_conn>
        <noroute>0</noroute>
        <noneigh>0</noneigh>
        <nomac>0</nomac>
        <l2_encap>0</l2_encap>
        <zonechange>0</zonechange>
        <other_conn>0</other_conn>
        <obytes>0</obytes>
        <land>0</land>
        <name>ae4.1254</name>
        <tcp_conn>0</tcp_conn>
        <neighpend>0</neighpend>
        <ipackets>84868</ipackets>
        <opackets>0</opackets>
        <l2_decap>0</l2_decap>
        <udp_conn>0</udp_conn>
        <idrops>0</idrops>
      </entry>
      <entry>
        <icmp_frag>0</icmp_frag>
        <ifwderrors>0</ifwderrors>
        <ierrors>0</ierrors>
        <macspoof>0</macspoof>
        <pod>0</pod>
        <flowstate>0</flowstate>
        <ipspoof>0</ipspoof>
        <teardrop>0</teardrop>
        <ibytes>5092980</ibytes>
        <noarp>0</noarp>
        <sctp_conn>0</sctp_conn>
        <noroute>0</noroute>
        <noneigh>0</noneigh>
        <nomac>0</nomac>
        <l2_encap>0</l2_encap>
        <zonechange>0</zonechange>
        <other_conn>0</other_conn>
        <obytes>0</obytes>
        <land>0</land>
        <name>ae4.1354</name>
        <tcp_conn>0</tcp_conn>
        <neighpend>0</neighpend>
        <ipackets>84883</ipackets>
        <opackets>0</opackets>
        <l2_decap>0</l2_decap>
        <udp_conn>0</udp_conn>
        <idrops>0</idrops>
      </entry>
      <entry>
        <icmp_frag>0</icmp_frag>
        <ifwderrors>0</ifwderrors>
        <ierrors>0</ierrors>
        <macspoof>0</macspoof>
        <pod>0</pod>
        <flowstate>0</flowstate>
        <ipspoof>0</ipspoof>
        <teardrop>0</teardrop>
        <ibytes>5092800</ibytes>
        <noarp>0</noarp>
        <sctp_conn>0</sctp_conn>
        <noroute>0</noroute>
        <noneigh>0</noneigh>
        <nomac>0</nomac>
        <l2_encap>0</l2_encap>
        <zonechange>0</zonechange>
        <other_conn>0</other_conn>
        <obytes>0</obytes>
        <land>0</land>
        <name>ae4.1454</name>
        <tcp_conn>0</tcp_conn>
        <neighpend>0</neighpend>
        <ipackets>84880</ipackets>
        <opackets>0</opackets>
        <l2_decap>0</l2_decap>
        <udp_conn>0</udp_conn>
        <idrops>0</idrops>
      </entry>
      <entry>
        <icmp_frag>0</icmp_frag>
        <ifwderrors>0</ifwderrors>
        <ierrors>0</ierrors>
        <macspoof>0</macspoof>
        <pod>0</pod>
        <flowstate>0</flowstate>
        <ipspoof>0</ipspoof>
        <teardrop>0</teardrop>
        <ibytes>5092620</ibytes>
        <noarp>0</noarp>
        <sctp_conn>0</sctp_conn>
        <noroute>0</noroute>
        <noneigh>0</noneigh>
        <nomac>0</nomac>
        <l2_encap>0</l2_encap>
        <zonechange>0</zonechange>
        <other_conn>0</other_conn>
        <obytes>0</obytes>
        <land>0</land>
        <name>ae4.1554</name>
        <tcp_conn>0</tcp_conn>
        <neighpend>0</neighpend>
        <ipackets>84877</ipackets>
        <opackets>0</opackets>
        <l2_decap>0</l2_decap>
        <udp_conn>0</udp_conn>
        <idrops>0</idrops>
      </entry>
      <entry>
        <icmp_frag>0</icmp_frag>
        <ifwderrors>0</ifwderrors>
        <ierrors>0</ierrors>
        <macspoof>0</macspoof>
        <pod>0</pod>
        <flowstate>0</flowstate>
        <ipspoof>0</ipspoof>
        <teardrop>0</teardrop>
        <ibytes>5092260</ibytes>
        <noarp>0</noarp>
        <sctp_conn>0</sctp_conn>
        <noroute>0</noroute>
        <noneigh>0</noneigh>
        <nomac>0</nomac>
        <l2_encap>0</l2_encap>
        <zonechange>0</zonechange>
        <other_conn>0</other_conn>
        <obytes>0</obytes>
        <land>0</land>
        <name>ae4.1654</name>
        <tcp_conn>0</tcp_conn>
        <neighpend>0</neighpend>
        <ipackets>84871</ipackets>
        <opackets>0</opackets>
        <l2_decap>0</l2_decap>
        <udp_conn>0</udp_conn>
        <idrops>0</idrops>
      </entry>
      <entry>
        <icmp_frag>0</icmp_frag>
        <ifwderrors>0</ifwderrors>
        <ierrors>0</ierrors>
        <macspoof>0</macspoof>
        <pod>0</pod>
        <flowstate>0</flowstate>
        <ipspoof>0</ipspoof>
        <teardrop>0</teardrop>
        <ibytes>5092020</ibytes>
        <noarp>0</noarp>
        <sctp_conn>0</sctp_conn>
        <noroute>0</noroute>
        <noneigh>0</noneigh>
        <nomac>0</nomac>
        <l2_encap>0</l2_encap>
        <zonechange>0</zonechange>
        <other_conn>0</other_conn>
        <obytes>0</obytes>
        <land>0</land>
        <name>ae4.1754</name>
        <tcp_conn>0</tcp_conn>
        <neighpend>0</neighpend>
        <ipackets>84867</ipackets>
        <opackets>0</opackets>
        <l2_decap>0</l2_decap>
        <udp_conn>0</udp_conn>
        <idrops>0</idrops>
      </entry>
      <entry>
        <icmp_frag>0</icmp_frag>
        <ifwderrors>0</ifwderrors>
        <ierrors>0</ierrors>
        <macspoof>0</macspoof>
        <pod>0</pod>
        <flowstate>0</flowstate>
        <ipspoof>0</ipspoof>
        <teardrop>0</teardrop>
        <ibytes>5093160</ibytes>
        <noarp>0</noarp>
        <sctp_conn>0</sctp_conn>
        <noroute>0</noroute>
        <noneigh>0</noneigh>
        <nomac>0</nomac>
        <l2_encap>0</l2_encap>
        <zonechange>0</zonechange>
        <other_conn>0</other_conn>
        <obytes>0</obytes>
        <land>0</land>
        <name>ae4.1854</name>
        <tcp_conn>0</tcp_conn>
        <neighpend>0</neighpend>
        <ipackets>84886</ipackets>
        <opackets>0</opackets>
        <l2_decap>0</l2_decap>
        <udp_conn>0</udp_conn>
        <idrops>0</idrops>
      </entry>
      <entry>
        <icmp_frag>0</icmp_frag>
        <ifwderrors>0</ifwderrors>
        <ierrors>0</ierrors>
        <macspoof>0</macspoof>
        <pod>0</pod>
        <flowstate>0</flowstate>
        <ipspoof>0</ipspoof>
        <teardrop>0</teardrop>
        <ibytes>5092920</ibytes>
        <noarp>0</noarp>
        <sctp_conn>0</sctp_conn>
        <noroute>0</noroute>
        <noneigh>0</noneigh>
        <nomac>0</nomac>
        <l2_encap>0</l2_encap>
        <zonechange>0</zonechange>
        <other_conn>0</other_conn>
        <obytes>0</obytes>
        <land>0</land>
        <name>ae4.1954</name>
        <tcp_conn>0</tcp_conn>
        <neighpend>0</neighpend>
        <ipackets>84882</ipackets>
        <opackets>0</opackets>
        <l2_decap>0</l2_decap>
        <udp_conn>0</udp_conn>
        <idrops>0</idrops>
      </entry>
      <entry>
        <icmp_frag>0</icmp_frag>
        <ifwderrors>0</ifwderrors>
        <ierrors>0</ierrors>
        <macspoof>0</macspoof>
        <pod>0</pod>
        <flowstate>0</flowstate>
        <ipspoof>0</ipspoof>
        <teardrop>0</teardrop>
        <ibytes>0</ibytes>
        <noarp>0</noarp>
        <counters>
          <tx-errs>0</tx-errs>
          <tx-fifo>0</tx-fifo>
          <tx-packets>30960613</tx-packets>
          <rx-errs>0</rx-errs>
          <tx-carrier>0</tx-carrier>
          <rx-fifo>0</rx-fifo>
          <rx-compressed>0</rx-compressed>
          <rx-drop>0</rx-drop>
          <rx-bytes>2320500057</rx-bytes>
          <tx-colls>0</tx-colls>
          <rx-multicast>0</rx-multicast>
          <rx-packets>30561897</rx-packets>
          <tx-drop>0</tx-drop>
          <tx-bytes>2021017962</tx-bytes>
          <rx-frame>0</rx-frame>
          <tx-compressed>0</tx-compressed>
        </counters>
        <sctp_conn>0</sctp_conn>
        <noroute>0</noroute>
        <noneigh>0</noneigh>
        <nomac>0</nomac>
        <l2_encap>0</l2_encap>
        <zonechange>0</zonechange>
        <other_conn>0</other_conn>
        <obytes>0</obytes>
        <land>0</land>
        <name>ha1-a</name>
        <tcp_conn>0</tcp_conn>
        <neighpend>0</neighpend>
        <ipackets>0</ipackets>
        <opackets>0</opackets>
        <l2_decap>0</l2_decap>
        <udp_conn>0</udp_conn>
        <idrops>0</idrops>
      </entry>
      <entry>
        <icmp_frag>0</icmp_frag>
        <ifwderrors>0</ifwderrors>
        <ierrors>0</ierrors>
        <macspoof>0</macspoof>
        <pod>0</pod>
        <flowstate>0</flowstate>
        <ipspoof>0</ipspoof>
        <teardrop>0</teardrop>
        <ibytes>0</ibytes>
        <noarp>0</noarp>
        <counters>
          <tx-errs>0</tx-errs>
          <tx-fifo>0</tx-fifo>
          <tx-packets>16560157</tx-packets>
          <rx-errs>0</rx-errs>
          <tx-carrier>0</tx-carrier>
          <rx-fifo>0</rx-fifo>
          <rx-compressed>0</rx-compressed>
          <rx-drop>0</rx-drop>
          <rx-bytes>1052537804</rx-bytes>
          <tx-colls>0</tx-colls>
          <rx-multicast>0</rx-multicast>
          <rx-packets>16155197</rx-packets>
          <tx-drop>0</tx-drop>
          <tx-bytes>832458331</tx-bytes>
          <rx-frame>0</rx-frame>
          <tx-compressed>0</tx-compressed>
        </counters>
        <sctp_conn>0</sctp_conn>
        <noroute>0</noroute>
        <noneigh>0</noneigh>
        <nomac>0</nomac>
        <l2_encap>0</l2_encap>
        <zonechange>0</zonechange>
        <other_conn>0</other_conn>
        <obytes>0</obytes>
        <land>0</land>
        <name>ha1-b</name>
        <tcp_conn>0</tcp_conn>
        <neighpend>0</neighpend>
        <ipackets>0</ipackets>
        <opackets>0</opackets>
        <l2_decap>0</l2_decap>
        <udp_conn>0</udp_conn>
        <idrops>0</idrops>
      </entry>
      <entry>
        <icmp_frag>0</icmp_frag>
        <ifwderrors>0</ifwderrors>
        <ierrors>0</ierrors>
        <macspoof>0</macspoof>
        <pod>0</pod>
        <flowstate>0</flowstate>
        <ipspoof>0</ipspoof>
        <teardrop>0</teardrop>
        <ibytes>0</ibytes>
        <noarp>0</noarp>
        <sctp_conn>0</sctp_conn>
        <noroute>0</noroute>
        <noneigh>0</noneigh>
        <nomac>0</nomac>
        <l2_encap>0</l2_encap>
        <zonechange>0</zonechange>
        <other_conn>0</other_conn>
        <obytes>0</obytes>
        <land>0</land>
        <name>vlan</name>
        <tcp_conn>0</tcp_conn>
        <neighpend>0</neighpend>
        <ipackets>0</ipackets>
        <opackets>0</opackets>
        <l2_decap>0</l2_decap>
        <udp_conn>0</udp_conn>
        <idrops>0</idrops>
      </entry>
      <entry>
        <icmp_frag>0</icmp_frag>
        <ifwderrors>0</ifwderrors>
        <ierrors>0</ierrors>
        <macspoof>0</macspoof>
        <pod>0</pod>
        <flowstate>0</flowstate>
        <ipspoof>0</ipspoof>
        <teardrop>0</teardrop>
        <ibytes>0</ibytes>
        <noarp>0</noarp>
        <sctp_conn>0</sctp_conn>
        <noroute>0</noroute>
        <noneigh>0</noneigh>
        <nomac>0</nomac>
        <l2_encap>0</l2_encap>
        <zonechange>0</zonechange>
        <other_conn>0</other_conn>
        <obytes>0</obytes>
        <land>0</land>
        <name>loopback</name>
        <tcp_conn>0</tcp_conn>
        <neighpend>0</neighpend>
        <ipackets>0</ipackets>
        <opackets>0</opackets>
        <l2_decap>0</l2_decap>
        <udp_conn>0</udp_conn>
        <idrops>0</idrops>
      </entry>
      <entry>
        <icmp_frag>0</icmp_frag>
        <ifwderrors>0</ifwderrors>
        <ierrors>0</ierrors>
        <macspoof>0</macspoof>
        <pod>0</pod>
        <flowstate>0</flowstate>
        <ipspoof>0</ipspoof>
        <teardrop>0</teardrop>
        <ibytes>0</ibytes>
        <noarp>0</noarp>
        <sctp_conn>0</sctp_conn>
        <noroute>0</noroute>
        <noneigh>0</noneigh>
        <nomac>0</nomac>
        <l2_encap>0</l2_encap>
        <zonechange>0</zonechange>
        <other_conn>0</other_conn>
        <obytes>0</obytes>
        <land>0</land>
        <name>loopback.1</name>
        <tcp_conn>0</tcp_conn>
        <neighpend>0</neighpend>
        <ipackets>0</ipackets>
        <opackets>0</opackets>
        <l2_decap>0</l2_decap>
        <udp_conn>0</udp_conn>
        <idrops>0</idrops>
      </entry>
      <entry>
        <icmp_frag>0</icmp_frag>
        <ifwderrors>0</ifwderrors>
        <ierrors>0</ierrors>
        <macspoof>0</macspoof>
        <pod>0</pod>
        <flowstate>0</flowstate>
        <ipspoof>0</ipspoof>
        <teardrop>0</teardrop>
        <ibytes>0</ibytes>
        <noarp>0</noarp>
        <sctp_conn>0</sctp_conn>
        <noroute>0</noroute>
        <noneigh>0</noneigh>
        <nomac>0</nomac>
        <l2_encap>0</l2_encap>
        <zonechange>0</zonechange>
        <other_conn>0</other_conn>
        <obytes>0</obytes>
        <land>0</land>
        <name>loopback.2</name>
        <tcp_conn>0</tcp_conn>
        <neighpend>0</neighpend>
        <ipackets>0</ipackets>
        <opackets>0</opackets>
        <l2_decap>0</l2_decap>
        <udp_conn>0</udp_conn>
        <idrops>0</idrops>
      </entry>
      <entry>
        <icmp_frag>0</icmp_frag>
        <ifwderrors>0</ifwderrors>
        <ierrors>0</ierrors>
        <macspoof>0</macspoof>
        <pod>0</pod>
        <flowstate>0</flowstate>
        <ipspoof>0</ipspoof>
        <teardrop>0</teardrop>
        <ibytes>0</ibytes>
        <noarp>0</noarp>
        <sctp_conn>0</sctp_conn>
        <noroute>0</noroute>
        <noneigh>0</noneigh>
        <nomac>0</nomac>
        <l2_encap>0</l2_encap>
        <zonechange>0</zonechange>
        <other_conn>0</other_conn>
        <obytes>0</obytes>
        <land>0</land>
        <name>loopback.3</name>
        <tcp_conn>0</tcp_conn>
        <neighpend>0</neighpend>
        <ipackets>0</ipackets>
        <opackets>0</opackets>
        <l2_decap>0</l2_decap>
        <udp_conn>0</udp_conn>
        <idrops>0</idrops>
      </entry>
      <entry>
        <icmp_frag>0</icmp_frag>
        <ifwderrors>0</ifwderrors>
        <ierrors>0</ierrors>
        <macspoof>0</macspoof>
        <pod>0</pod>
        <flowstate>0</flowstate>
        <ipspoof>0</ipspoof>
        <teardrop>0</teardrop>
        <ibytes>0</ibytes>
        <noarp>0</noarp>
        <sctp_conn>0</sctp_conn>
        <noroute>0</noroute>
        <noneigh>0</noneigh>
        <nomac>0</nomac>
        <l2_encap>0</l2_encap>
        <zonechange>0</zonechange>
        <other_conn>0</other_conn>
        <obytes>0</obytes>
        <land>0</land>
        <name>tunnel</name>
        <tcp_conn>0</tcp_conn>
        <neighpend>0</neighpend>
        <ipackets>0</ipackets>
        <opackets>0</opackets>
        <l2_decap>0</l2_decap>
        <udp_conn>0</udp_conn>
        <idrops>0</idrops>
      </entry>
    </ifnet>
  </ifnet>
  <hw>
    <entry>
      <obytes>0</obytes>
      <name>ethernet1/2</name>
      <idrops>0</idrops>
      <ipackets>0</ipackets>
      <opackets>0</opackets>
      <ierrors>0</ierrors>
      <interface>ethernet1/2</interface>
      <ibytes>0</ibytes>
      <port>
        <tx-unicast>0</tx-unicast>
        <tx-multicast>0</tx-multicast>
        <rx-broadcast>0</rx-broadcast>
        <rx-unicast>0</rx-unicast>
        <rx-multicast>0</rx-multicast>
        <rx-bytes>0</rx-bytes>
        <tx-broadcast>0</tx-broadcast>
        <tx-bytes>0</tx-bytes>
      </port>
    </entry>
    <entry>
      <obytes>0</obytes>
      <name>ethernet1/25</name>
      <idrops>0</idrops>
      <ipackets>1846006</ipackets>
      <opackets>0</opackets>
      <ierrors>110</ierrors>
      <interface>ethernet1/25</interface>
      <ibytes>203168209</ibytes>
      <port>
        <tx-unicast>0</tx-unicast>
        <tx-multicast>0</tx-multicast>
        <rx-broadcast>226752</rx-broadcast>
        <rx-unicast>0</rx-unicast>
        <rx-multicast>672819</rx-multicast>
        <rx-bytes>102919644</rx-bytes>
        <tx-broadcast>0</tx-broadcast>
        <tx-bytes>0</tx-bytes>
      </port>
    </entry>
    <entry>
      <obytes>0</obytes>
      <name>ethernet1/26</name>
      <idrops>0</idrops>
      <ipackets>1847434</ipackets>
      <opackets>0</opackets>
      <ierrors>109</ierrors>
      <interface>ethernet1/26</interface>
      <ibytes>203344350</ibytes>
      <port>
        <tx-unicast>0</tx-unicast>
        <tx-multicast>0</tx-multicast>
        <rx-broadcast>226454</rx-broadcast>
        <rx-unicast>0</rx-unicast>
        <rx-multicast>670131</rx-multicast>
        <rx-bytes>102373670</rx-bytes>
        <tx-broadcast>0</tx-broadcast>
        <tx-bytes>0</tx-bytes>
      </port>
    </entry>
    <entry>
      <obytes>0</obytes>
      <name>ae4</name>
      <idrops>0</idrops>
      <ipackets>0</ipackets>
      <opackets>0</opackets>
      <ierrors>0</ierrors>
      <interface>ae4</interface>
      <ibytes>0</ibytes>
      <port>
        <tx-unicast>0</tx-unicast>
        <tx-multicast>0</tx-multicast>
        <rx-broadcast>453206</rx-broadcast>
        <rx-unicast>0</rx-unicast>
        <rx-multicast>1342950</rx-multicast>
        <rx-bytes>205293314</rx-bytes>
        <tx-broadcast>0</tx-broadcast>
        <tx-bytes>0</tx-bytes>
      </port>
    </entry>
    <entry>
      <obytes>0</obytes>
      <name>vlan</name>
      <idrops>0</idrops>
      <ipackets>0</ipackets>
      <opackets>0</opackets>
      <ierrors>0</ierrors>
      <interface>vlan</interface>
      <ibytes>0</ibytes>
    </entry>
    <entry>
      <obytes>0</obytes>
      <name>loopback</name>
      <idrops>0</idrops>
      <ipackets>0</ipackets>
      <opackets>0</opackets>
      <ierrors>0</ierrors>
      <interface>loopback</interface>
      <ibytes>0</ibytes>
    </entry>
    <entry>
      <obytes>0</obytes>
      <name>tunnel</name>
      <idrops>0</idrops>
      <ipackets>0</ipackets>
      <opackets>0</opackets>
      <ierrors>0</ierrors>
      <interface>tunnel</interface>
      <ibytes>0</ibytes>
    </entry>
    <entry>
      <tx-unicast>339297491024</tx-unicast>
      <tx-multicast>0</tx-multicast>
      <rx-broadcast>0</rx-broadcast>
      <rx-unicast>0</rx-unicast>
      <rx-multicast>0</rx-multicast>
      <rx-bytes>33670443511102</rx-bytes>
      <tx-broadcast>0</tx-broadcast>
      <tx-bytes>154715624602770</tx-bytes>
    </entry>
    <entry>
      <tx-unicast>339263971901</tx-unicast>
      <tx-multicast>0</tx-multicast>
      <rx-broadcast>0</rx-broadcast>
      <rx-unicast>0</rx-unicast>
      <rx-multicast>0</rx-multicast>
      <rx-bytes>33626492296412</rx-bytes>
      <tx-broadcast>0</tx-broadcast>
      <tx-bytes>154700374342956</tx-bytes>
    </entry>
  </hw>
</result></response>%
inetman28 commented 1 year ago

what do you think about that?

pawelos99 commented 1 year ago

Looks like the interface name is empty for some of the data, but I don't see any problem in the code which can cause that. Can you confirm its still there?

mari-arondeus commented 1 year ago

I'm testing this out on a 5220, getting a similar response (albeit only one error):

An error has occurred while serving metrics:

[from Gatherer #2] collected metric "panos_report_topsources" { label:<name:"category" value:"predefined" > label:<name:"domain" value:"report" > label:<name:"resolvedSource" value:"<redacted IP>" > label:<name:"source" value:"<redacted IP>" > gauge:<value:308725 > } was collected before with the same name and label values
dprillxyz commented 1 year ago

I'm seeing similar behavior on a pair of PA-5450 devices running PAN-OS 10.1.10-h2.

An error has occurred while serving metrics:

14 error(s) occurred:
* [from Gatherer #2] collected metric "panos_interface_counter_hw_obytes" { label:<name:"category" value:"hw" > label:<name:"domain" value:"interface_counter" > label:<name:"name" value:"" > gauge:<value:0 > } was collected before with the same name and label values
* [from Gatherer #2] collected metric "panos_interface_counter_hw_idrops" { label:<name:"category" value:"hw" > label:<name:"domain" value:"interface_counter" > label:<name:"name" value:"" > gauge:<value:0 > } was collected before with the same name and label values
* [from Gatherer #2] collected metric "panos_interface_counter_hw_ipackets" { label:<name:"category" value:"hw" > label:<name:"domain" value:"interface_counter" > label:<name:"name" value:"" > gauge:<value:0 > } was collected before with the same name and label values
* [from Gatherer #2] collected metric "panos_interface_counter_hw_opackets" { label:<name:"category" value:"hw" > label:<name:"domain" value:"interface_counter" > label:<name:"name" value:"" > gauge:<value:0 > } was collected before with the same name and label values
* [from Gatherer #2] collected metric "panos_interface_counter_hw_ierrors" { label:<name:"category" value:"hw" > label:<name:"domain" value:"interface_counter" > label:<name:"name" value:"" > gauge:<value:0 > } was collected before with the same name and label values
* [from Gatherer #2] collected metric "panos_interface_counter_hw_ibytes" { label:<name:"category" value:"hw" > label:<name:"domain" value:"interface_counter" > label:<name:"name" value:"" > gauge:<value:0 > } was collected before with the same name and label values
* [from Gatherer #2] collected metric "panos_interface_counter_hw_tx_unicast" { label:<name:"category" value:"hw" > label:<name:"domain" value:"interface_counter" > label:<name:"name" value:"" > gauge:<value:0 > } was collected before with the same name and label values
* [from Gatherer #2] collected metric "panos_interface_counter_hw_tx_multicast" { label:<name:"category" value:"hw" > label:<name:"domain" value:"interface_counter" > label:<name:"name" value:"" > gauge:<value:0 > } was collected before with the same name and label values
* [from Gatherer #2] collected metric "panos_interface_counter_hw_rx_broadcast" { label:<name:"category" value:"hw" > label:<name:"domain" value:"interface_counter" > label:<name:"name" value:"" > gauge:<value:0 > } was collected before with the same name and label values
* [from Gatherer #2] collected metric "panos_interface_counter_hw_rx_unicast" { label:<name:"category" value:"hw" > label:<name:"domain" value:"interface_counter" > label:<name:"name" value:"" > gauge:<value:0 > } was collected before with the same name and label values
* [from Gatherer #2] collected metric "panos_interface_counter_hw_rx_multicast" { label:<name:"category" value:"hw" > label:<name:"domain" value:"interface_counter" > label:<name:"name" value:"" > gauge:<value:0 > } was collected before with the same name and label values
* [from Gatherer #2] collected metric "panos_interface_counter_hw_rx_bytes" { label:<name:"category" value:"hw" > label:<name:"domain" value:"interface_counter" > label:<name:"name" value:"" > gauge:<value:0 > } was collected before with the same name and label values
* [from Gatherer #2] collected metric "panos_interface_counter_hw_tx_broadcast" { label:<name:"category" value:"hw" > label:<name:"domain" value:"interface_counter" > label:<name:"name" value:"" > gauge:<value:0 > } was collected before with the same name and label values
* [from Gatherer #2] collected metric "panos_interface_counter_hw_tx_bytes" { label:<name:"category" value:"hw" > label:<name:"domain" value:"interface_counter" > label:<name:"name" value:"" > gauge:<value:0 > } was collected before with the same name and label values

Happy to do some data gathering to try and get to the root cause.

mvivaldi commented 8 months ago

Same problem here:

An error has occurred while serving metrics:

[from Gatherer #2] collected metric "panos_report_topsources" { label:<name:"category" value:"predefined" > label:<name:"domain" value:"report" > label:<name:"resolvedSource" value:"virgo.domain" > label:<name:"source" value:"192.168.148.180" > gauge:<value:20343 > } was collected before with the same name and label values

PaloAlto 5220 with 10.2.7-h3

Shadow00Caster commented 5 months ago

Similar on a 1420 running 11.1.2-h3, was working fine on 11.1.2

* [from Gatherer #2] collected metric "panos_report_topsources" { label:<name:"category" value:"predefined" > label:<name:"domain" value:"report" > label:<name:"resolvedSource" value:"x.x.x.x" > label:<name:"source" value:"x.x.x.x" > gauge:<value:43434 > } was collected before with the same name and label values
* [from Gatherer #2] collected metric "panos_report_topdestinations" { label:<name:"category" value:"predefined" > label:<name:"destination" value:"x.x.x.x" > label:<name:"domain" value:"report" > label:<name:"resolvedDestination" value:"x.x.x.x" > gauge:<value:346505 > } was collected before with the same name and label values