search

MetPX / sarracenia

https://MetPX.github.io/sarracenia
GNU General Public License v2.0
45 stars 22 forks source link

metrics not displayed accurately for some polls. #657

Open petersilva opened 1 year ago

petersilva commented 1 year ago 
aspypas@srdev1:~/Sarracenia/sr3/sarracenia$ sr3 status
status:
Component/Config                         Processes   Connection        Lag                Rates
                                         State   Run Retry  msg data   LagMax  LagAvg  %rej     pubsub   messages     RxData     TxData
                                         -----   --- -----  --- ----   ------  ------  ----   --------       ----     ------     ------
cpost/hd_local                           stop    0/0     0  -1%   0%    0.00s    0.00s  0.0%  0 Bytes/s   0 msgs/s  0 Bytes/s  0 Bytes/s
cpost/my_products                        stop    0/0          -          -         -     -          -        -
poll/airnow_man_pxpaz3                   stop    0/0          -          -         -     -          -        -
poll/noaa_ncep_lam                       run     1/1     0  -1%   0%    0.00s    0.00s  0.0%  0 Bytes/s   0 msgs/s  0 Bytes/s  0 Bytes/s
sender/hd_upload_to_fex                  stop    0/0     0  -1%   0%    0.00s    0.00s  0.0%  0 Bytes/s   0 msgs/s  0 Bytes/s  0 Bytes/s
subscribe/hd_download_from_fex           stop    0/0     0  -1%   0%    0.00s    0.00s  0.0%  0 Bytes/s   0 msgs/s  0 Bytes/s  0 Bytes/s
subscribe/their_feed                     stop    0/0     0  -1%   0%    0.00s    0.00s  0.0%  0 Bytes/s   0 msgs/s  0 Bytes/s  0 Bytes/s
      Total Running Configs:   1 ( Processes: 1 missing: 0 stray: 0 )
                     Memory: uss:452.6 MiB rss:461.8 MiB vms:525.7 MiB
                   CPU Time: User:260.20s System:1.83s
           Pub/Sub Received: 0 msgs/s (0 Bytes/s), Sent:  0 msgs/s (0 Bytes/s)
              Data Received: 0 Files/s (0 Bytes/s), Sent: 0 Files/s (0 Bytes/s)
aspypas@srdev1:~/Sarracenia/sr3/sarracenia$

looking at poll/noaa_ncep_lam ...

but the metrics file indicates 100% rejection rate:

aspypas@srdev1:~/Sarracenia/sr3/sarracenia$ more ~/.cache/sr3/poll/noaa_ncep_lam/*.metrics
{"flow": {"stop_requested": false, "last_housekeeping": 1683031169.148135, "transferConnected": false, "transferConnectStart": 0, "transferConnectTime": 0, "transferRxBytes": 0, "transferTxBytes":
0, "transferRxFiles": 0, "transferTxFiles": 0, "next_housekeeping": 1683031469.148135}, "post.message": {"connected": true, "disconnectLast": 0, "disconnectTime": 0, "disconnectCount": 0, "rxByteCo
unt": 0, "rxGoodCount": 0, "rxBadCount": 0, "txByteCount": 0, "txGoodCount": 0, "txBadCount": 0}, "retry": {"msgs_in_download_retry": 0, "msgs_in_post_retry": 0}, "log": {"lagMax": 0, "lagTotal": 0
, "lagMessageCount": 0, "rejectCount": 200289}, "poll": {"transferRxBytes": 0}}
aspypas@srdev1:~/Sarracenia/sr3/sarracenia$

rejectCount is over 200 thousand, and the messages accepted is zero... the %rejection rate should be 100 or higher...

so something is wrong.

petersilva commented 1 year ago

might need to add support for housekeeping while sleeping in a poll.