search

openconfig / gnmi-gateway

A modular, distributed, and highly available service for modern network telemetry via OpenConfig and gNMI
Apache License 2.0
140 stars 32 forks source link

Updates are either delayed or getting lost when 256 network router streaming 10K updates/20sec #60

Open kulpatel opened 4 months ago

kulpatel commented 4 months ago

Bug description Updates are either delayed or getting lost when 256 network router streaming 10K updates/20sec. I tried two case when streaming directly from devices m receiving all the updates but while getting it from gateway i m not receiving all updates on time (delayed not at 20 sec its random some time 1 min apart sometime 2 min apart ). I have changed target devices t0 300, "-TargetLimit=300". Any setting needs to to be tweaked, i have tried changing the "GatewayTransitionBufferSize" to higher value but no luck @colinmcintosh any input?

Step to reproduce Steps to reproduce the behavior. For example:

  1. My config is '....'
  2. Type '....'
  3. Then type '....'
  4. See error

Expected behavior A clear and concise description of what you expected to happen.

Output or code snippets If applicable, add code, links to commits, or terminal output to help explain your problem.

Environment details Please include the output of go version. If you have any additional specific details about your environment to share please include them in the bug report.

Additional context Add any other context about the problem here.

HBLiB commented 4 months ago

You need a "broker"

Op ma 22 jul 2024 om 16:05 schreef kulpatel @.***>:

Bug description Updates are either delayed or getting lost when 256 network router streaming 10K updates/20sec. I tried two case when streaming directly from devices m receiving all the updates but while getting it from gateway i m not receiving all updates on time (delayed not at 20 sec its random some time 1 min apart sometime 2 min apart ). I have changed target devices t0 300, "-TargetLimit=300". Any setting needs to to be tweaked, i have tried changing the "GatewayTransitionBufferSize" to higher value but no luck @colinmcintosh https://github.com/colinmcintosh any input?

Step to reproduce Steps to reproduce the behavior. For example:

  1. My config is '....'
  2. Type '....'
  3. Then type '....'
  4. See error

Expected behavior A clear and concise description of what you expected to happen.

Output or code snippets If applicable, add code, links to commits, or terminal output to help explain your problem.

Environment details Please include the output of go version. If you have any additional specific details about your environment to share please include them in the bug report.

Additional context Add any other context about the problem here.

— Reply to this email directly, view it on GitHub https://github.com/openconfig/gnmi-gateway/issues/60, or unsubscribe https://github.com/notifications/unsubscribe-auth/AC7KZHB3YG2L3HTVDPOIKVDZNUGUNAVCNFSM6AAAAABLIMX3QWVHI2DSMVQWIX3LMV43ASLTON2WKOZSGQZDEOJXGE2DMMI . You are receiving this because you are subscribed to this thread.Message ID: @.***>

kulpatel commented 4 months ago

@HBLiB can u explain me i m bit new to this space what exactly u mean when u say broker. and do we need at the device facing side or client facing side? If u can explain me why we face this situation with borker that also helps me here. Anything i can refer here would be much appreciated . and just add poitn here we do subscribe to gateway to receive the updates.