search

zeromq / zbroker

Elastic pipes
Mozilla Public License 2.0
50 stars 11 forks source link

Problem: zyre sometimes goes crazy. O_o #79

Closed rpedde closed 10 years ago

rpedde commented 10 years ago

I've only seen this on multihomed boxes, but sometimes zyre starts pumping out scads of broadcasts:

https://gist.github.com/willkelly/08843595e7cc9e9bfcf8 https://gist.github.com/willkelly/6618d793a822b32624b6

rpedde commented 10 years ago

If you are going to disconnect pipes on server disconnects, this will be an issue. Several times I've seen where a server appears and disappears around 1500 times a second. When this happens, the reader/writer handshakes seems to fail.

hintjens commented 10 years ago

Yes.... Have to fix that zyre issue first... On May 8, 2014 6:35 PM, "Ron Pedde" notifications@github.com wrote:

If you are going to disconnect pipes on server disconnects, this will be an issue. Several times I've seen where a server appears and disappears around 1500 times a second. When this happens, the reader/writer handshakes seems to fail.

— Reply to this email directly or view it on GitHubhttps://github.com/zeromq/zbroker/issues/79#issuecomment-42572620 .

rpedde commented 10 years ago

After the reader/writer handshake confusion, this seems to be the most common problem

hintjens commented 10 years ago

I've added tracing to Zyre to debug the issue, and unpinned the Zyre version in zbroker/.travis.yml. For the reader/writer confusion I have pushed a plausible solution.

All waiting on merges now :-)

rpedde commented 10 years ago

reader/writer seems to have fixed it. I'll rebuild off trunk zyre and get you better zyre storm logs.

willkelly commented 10 years ago

I've got extended logs of the behavior here: https://gist.githubusercontent.com/willkelly/64fc56d206db9e5f2d44/raw/gistfile1.txt

hintjens commented 10 years ago

Thanks, that's really helpful.

On Thu, May 8, 2014 at 9:06 PM, William Kelly notifications@github.comwrote:

I've got extended logs of the behavior here: https://gist.githubusercontent.com/willkelly/64fc56d206db9e5f2d44/raw/gistfile1.txt

— Reply to this email directly or view it on GitHubhttps://github.com/zeromq/zbroker/issues/79#issuecomment-42591930 .

hintjens commented 10 years ago

Fixed in Zyre, as far as I can tell. Took a while to hunt down.

hintjens commented 10 years ago

Can we close this? I think it's fixed.

willkelly commented 10 years ago

Sorry, Pieter! We have been at the openstack summit and were unable to test. We'll test today.

hintjens commented 10 years ago

No problem. Any issues you hit, let me know... :-)

On Mon, May 19, 2014 at 5:08 PM, William Kelly notifications@github.comwrote:

Sorry, Pieter! We have been at the openstack summit and were unable to test. We'll test today.

— Reply to this email directly or view it on GitHubhttps://github.com/zeromq/zbroker/issues/79#issuecomment-43516129 .

rpedde commented 10 years ago

I'll close it, and make a new one if it comes back.