search

magneticio / vamp

Vamp - canary releasing and autoscaling for microservice systems
http://vamp.io
Apache License 2.0
625 stars 55 forks source link

VGA port crash #1120

Closed bench87 closed 6 years ago

bench87 commented 6 years ago

I have 6 vamp gateway agent with sf reload option, when I deployed new service, a vga raise error It happens stochastically and randomly

Server o_4973ff6681fd2001c63198a5ab0092f16aa78152/2963cce8267a884a1f8cd24fbae3e8cdf7c58dfc is DOWN, reason: Socket error, info: "General socket error (Connection refused)", check duration: 0ms. 0 active and 0 backup servers le
ft. 0 sessions active, 0 requeued, 0 remaining in queue.
 Server o_4973ff6681fd2001c63198a5ab0092f16aa78152/a83be2f2b35f6c60ba12bf416d308e95c468b605 is DOWN, reason: Socket error, info: "General socket error (Connection refused)", check duration: 0ms. 0 active and 0 backup servers le
ft. 0 sessions active, 0 requeued, 0 remaining in queue.
 {"ci":"127.0.0.1","cp":56302,"t":"23/Apr/2018:13:14:00.873","ft":"75c2f20f3ef91992c94af238175ffd36e3d0a978","b":"o_75c2f20f3ef91992c94af238175ffd36e3d0a978","s":"875b09d16acfa8f47615badb49a79adaa1bc258e","Tl":"23/Apr/2018:13:1
4:00 +0900","Tw":0,"Tc":-1,"Tr":-1,"Tt":0,"ST":503,"r":"GET /api/v1/online-account/opening/list/user/7805197 HTTP/1.1", "HM":"GET", "HP":"/api/v1/online-account/opening/list/user/7805197", "value":1}
 192.168.101.19:9467 [23/Apr/2018:13:14:00.873] virtual_hosts 75c2f20f3ef91992c94af238175ffd36e3d0a978/75c2f20f3ef91992c94af238175ffd36e3d0a978 0/0/0 212 -- 1/0/0/0/0 0/0
 Server im_27ae9afaaf3d425c16c8ab4e7a43384008f9663/27ae9afaaf3d425c16c8ab4e7a43384008f9663 is DOWN, reason: Socket error, info: "General socket error (Connection refused)", check duration: 0ms. 0 active and 0 backup servers lef
t. 0 sessions active, 0 requeued, 0 remaining in queue.
 backend im_27ae9afaaf3d425c16c8ab4e7a43384008f9663 has no server available!
 {"ci":"127.0.0.1","cp":57014,"t":"23/Apr/2018:13:14:00.897","ft":"3e80c8e64ef4638cac8e4f86fdbba64fb4286044","b":"o_3e80c8e64ef4638cac8e4f86fdbba64fb4286044","s":"2d0098ef6349635988e83e20bba4afdc10e1b12e","Tl":"23/Apr/2018:13:1
4:00 +0900","Tw":0,"Tc":-1,"Tr":-1,"Tt":0,"ST":503,"r":"GET /credit/api/overviews/latest HTTP/1.1", "HM":"GET", "HP":"/credit/api/overviews/latest", "value":1}
 192.168.101.20:47479 [23/Apr/2018:13:14:00.896] virtual_hosts 3e80c8e64ef4638cac8e4f86fdbba64fb4286044/3e80c8e64ef4638cac8e4f86fdbba64fb4286044 0/0/0 212 -- 1/0/0/0/0 0/0
 Server im_db19592a5b0c7bfe3e945672b97b2846305aba4c/o_99290e8d534c9bedb886034d266090a1b41dc03a is DOWN, reason: Socket error, info: "General socket error (Connection refused)", check duration: 0ms. 1 active and 0 backup servers
 left. 0 sessions active, 0 requeued, 0 remaining in queue.
 Server o_56991d7fc9292010d89b1400f08aee3a7a354f0f/d92a8a49342d059239df39009fdfe6db973e7a9e is DOWN, reason: Socket error, info: "General socket error (Connection refused)", check duration: 0ms. 0 active and 0 backup servers le
ft. 0 sessions active, 0 requeued, 0 remaining in queue.
 backend o_56991d7fc9292010d89b1400f08aee3a7a354f0f has no server available!
 Server im_97d0f709e194aff5ba2e75139831b9968fe7b2b3/97d0f709e194aff5ba2e75139831b9968fe7b2b3 is DOWN, reason: Socket error, info: "General socket error (Connection refused)", check duration: 0ms. 0 active and 0 backup servers l
eft. 0 sessions active, 0 requeued, 0 remaining in queue.
 backend im_97d0f709e194aff5ba2e75139831b9968fe7b2b3 has no server available!
 Server o_99290e8d534c9bedb886034d266090a1b41dc03a/db19592a5b0c7bfe3e945672b97b2846305aba4c is DOWN, reason: Socket error, info: "General socket error (Connection refused)", check duration: 0ms. 0 active and 0 backup servers le
ft. 0 sessions active, 0 requeued, 0 remaining in queue.
 Server o_a4859849b06488149668371b06b401702806630/a547945b1d20f125c76afef4bc14ffaa9ba4393e is DOWN, reason: Socket error, info: "General socket error (Connection refused)", check duration: 0ms. 0 active and 0 backup servers lef
t. 0 sessions active, 0 requeued, 0 remaining in queue.
 backend o_a4859849b06488149668371b06b401702806630 has no server available!
 Server o_8cc2bafcdcaec4c51deb6e89bf4c94c3c766621b/701e07c8fe6fbbcb067489d0de4797662353d2bb is DOWN, reason: Socket error, info: "General socket error (Connection refused)", check duration: 0ms. 0 active and 0 backup servers le
ft. 0 sessions active, 0 requeued, 0 remaining in queue.
 Server o_c80ffa5d55573f159109a06107aeea9fab697a09/1717a372ba2db43eefcdda247e550cb7c3f956cf is DOWN, reason: Socket error, info: "General socket error (Connection refused)", check duration: 0ms. 0 active and 0 backup servers le
ft. 0 sessions active, 0 requeued, 0 remaining in queue.
 backend o_c80ffa5d55573f159109a06107aeea9fab697a09 has no server available!
 Server im_759319885719289e230277d0e2c6da8421f8a002/o_99290e8d534c9bedb886034d266090a1b41dc03a is DOWN, reason: Socket error, info: "General socket error (Connection refused)", check duration: 0ms. 1 active and 0 backup servers
 left. 0 sessions active, 0 requeued, 0 remaining in queue.
 Server o_a77849dc4d09faadb524e47639f704964cfe55c0/9ba30131e08066dc11db02250a4d6d77ae902acb is DOWN, reason: Socket error, info: "General socket error (Connection refused)", check duration: 0ms. 1 active and 0 backup servers le
ft. 0 sessions active, 0 requeued, 0 remaining in queue.
bench87 commented 6 years ago

It port crash

  1. run python -m SimpleHTTPServer 12702 on vamp gateway agent machine

  2. deploy gateway

    
kind: gateway
metadata: {}
lookup_name: 46ef250948e5a56fb82e0dad85053935daae811b
internal: false
service:
host: 172.17.0.1
port: 12702/tcp
deployed: true
port: 12702/tcp
sticky: null
virtual_hosts:
- 12702.telegram.vamp
routes:
telegram/staging/samsungport:
lookup_name: 8d6c8bdbc6908cc9c9051e737d120e02618b9e5e
weight: 100%
balance: default
condition: null
condition_strength: 0%
rewrites: []```

  3. reload vamp gateway 2times

olafmol commented 6 years ago

Closing this. If still a problem please re-open @bench87