search

weaveworks / weave

Simple, resilient multi-host containers networking and more.
https://www.weave.works
Apache License 2.0
6.62k stars 670 forks source link

cant connect 2 nodes with weave #2377

Closed joserivca closed 8 years ago

joserivca commented 8 years ago

Hi there, Im using latest version of weave on docker 1.9.1 and i cant connect 2 nodes (p by the regular way with weave launch . im open the ports in both servers p01 and p02

firewall-cmd --zone=public --add-port=6783/tcp --permanent firewall-cmd --zone=public --add-port=6784/tcp --permanent firewall-cmd --zone=public --add-port=6783/udp --permanent firewall-cmd --zone=public --add-port=6784/udp --permanent

im sending the wave logs for help [root@pmbrklnxp01 APMBPRO]# /database/weave/weave status Version: 1.4.6

    Service: router
   Protocol: weave 1..2
       Name: 26:36:82:5e:8b:ff(pmbrklnxp01)
 Encryption: disabled

PeerDiscovery: enabled Targets: 0 Connections: 0 Peers: 1 TrustedSubnets: none

    Service: ipam
     Status: idle
      Range: 10.32.0.0-10.47.255.255

DefaultSubnet: 10.32.0.0/12

    Service: dns
     Domain: weave.local.
   Upstream: 130.1.40.10, 131.1.20.41
        TTL: 1
    Entries: 0

    Service: proxy
    Address: unix:///var/run/weave/weave.sock

[root@pmbrklnxp01 APMBPRO]# docker logs weave INFO: 2016/06/15 19:27:07.283592 Command line options: map[ipalloc-range:10.32.0.0/12 name:26:36:82:5e:8b:ff nickna me:pmbrklnxp01 port:6783 datapath:datapath dns-effective-listen-address:172.17.0.1 dns-listen-address:172.17.0.1:53 http-addr:127.0.0.1:6784] INFO: 2016/06/15 19:27:07.283751 Command line peers: [] INFO: 2016/06/15 19:27:07.292179 Communication between peers is unencrypted. INFO: 2016/06/15 19:27:07.292752 Our name is 26:36:82:5e:8b:ff(pmbrklnxp01) INFO: 2016/06/15 19:27:07.423019 Docker API on unix:///var/run/docker.sock: &[KernelVersion=3.10.0-327.13.1.el7.x86 _64 PkgVersion=docker-common-1.9.1-40.el7.x86_64 Version=1.9.1 ApiVersion=1.21 GitCommit=ab77bde/1.9.1 GoVersion=go 1.4.2 Os=linux Arch=amd64] INFO: 2016/06/15 19:27:07.423081 Assuming quorum size of 1 INFO: 2016/06/15 19:27:07.423930 Listening for DNS queries on 172.17.0.1 INFO: 2016/06/15 19:27:07.423994 Sniffing traffic on datapath (via ODP) INFO: 2016/06/15 19:27:07.426686 Listening for HTTP control messages on 127.0.0.1:6784 INFO: 2016/06/15 19:27:08.064129 Discovered local MAC 5a:a4:16:55:55:93 INFO: 2016/06/15 19:27:08.094096 Discovered local MAC 26:36:82:5e:8b:ff INFO: 2016/06/15 19:27:08.675943 Discovered local MAC e2:76:c0:42:e1:ce INFO: 2016/06/15 19:31:05.756480 ->[10.80.128.187:52083] connection accepted INFO: 2016/06/15 19:31:05.758107 ->[10.80.128.187:52083|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection ready; using pr otocol version 2 INFO: 2016/06/15 19:31:05.758263 overlay_switch ->[de:9b:ea:48:ff:ac(pmbrklnxp02)] using fastdp INFO: 2016/06/15 19:31:05.758410 ->[10.80.128.187:52083|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection added (new peer ) ERRO: 2016/06/15 19:31:05.760015 ->[10.80.128.187:52083|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection shutting down d ue to error: clock skew of -21617 detected INFO: 2016/06/15 19:31:05.760101 ->[10.80.128.187:52083|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection deleted INFO: 2016/06/15 19:31:05.760131 Removed unreachable peer de:9b:ea:48:ff:ac(pmbrklnxp02) INFO: 2016/06/15 19:31:05.760162 [nameserver 26:36:82:5e:8b:ff] peer de:9b:ea:48:ff:ac gone INFO: 2016/06/15 19:31:07.779580 ->[10.80.128.187:52085] connection accepted INFO: 2016/06/15 19:31:07.781278 ->[10.80.128.187:52085|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection ready; using pr otocol version 2 INFO: 2016/06/15 19:31:07.781499 overlay_switch ->[de:9b:ea:48:ff:ac(pmbrklnxp02)] using fastdp INFO: 2016/06/15 19:31:07.781621 ->[10.80.128.187:52085|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection added (new peer ) ERRO: 2016/06/15 19:31:07.783981 ->[10.80.128.187:52085|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection shutting down d ue to error: clock skew of -21617 detected INFO: 2016/06/15 19:31:07.784104 ->[10.80.128.187:52085|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection deleted INFO: 2016/06/15 19:31:07.784125 Removed unreachable peer de:9b:ea:48:ff:ac(pmbrklnxp02) INFO: 2016/06/15 19:31:07.784141 [nameserver 26:36:82:5e:8b:ff] peer de:9b:ea:48:ff:ac gone INFO: 2016/06/15 19:31:10.936340 ->[10.80.128.187:52086] connection accepted INFO: 2016/06/15 19:31:10.937987 ->[10.80.128.187:52086|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection ready; using pr otocol version 2 INFO: 2016/06/15 19:31:10.938120 overlay_switch ->[de:9b:ea:48:ff:ac(pmbrklnxp02)] using fastdp INFO: 2016/06/15 19:31:10.938196 ->[10.80.128.187:52086|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection added (new peer ) INFO: 2016/06/15 19:31:10.940027 overlay_switch ->[de:9b:ea:48:ff:ac(pmbrklnxp02)] sleeve write tcp4 10.80.128.187: 52086: connection reset by peer ERRO: 2016/06/15 19:31:10.940166 ->[10.80.128.187:52086|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection shutting down d ue to error: clock skew of -21617 detected INFO: 2016/06/15 19:31:10.940234 ->[10.80.128.187:52086|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection deleted INFO: 2016/06/15 19:31:10.940273 Removed unreachable peer de:9b:ea:48:ff:ac(pmbrklnxp02) INFO: 2016/06/15 19:31:10.940298 [nameserver 26:36:82:5e:8b:ff] peer de:9b:ea:48:ff:ac gone INFO: 2016/06/15 19:31:14.716657 ->[10.80.128.187:52087] connection accepted INFO: 2016/06/15 19:31:14.718284 ->[10.80.128.187:52087|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection ready; using pr otocol version 2 INFO: 2016/06/15 19:31:14.718461 overlay_switch ->[de:9b:ea:48:ff:ac(pmbrklnxp02)] using fastdp INFO: 2016/06/15 19:31:14.718525 ->[10.80.128.187:52087|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection added (new peer ) ERRO: 2016/06/15 19:31:14.720654 ->[10.80.128.187:52087|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection shutting down d ue to error: clock skew of -21617 detected INFO: 2016/06/15 19:31:14.720800 ->[10.80.128.187:52087|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection deleted INFO: 2016/06/15 19:31:14.720835 Removed unreachable peer de:9b:ea:48:ff:ac(pmbrklnxp02) INFO: 2016/06/15 19:31:14.720860 [nameserver 26:36:82:5e:8b:ff] peer de:9b:ea:48:ff:ac gone INFO: 2016/06/15 19:31:22.215582 ->[10.80.128.187:52088] connection accepted INFO: 2016/06/15 19:31:22.217440 ->[10.80.128.187:52088|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection ready; using pr otocol version 2 INFO: 2016/06/15 19:31:22.217623 overlay_switch ->[de:9b:ea:48:ff:ac(pmbrklnxp02)] using fastdp INFO: 2016/06/15 19:31:22.217667 ->[10.80.128.187:52088|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection added (new peer ) INFO: 2016/06/15 19:31:22.220539 overlay_switch ->[de:9b:ea:48:ff:ac(pmbrklnxp02)] sleeve write tcp4 10.80.128.187: 52088: connection reset by peer ERRO: 2016/06/15 19:31:22.220850 ->[10.80.128.187:52088|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection shutting down d ue to error: clock skew of -21618 detected INFO: 2016/06/15 19:31:22.220930 ->[10.80.128.187:52088|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection deleted INFO: 2016/06/15 19:31:22.220958 Removed unreachable peer de:9b:ea:48:ff:ac(pmbrklnxp02) INFO: 2016/06/15 19:31:22.220980 [nameserver 26:36:82:5e:8b:ff] peer de:9b:ea:48:ff:ac gone INFO: 2016/06/15 19:31:27.894322 ->[10.80.128.187:52089] connection accepted INFO: 2016/06/15 19:31:27.896240 ->[10.80.128.187:52089|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection ready; using pr otocol version 2 INFO: 2016/06/15 19:31:27.896316 overlay_switch ->[de:9b:ea:48:ff:ac(pmbrklnxp02)] using fastdp INFO: 2016/06/15 19:31:27.896375 ->[10.80.128.187:52089|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection added (new peer ) ERRO: 2016/06/15 19:31:27.899090 ->[10.80.128.187:52089|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection shutting down d ue to error: clock skew of -21617 detected INFO: 2016/06/15 19:31:27.899218 ->[10.80.128.187:52089|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection deleted INFO: 2016/06/15 19:31:27.899245 Removed unreachable peer de:9b:ea:48:ff:ac(pmbrklnxp02) INFO: 2016/06/15 19:31:27.899261 [nameserver 26:36:82:5e:8b:ff] peer de:9b:ea:48:ff:ac gone INFO: 2016/06/15 19:31:37.085345 ->[10.80.128.187:52090] connection accepted INFO: 2016/06/15 19:31:37.087182 ->[10.80.128.187:52090|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection ready; using pr otocol version 2 INFO: 2016/06/15 19:31:37.087266 overlay_switch ->[de:9b:ea:48:ff:ac(pmbrklnxp02)] using fastdp INFO: 2016/06/15 19:31:37.087312 ->[10.80.128.187:52090|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection added (new peer ) ERRO: 2016/06/15 19:31:37.089621 ->[10.80.128.187:52090|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection shutting down d ue to error: clock skew of -21618 detected INFO: 2016/06/15 19:31:37.089690 ->[10.80.128.187:52090|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection deleted INFO: 2016/06/15 19:31:37.089723 Removed unreachable peer de:9b:ea:48:ff:ac(pmbrklnxp02) INFO: 2016/06/15 19:31:37.089740 [nameserver 26:36:82:5e:8b:ff] peer de:9b:ea:48:ff:ac gone INFO: 2016/06/15 19:32:10.738296 ->[10.80.128.187:52091] connection accepted INFO: 2016/06/15 19:32:10.740211 ->[10.80.128.187:52091|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection ready; using pr otocol version 2 INFO: 2016/06/15 19:32:10.740277 overlay_switch ->[de:9b:ea:48:ff:ac(pmbrklnxp02)] using fastdp INFO: 2016/06/15 19:32:10.740335 ->[10.80.128.187:52091|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection added (new peer ) ERRO: 2016/06/15 19:32:10.744356 ->[10.80.128.187:52091|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection shutting down d ue to error: clock skew of -21617 detected INFO: 2016/06/15 19:32:10.744429 ->[10.80.128.187:52091|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection deleted INFO: 2016/06/15 19:32:10.744455 Removed unreachable peer de:9b:ea:48:ff:ac(pmbrklnxp02) INFO: 2016/06/15 19:32:10.744475 [nameserver 26:36:82:5e:8b:ff] peer de:9b:ea:48:ff:ac gone INFO: 2016/06/15 19:32:10.744487 overlay_switch ->[de:9b:ea:48:ff:ac(pmbrklnxp02)] fastdp write tcp4 10.80.128.187: 52091: connection reset by peer INFO: 2016/06/15 19:32:10.744569 overlay_switch ->[de:9b:ea:48:ff:ac(pmbrklnxp02)] using sleeve INFO: 2016/06/15 19:32:46.264373 ->[10.80.128.187:52093] connection accepted INFO: 2016/06/15 19:32:46.266302 ->[10.80.128.187:52093|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection ready; using pr otocol version 2 INFO: 2016/06/15 19:32:46.266514 overlay_switch ->[de:9b:ea:48:ff:ac(pmbrklnxp02)] using fastdp INFO: 2016/06/15 19:32:46.266579 ->[10.80.128.187:52093|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection added (new peer ) ERRO: 2016/06/15 19:32:46.268719 ->[10.80.128.187:52093|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection shutting down d ue to error: clock skew of -21618 detected INFO: 2016/06/15 19:32:46.268877 ->[10.80.128.187:52093|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection deleted INFO: 2016/06/15 19:32:46.268912 Removed unreachable peer de:9b:ea:48:ff:ac(pmbrklnxp02) INFO: 2016/06/15 19:32:46.268947 [nameserver 26:36:82:5e:8b:ff] peer de:9b:ea:48:ff:ac gone INFO: 2016/06/15 19:33:45.478930 ->[10.80.128.187:52095] connection accepted INFO: 2016/06/15 19:33:45.480743 ->[10.80.128.187:52095|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection ready; using pr otocol version 2 INFO: 2016/06/15 19:33:45.480949 overlay_switch ->[de:9b:ea:48:ff:ac(pmbrklnxp02)] using fastdp INFO: 2016/06/15 19:33:45.481161 ->[10.80.128.187:52095|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection added (new peer ) ERRO: 2016/06/15 19:33:45.483628 ->[10.80.128.187:52095|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection shutting down d ue to error: clock skew of -21617 detected INFO: 2016/06/15 19:33:45.483754 ->[10.80.128.187:52095|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection deleted INFO: 2016/06/15 19:33:45.483813 Removed unreachable peer de:9b:ea:48:ff:ac(pmbrklnxp02) INFO: 2016/06/15 19:33:45.483837 [nameserver 26:36:82:5e:8b:ff] peer de:9b:ea:48:ff:ac gone INFO: 2016/06/15 19:34:42.430294 ->[10.80.128.187:52096] connection accepted INFO: 2016/06/15 19:34:42.432222 ->[10.80.128.187:52096|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection ready; using pr otocol version 2 INFO: 2016/06/15 19:34:42.432410 overlay_switch ->[de:9b:ea:48:ff:ac(pmbrklnxp02)] using fastdp INFO: 2016/06/15 19:34:42.432498 ->[10.80.128.187:52096|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection added (new peer ) ERRO: 2016/06/15 19:34:42.435004 ->[10.80.128.187:52096|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection shutting down d ue to error: clock skew of -21617 detected INFO: 2016/06/15 19:34:42.435072 ->[10.80.128.187:52096|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection deleted INFO: 2016/06/15 19:34:42.435230 Removed unreachable peer de:9b:ea:48:ff:ac(pmbrklnxp02) INFO: 2016/06/15 19:34:42.435256 [nameserver 26:36:82:5e:8b:ff] peer de:9b:ea:48:ff:ac gone INFO: 2016/06/15 19:36:44.816202 ->[10.80.128.187:52097] connection accepted INFO: 2016/06/15 19:36:44.817690 ->[10.80.128.187:52097|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection ready; using pr otocol version 2 INFO: 2016/06/15 19:36:44.817840 overlay_switch ->[de:9b:ea:48:ff:ac(pmbrklnxp02)] using fastdp INFO: 2016/06/15 19:36:44.817936 ->[10.80.128.187:52097|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection added (new peer ) ERRO: 2016/06/15 19:36:44.821154 ->[10.80.128.187:52097|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection shutting down d ue to error: clock skew of -21617 detected INFO: 2016/06/15 19:36:44.821227 ->[10.80.128.187:52097|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection deleted INFO: 2016/06/15 19:36:44.821248 Removed unreachable peer de:9b:ea:48:ff:ac(pmbrklnxp02) INFO: 2016/06/15 19:36:44.821264 [nameserver 26:36:82:5e:8b:ff] peer de:9b:ea:48:ff:ac gone INFO: 2016/06/15 19:38:07.311279 Expired MAC 5a:a4:16:55:55:93 at 26:36:82:5e:8b:ff(pmbrklnxp01) INFO: 2016/06/15 19:38:07.311341 Expired MAC 26:36:82:5e:8b:ff at 26:36:82:5e:8b:ff(pmbrklnxp01) INFO: 2016/06/15 19:38:07.311358 Expired MAC e2:76:c0:42:e1:ce at 26:36:82:5e:8b:ff(pmbrklnxp01) INFO: 2016/06/15 19:39:03.402348 ->[10.80.128.187:52098] connection accepted INFO: 2016/06/15 19:39:03.404082 ->[10.80.128.187:52098|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection ready; using pr otocol version 2 INFO: 2016/06/15 19:39:03.404167 overlay_switch ->[de:9b:ea:48:ff:ac(pmbrklnxp02)] using fastdp INFO: 2016/06/15 19:39:03.404256 ->[10.80.128.187:52098|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection added (new peer ) ERRO: 2016/06/15 19:39:03.406924 ->[10.80.128.187:52098|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection shutting down d ue to error: clock skew of -21617 detected INFO: 2016/06/15 19:39:03.407029 ->[10.80.128.187:52098|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection deleted INFO: 2016/06/15 19:39:03.407070 Removed unreachable peer de:9b:ea:48:ff:ac(pmbrklnxp02) INFO: 2016/06/15 19:39:03.407105 [nameserver 26:36:82:5e:8b:ff] peer de:9b:ea:48:ff:ac gone INFO: 2016/06/15 19:42:55.777869 ->[10.80.128.187:52099] connection accepted INFO: 2016/06/15 19:42:55.779475 ->[10.80.128.187:52099|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection ready; using pr otocol version 2 INFO: 2016/06/15 19:42:55.779604 overlay_switch ->[de:9b:ea:48:ff:ac(pmbrklnxp02)] using fastdp INFO: 2016/06/15 19:42:55.779722 ->[10.80.128.187:52099|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection added (new peer ) ERRO: 2016/06/15 19:42:55.782079 ->[10.80.128.187:52099|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection shutting down d ue to error: clock skew of -6h0m17.781991274s detected, ignoring update INFO: 2016/06/15 19:42:55.782463 ->[10.80.128.187:52099|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection deleted INFO: 2016/06/15 19:42:55.782521 Removed unreachable peer de:9b:ea:48:ff:ac(pmbrklnxp02) INFO: 2016/06/15 19:42:55.782547 [nameserver 26:36:82:5e:8b:ff] peer de:9b:ea:48:ff:ac gone INFO: 2016/06/15 19:47:25.439947 ->[10.80.128.187:52101] connection accepted INFO: 2016/06/15 19:47:25.441681 ->[10.80.128.187:52101|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection ready; using pr otocol version 2 INFO: 2016/06/15 19:47:25.441764 overlay_switch ->[de:9b:ea:48:ff:ac(pmbrklnxp02)] using fastdp INFO: 2016/06/15 19:47:25.441944 ->[10.80.128.187:52101|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection added (new peer ) ERRO: 2016/06/15 19:47:25.444445 ->[10.80.128.187:52101|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection shutting down d ue to error: clock skew of -21617 detected INFO: 2016/06/15 19:47:25.444643 ->[10.80.128.187:52101|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection deleted INFO: 2016/06/15 19:47:25.444693 Removed unreachable peer de:9b:ea:48:ff:ac(pmbrklnxp02) INFO: 2016/06/15 19:47:25.444742 [nameserver 26:36:82:5e:8b:ff] peer de:9b:ea:48:ff:ac gone INFO: 2016/06/15 19:50:36.431201 ->[10.80.128.187:52102] connection accepted INFO: 2016/06/15 19:50:36.432703 ->[10.80.128.187:52102|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection ready; using pr otocol version 2 INFO: 2016/06/15 19:50:36.432915 overlay_switch ->[de:9b:ea:48:ff:ac(pmbrklnxp02)] using fastdp INFO: 2016/06/15 19:50:36.433013 ->[10.80.128.187:52102|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection added (new peer ) ERRO: 2016/06/15 19:50:36.434676 ->[10.80.128.187:52102|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection shutting down d ue to error: clock skew of -21617 detected INFO: 2016/06/15 19:50:36.434760 ->[10.80.128.187:52102|de:9b:ea:48:ff:ac(pmbrklnxp02)]: connection deleted INFO: 2016/06/15 19:50:36.434847 Removed unreachable peer de:9b:ea:48:ff:ac(pmbrklnxp02) INFO: 2016/06/15 19:50:36.434870 [nameserver 26:36:82:5e:8b:ff] peer de:9b:ea:48:ff:ac gone

[root@pmbrklnxp02 APMBPRO]# /database/weave/weave status Usage of loopback devices is strongly discouraged for production use. Either use --storage-opt dm.thinpooldev or use --storage-opt dm.no_warn_on_loop_devices=true to suppress this warning.

    Version: 1.4.6

    Service: router
   Protocol: weave 1..2
       Name: de:9b:ea:48:ff:ac(p02)
 Encryption: disabled

PeerDiscovery: enabled Targets: 1 Connections: 1 (1 failed) Peers: 1 TrustedSubnets: none

    Service: ipam
     Status: idle
      Range: 10.32.0.0-10.47.255.255

DefaultSubnet: 10.32.0.0/12

    Service: dns
     Domain: weave.local.
   Upstream: 130.1.40.10, 131.1.20.41
        TTL: 1
    Entries: 0

    Service: proxy
    Address: unix:///var/run/weave/weave.sock

[root@pmbrklnxp02 APMBPRO]# docker logs weave INFO: 2016/06/15 13:30:48.334740 Command line options: map[name:de:9b:ea:48:ff:ac nickname:pmbrklnxp 02 port:6783 datapath:datapath dns-effective-listen-address:172.17.0.1 dns-listen-address:172.17.0.1 :53 http-addr:127.0.0.1:6784 ipalloc-range:10.32.0.0/12] INFO: 2016/06/15 13:30:48.334860 Command line peers: [10.80.192.27] INFO: 2016/06/15 13:30:48.350679 Communication between peers is unencrypted. INFO: 2016/06/15 13:30:48.351184 Our name is de:9b:ea:48:ff:ac(pmbrklnxp02) INFO: 2016/06/15 13:30:48.438353 Docker API on unix:///var/run/docker.sock: &[PkgVersion=docker-comm on-1.9.1-40.el7.x86_64 Version=1.9.1 ApiVersion=1.21 GitCommit=ab77bde/1.9.1 GoVersion=go1.4.2 Os=li nux Arch=amd64 KernelVersion=3.10.0-327.13.1.el7.x86_64] INFO: 2016/06/15 13:30:48.438408 Assuming quorum size of 2 INFO: 2016/06/15 13:30:48.438895 Listening for DNS queries on 172.17.0.1 INFO: 2016/06/15 13:30:48.438936 Sniffing traffic on datapath (via ODP) INFO: 2016/06/15 13:30:48.439188 ->[10.80.192.27:6783] attempting connection INFO: 2016/06/15 13:30:48.440616 Listening for HTTP control messages on 127.0.0.1:6784 INFO: 2016/06/15 13:30:48.442937 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection re ady; using protocol version 2 INFO: 2016/06/15 13:30:48.443026 overlay_switch ->[26:36:82:5e:8b:ff(pmbrklnxp01)] using fastdp INFO: 2016/06/15 13:30:48.443107 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection ad ded (new peer) ERRO: 2016/06/15 13:30:48.444716 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection shutting down due to error: clock skew of 21617 detected INFO: 2016/06/15 13:30:48.445077 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection deleted INFO: 2016/06/15 13:30:48.445104 Removed unreachable peer 26:36:82:5e:8b:ff(pmbrklnxp01) INFO: 2016/06/15 13:30:48.445121 [nameserver de:9b:ea:48:ff:ac] peer 26:36:82:5e:8b:ff gone INFO: 2016/06/15 13:30:49.080625 Discovered local MAC de:9b:ea:48:ff:ac INFO: 2016/06/15 13:30:49.216273 Discovered local MAC 1e:c0:03:08:d2:61 INFO: 2016/06/15 13:30:49.475507 Discovered local MAC b6:4d:18:22:2d:73 INFO: 2016/06/15 13:30:50.462365 ->[10.80.192.27:6783] attempting connection INFO: 2016/06/15 13:30:50.466644 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection re ady; using protocol version 2 INFO: 2016/06/15 13:30:50.466714 overlay_switch ->[26:36:82:5e:8b:ff(pmbrklnxp01)] using fastdp INFO: 2016/06/15 13:30:50.466752 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection ad ded (new peer) ERRO: 2016/06/15 13:30:50.467691 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection sh utting down due to error: clock skew of 21617 detected INFO: 2016/06/15 13:30:50.467753 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection de leted INFO: 2016/06/15 13:30:50.467782 Removed unreachable peer 26:36:82:5e:8b:ff(pmbrklnxp01) INFO: 2016/06/15 13:30:50.467798 [nameserver de:9b:ea:48:ff:ac] peer 26:36:82:5e:8b:ff gone INFO: 2016/06/15 13:30:53.619118 ->[10.80.192.27:6783] attempting connection INFO: 2016/06/15 13:30:53.623072 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection re ady; using protocol version 2 INFO: 2016/06/15 13:30:53.623153 overlay_switch ->[26:36:82:5e:8b:ff(pmbrklnxp01)] using fastdp INFO: 2016/06/15 13:30:53.623214 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection ad ded (new peer) ERRO: 2016/06/15 13:30:53.623941 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection sh utting down due to error: clock skew of 21617 detected INFO: 2016/06/15 13:30:53.624022 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection de leted INFO: 2016/06/15 13:30:53.624044 Removed unreachable peer 26:36:82:5e:8b:ff(pmbrklnxp01) INFO: 2016/06/15 13:30:53.624058 [nameserver de:9b:ea:48:ff:ac] peer 26:36:82:5e:8b:ff gone INFO: 2016/06/15 13:30:57.399323 ->[10.80.192.27:6783] attempting connection INFO: 2016/06/15 13:30:57.403269 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection re ady; using protocol version 2 INFO: 2016/06/15 13:30:57.403363 overlay_switch ->[26:36:82:5e:8b:ff(pmbrklnxp01)] using fastdp INFO: 2016/06/15 13:30:57.403443 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection ad ded (new peer) ERRO: 2016/06/15 13:30:57.404334 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection sh utting down due to error: clock skew of 21617 detected INFO: 2016/06/15 13:30:57.404439 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection de leted INFO: 2016/06/15 13:30:57.404472 Removed unreachable peer 26:36:82:5e:8b:ff(pmbrklnxp01) INFO: 2016/06/15 13:30:57.404489 [nameserver de:9b:ea:48:ff:ac] peer 26:36:82:5e:8b:ff gone INFO: 2016/06/15 13:31:04.898248 ->[10.80.192.27:6783] attempting connection INFO: 2016/06/15 13:31:04.902671 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection re ady; using protocol version 2 INFO: 2016/06/15 13:31:04.902952 overlay_switch ->[26:36:82:5e:8b:ff(pmbrklnxp01)] using fastdp INFO: 2016/06/15 13:31:04.903053 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection ad ded (new peer) ERRO: 2016/06/15 13:31:04.904608 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection sh utting down due to error: clock skew of 21618 detected INFO: 2016/06/15 13:31:04.904757 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection de leted INFO: 2016/06/15 13:31:04.904797 Removed unreachable peer 26:36:82:5e:8b:ff(pmbrklnxp01) INFO: 2016/06/15 13:31:04.904825 [nameserver de:9b:ea:48:ff:ac] peer 26:36:82:5e:8b:ff gone INFO: 2016/06/15 13:31:10.577111 ->[10.80.192.27:6783] attempting connection INFO: 2016/06/15 13:31:10.582567 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection re ady; using protocol version 2 INFO: 2016/06/15 13:31:10.582701 overlay_switch ->[26:36:82:5e:8b:ff(pmbrklnxp01)] using fastdp INFO: 2016/06/15 13:31:10.582801 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection ad ded (new peer) INFO: 2016/06/15 13:31:10.584695 overlay_switch ->[26:36:82:5e:8b:ff(pmbrklnxp01)] sleeve write tcp4 10.80.192.27:6783: connection reset by peer ERRO: 2016/06/15 13:31:10.584778 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection sh utting down due to error: clock skew of 21617 detected INFO: 2016/06/15 13:31:10.584877 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection de leted INFO: 2016/06/15 13:31:10.584915 Removed unreachable peer 26:36:82:5e:8b:ff(pmbrklnxp01) INFO: 2016/06/15 13:31:10.584961 [nameserver de:9b:ea:48:ff:ac] peer 26:36:82:5e:8b:ff gone INFO: 2016/06/15 13:31:19.768132 ->[10.80.192.27:6783] attempting connection INFO: 2016/06/15 13:31:19.772641 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection re ady; using protocol version 2 INFO: 2016/06/15 13:31:19.772946 overlay_switch ->[26:36:82:5e:8b:ff(pmbrklnxp01)] using fastdp INFO: 2016/06/15 13:31:19.773083 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection ad ded (new peer) ERRO: 2016/06/15 13:31:19.774894 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection sh utting down due to error: clock skew of 21618 detected INFO: 2016/06/15 13:31:19.775088 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection de leted INFO: 2016/06/15 13:31:19.775135 Removed unreachable peer 26:36:82:5e:8b:ff(pmbrklnxp01) INFO: 2016/06/15 13:31:19.775164 [nameserver de:9b:ea:48:ff:ac] peer 26:36:82:5e:8b:ff gone INFO: 2016/06/15 13:31:53.421091 ->[10.80.192.27:6783] attempting connection INFO: 2016/06/15 13:31:53.427229 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection re ady; using protocol version 2 INFO: 2016/06/15 13:31:53.427372 overlay_switch ->[26:36:82:5e:8b:ff(pmbrklnxp01)] using fastdp INFO: 2016/06/15 13:31:53.427568 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection ad ded (new peer) ERRO: 2016/06/15 13:31:53.428587 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection sh utting down due to error: clock skew of 21617 detected INFO: 2016/06/15 13:31:53.428826 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection de leted INFO: 2016/06/15 13:31:53.428868 Removed unreachable peer 26:36:82:5e:8b:ff(pmbrklnxp01) INFO: 2016/06/15 13:31:53.428915 [nameserver de:9b:ea:48:ff:ac] peer 26:36:82:5e:8b:ff gone INFO: 2016/06/15 13:32:28.947598 ->[10.80.192.27:6783] attempting connection INFO: 2016/06/15 13:32:28.952220 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection re ady; using protocol version 2 INFO: 2016/06/15 13:32:28.952335 overlay_switch ->[26:36:82:5e:8b:ff(pmbrklnxp01)] using fastdp INFO: 2016/06/15 13:32:28.952479 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection ad ded (new peer) ERRO: 2016/06/15 13:32:28.954116 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection sh utting down due to error: clock skew of 21618 detected INFO: 2016/06/15 13:32:28.954181 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection de leted INFO: 2016/06/15 13:32:28.954216 Removed unreachable peer 26:36:82:5e:8b:ff(pmbrklnxp01) INFO: 2016/06/15 13:32:28.954244 [nameserver de:9b:ea:48:ff:ac] peer 26:36:82:5e:8b:ff gone INFO: 2016/06/15 13:33:28.162655 ->[10.80.192.27:6783] attempting connection INFO: 2016/06/15 13:33:28.167042 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection re ady; using protocol version 2 INFO: 2016/06/15 13:33:28.167187 overlay_switch ->[26:36:82:5e:8b:ff(pmbrklnxp01)] using fastdp INFO: 2016/06/15 13:33:28.167331 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection ad ded (new peer) ERRO: 2016/06/15 13:33:28.169125 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection sh utting down due to error: clock skew of 21617 detected INFO: 2016/06/15 13:33:28.169302 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection de leted INFO: 2016/06/15 13:33:28.169466 Removed unreachable peer 26:36:82:5e:8b:ff(pmbrklnxp01) INFO: 2016/06/15 13:33:28.169547 [nameserver de:9b:ea:48:ff:ac] peer 26:36:82:5e:8b:ff gone INFO: 2016/06/15 13:34:25.114394 ->[10.80.192.27:6783] attempting connection INFO: 2016/06/15 13:34:25.119917 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection re ady; using protocol version 2 INFO: 2016/06/15 13:34:25.120168 overlay_switch ->[26:36:82:5e:8b:ff(pmbrklnxp01)] using fastdp INFO: 2016/06/15 13:34:25.120275 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection ad ded (new peer) ERRO: 2016/06/15 13:34:25.122218 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection sh utting down due to error: clock skew of 21617 detected INFO: 2016/06/15 13:34:25.122337 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection de leted INFO: 2016/06/15 13:34:25.122436 Removed unreachable peer 26:36:82:5e:8b:ff(pmbrklnxp01) INFO: 2016/06/15 13:34:25.122473 [nameserver de:9b:ea:48:ff:ac] peer 26:36:82:5e:8b:ff gone INFO: 2016/06/15 13:36:27.501705 ->[10.80.192.27:6783] attempting connection INFO: 2016/06/15 13:36:27.505958 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection re ady; using protocol version 2 INFO: 2016/06/15 13:36:27.506088 overlay_switch ->[26:36:82:5e:8b:ff(pmbrklnxp01)] using fastdp INFO: 2016/06/15 13:36:27.506262 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection ad ded (new peer) ERRO: 2016/06/15 13:36:27.508207 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection sh utting down due to error: clock skew of 21617 detected INFO: 2016/06/15 13:36:27.508355 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection de leted INFO: 2016/06/15 13:36:27.508494 Removed unreachable peer 26:36:82:5e:8b:ff(pmbrklnxp01) INFO: 2016/06/15 13:36:27.508531 [nameserver de:9b:ea:48:ff:ac] peer 26:36:82:5e:8b:ff gone INFO: 2016/06/15 13:38:46.088824 ->[10.80.192.27:6783] attempting connection INFO: 2016/06/15 13:38:46.093472 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection re ady; using protocol version 2 INFO: 2016/06/15 13:38:46.093610 overlay_switch ->[26:36:82:5e:8b:ff(pmbrklnxp01)] using fastdp INFO: 2016/06/15 13:38:46.093772 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection ad ded (new peer) ERRO: 2016/06/15 13:38:46.095512 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection sh utting down due to error: clock skew of 21617 detected INFO: 2016/06/15 13:38:46.095653 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection de leted INFO: 2016/06/15 13:38:46.095694 Removed unreachable peer 26:36:82:5e:8b:ff(pmbrklnxp01) INFO: 2016/06/15 13:38:46.095723 [nameserver de:9b:ea:48:ff:ac] peer 26:36:82:5e:8b:ff gone INFO: 2016/06/15 13:41:48.353363 Expired MAC de:9b:ea:48:ff:ac at de:9b:ea:48:ff:ac(pmbrklnxp02) INFO: 2016/06/15 13:41:48.354117 Expired MAC 1e:c0:03:08:d2:61 at de:9b:ea:48:ff:ac(pmbrklnxp02) INFO: 2016/06/15 13:41:48.354154 Expired MAC b6:4d:18:22:2d:73 at de:9b:ea:48:ff:ac(pmbrklnxp02) INFO: 2016/06/15 13:42:38.464653 ->[10.80.192.27:6783] attempting connection INFO: 2016/06/15 13:42:38.470440 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection re ady; using protocol version 2 INFO: 2016/06/15 13:42:38.470605 overlay_switch ->[26:36:82:5e:8b:ff(pmbrklnxp01)] using fastdp INFO: 2016/06/15 13:42:38.470874 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection ad ded (new peer) ERRO: 2016/06/15 13:42:38.472862 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection sh utting down due to error: clock skew of 21617 detected INFO: 2016/06/15 13:42:38.473517 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection de leted INFO: 2016/06/15 13:42:38.473568 Removed unreachable peer 26:36:82:5e:8b:ff(pmbrklnxp01) INFO: 2016/06/15 13:42:38.473598 [nameserver de:9b:ea:48:ff:ac] peer 26:36:82:5e:8b:ff gone

rade commented 8 years ago

Notice there is only kind of error in the logs:

ERRO: 2016/06/15 13:30:48.444716 ->[10.80.192.27:6783|26:36:82:5e:8b:ff(pmbrklnxp01)]: connection shutting down due to error: clock skew of 21617 detected

That's your problem - the two machines' clocks are too far adrift.

(as an aside; weave status connections would also have shown that error)

joserivca commented 8 years ago

OK, but i dont understand the error, its in my virtual machines, what i can do? i working with two vmware machine now Thanks a lot Regards Jose!

rade commented 8 years ago

There's usually a way to synchronise VM clocks to host clocks. Google should have some answers.

joserivca commented 8 years ago

thanks a lot rade! , i synchronize the ntp service and now works!