dragonresearch / rpki.net

Dragon Research Labs rpki.net RPKI toolkit
54 stars 26 forks source link

ca0 rsyncd errors from sunfire.cbbtier3.att.net #425

Closed sraustein closed 11 years ago

sraustein commented 11 years ago

i have been logging this stuff daily

Feb 12 19:49:42 ca0 rsyncd[60341]: rsync: connection unexpectedly closed (0 bytes received so far) [Receiver] Feb 12 19:49:42 ca0 rsyncd[60341]: rsync error: error in rsync protocol data stream (code 12) at io.c(605) [Receiver=3.0.9] Feb 12 19:49:42 ca0 rsyncd[60342]: rsync: connection unexpectedly closed (0 bytes received so far) [Receiver] Feb 12 19:49:42 ca0 rsyncd[60342]: rsync error: error in rsync protocol data stream (code 12) at io.c(605) [Receiver=3.0.9]

so i started a tcpdump to catch it

19:49:41.814276 IP sunfire.cbbtier3.att.net.44477 > ca0.rpki.net.rsync: Flags [S], seq 3926846490, win 14600, options [mss 1460,sackOK,TS val 172765733 ecr 0,nop,wscale 4], length 0 19:49:41.814325 IP ca0.rpki.net.rsync > sunfire.cbbtier3.att.net.44477: Flags [S.], seq 3875036392, ack 3926846491, win 65535, options [mss 1460,nop,wscale 6,sackOK,TS val 2074311188 ecr 172765733], length 0 19:49:41.886896 IP sunfire.cbbtier3.att.net.44477 > ca0.rpki.net.rsync: Flags [.], ack 1, win 913, options [nop,nop,TS val 172765751 ecr 2074311188], length 0 19:49:41.887366 IP sunfire.cbbtier3.att.net.44477 > ca0.rpki.net.rsync: Flags [F.], seq 1, ack 1, win 913, options [nop,nop,TS val 172765751 ecr 2074311188], length 0 19:49:41.887382 IP ca0.rpki.net.rsync > sunfire.cbbtier3.att.net.44477: Flags [.], ack 2, win 1040, options [nop,nop,TS val 2074311254 ecr 172765751], length 0 19:49:41.894446 IP6 2001:1890:111d:1::223f.56369 > ca0.rpki.net.rsync: Flags [S], seq 4187975661, win 14400, options [mss 1440,sackOK,TS val 172765751 ecr 0,nop,wscale 4], length 0 19:49:41.894495 IP6 ca0.rpki.net.rsync > 2001:1890:111d:1::223f.56369: Flags [R.], seq 0, ack 4187975662, win 0, length 0 19:49:42.090834 IP ca0.rpki.net.rsync > sunfire.cbbtier3.att.net.44477: Flags [P.], seq 1:15, ack 2, win 1040, options [nop,nop,TS val 2074311465 ecr 172765751], length 14 19:49:42.091052 IP ca0.rpki.net.rsync > sunfire.cbbtier3.att.net.44477: Flags [F.], seq 15, ack 2, win 1040, options [nop,nop,TS val 2074311465 ecr 172765751], length 0 19:49:42.163613 IP sunfire.cbbtier3.att.net.44477 > ca0.rpki.net.rsync: Flags [R], seq 3926846492, win 0, length 0 19:49:42.163985 IP sunfire.cbbtier3.att.net.44477 > ca0.rpki.net.rsync: Flags [R], seq 3926846492, win 0, length 0 19:49:42.832303 IP sunfire.cbbtier3.att.net.44484 > ca0.rpki.net.rsync: Flags [S], seq 962318547, win 14600, options [mss 1460,sackOK,TS val 172765986 ecr 0,nop,wscale 4], length 0 19:49:42.832345 IP ca0.rpki.net.rsync > sunfire.cbbtier3.att.net.44484: Flags [S.], seq 1996520043, ack 962318548, win 65535, options [mss 1460,nop,wscale 6,sackOK,TS val 1431372761 ecr 172765986], length 0 19:49:42.911295 IP sunfire.cbbtier3.att.net.44484 > ca0.rpki.net.rsync: Flags [.], ack 1, win 913, options [nop,nop,TS val 172766006 ecr 1431372761], length 0 19:49:42.911330 IP sunfire.cbbtier3.att.net.44484 > ca0.rpki.net.rsync: Flags [F.], seq 1, ack 1, win 913, options [nop,nop,TS val 172766006 ecr 1431372761], length 0 19:49:42.911347 IP ca0.rpki.net.rsync > sunfire.cbbtier3.att.net.44484: Flags [.], ack 2, win 1040, options [nop,nop,TS val 1431372840 ecr 172766006], length 0 19:49:42.912529 IP6 2001:1890:111d:1::223f.56376 > ca0.rpki.net.rsync: Flags [S], seq 754873706, win 14400, options [mss 1440,sackOK,TS val 172766006 ecr 0,nop,wscale 4], length 0 19:49:42.912553 IP6 ca0.rpki.net.rsync > 2001:1890:111d:1::223f.56376: Flags [R.], seq 0, ack 754873707, win 0, length 0 19:49:42.914754 IP ca0.rpki.net.rsync > sunfire.cbbtier3.att.net.44484: Flags [P.], seq 1:15, ack 2, win 1040, options [nop,nop,TS val 1431372840 ecr 172766006], length 14 19:49:42.914951 IP ca0.rpki.net.rsync > sunfire.cbbtier3.att.net.44484: Flags [F.], seq 15, ack 2, win 1040, options [nop,nop,TS val 1431372840 ecr 172766006], length 0 19:49:42.994103 IP sunfire.cbbtier3.att.net.44484 > ca0.rpki.net.rsync: Flags [R], seq 962318549, win 0, length 0 19:49:42.994120 IP sunfire.cbbtier3.att.net.44484 > ca0.rpki.net.rsync: Flags [R], seq 962318549, win 0, length 0

Trac ticket #410 component rcynic priority minor, owner sra, created by randy on 2013-02-17T08:31:35Z, last modified 2013-02-19T13:10:58Z

sraustein commented 11 years ago

Interesting. sunfire's primary IPv6 address is 2001:1890:111d:1::223/64, but it has a number of others including 2001:1890:111d:1::223f/64. Nothing in my (meager) local configuration of the RIPE RPKI Validator specifies which local address to use. It appears the RIPE software is being inconsistent in its choice of source IPv6 addresses, and that confuses its partners.

Please let me know if there is anything you'd like me to gather from my end, or if you'd like me to contact the RIPE blokes to report this. Or feel free to contact them directly and CC me.

Trac comment by jayb on 2013-02-17T16:18:17Z

sraustein commented 11 years ago

As a test to see if having a choice of IPv6 addresses on this Ubuntu server "sunfire" is related to the rsync resets, I have removed all global scope IPv6 interface addresses except 2001:1890:111d:1::223/64 by this time:

Sun Feb 17 17:20:00 UTC 2013

I intend to run the server in this configuration until further notice.

Trac comment by jayb on 2013-02-17T17:22:19Z

sraustein commented 11 years ago

i'll watch this end

randy

Trac comment by randy on 2013-02-17T18:18:46Z

sraustein commented 11 years ago

i recommend ticketing this one at the ncc

Trac comment by randy on 2013-02-17T18:32:09Z

sraustein commented 11 years ago

looks to be fixed

Trac comment by randy on 2013-02-19T13:10:58Z

sraustein commented 11 years ago

Closed with resolution fixed