search

CAIDA / bgpstream

BGP measurement analysis for the masses
GNU General Public License v2.0
109 stars 43 forks source link

BGPreader: [warn] process_one_attr failed, stopping attribute processing #79

Open MarcinNaw opened 5 years ago

MarcinNaw commented 5 years ago

Creating a textual dump of recent RIPE RIS bview files fails with:

$ bgpreader -d singlefile -o rib-file,latest-bview.gz > /dev/null 
WARN: No time windows specified, defaulting to all available data
2019-01-07 16:51:43 [warn] ERROR attribute is truncated: expected=10286 remaining=4184

2019-01-07 16:51:43 [warn] process_one_attr failed, stopping attribute processing

I receive this message after a partial output (~1.2M lines) using the latest BGPreader version (1.2.1).

An older version of BGPreader (1.1.0) is also affected.

$ ./bgpreader -d singlefile -o rib-file,/tmp/latest-bview.gz -w 0,-2 > /dev/null
2019-01-07 16:35:38 [warn] ERROR attribute is truncated: expected=10286 remaining=4184

bgpreader: bgpdump_lib.c:888: process_one_attr: Assertion `-1 == attr->local_pref' failed.
Aborted

Unfortunately, we could not get more information by activating debug output.

This file works: http://data.ris.ripe.net/rrc00/2018.09/bview.20180909.0800.gz This file does not work: http://data.ris.ripe.net/rrc00/2019.01/bview.20190107.0800.gz

alistairking commented 5 years ago

I am pretty sure this is a bug in the library (libbgpdump) we use to parse MRT data. I believe it has been fixed in the upstream library, but since BGPStream v2 no longer uses this library, we have not yet backported the fix. My understanding is that this bug only affects RRC00 -- is that your experience too?

I'd suggest that you might want to try the BGPStream v2 beta (http://bgpstream.caida.org/v2-beta). If switching to v2 is not possible, please let me know and we can try and find some time to backport a fix.