InternetHealthReport / internet-yellow-pages

A knowledge graph for Internet resources
GNU General Public License v3.0
39 stars 16 forks source link

Fix PCH crawler crashing #67

Closed m-appel closed 1 year ago

m-appel commented 1 year ago

The PCH crawler crashes due to some unexpected input in files containing incomplete output.

For example, the yyz collector seems to crash frequently (example), leaving an incomplete file with the last line:

*                 vtysh: error reading from bgpd: No such file or directory (2)Warning: closing connection to bgpd because of an I/O error!

The parsing mechanism needs to be more robust and catch this error.