zmap / zannotate

Utility for annotating Internet datasets with contextual metadata (e.g., origin AS, MaxMind GeoIP2, reverse DNS, and WHOIS)
Apache License 2.0
95 stars 17 forks source link

Large lines (>64k) cause error with bufio.Scanner #11

Closed bvandersloot closed 6 years ago

bvandersloot commented 6 years ago

Known limitation with Scanner, with a standard workaround.

Large JSON objects with the newline-delimited JSON input caused me to have this issue, and doesn't seem like a rare use case for this library.