WarcReader may hang up when processing a gzipped WARC file with the last record clipped/incomplete (due to an unfinished download or a killed WARC writer). Seen with
clipped.warc.gz, but I'll try to prepare a unit test which systematically checks for boundary conditions.
WarcReader may hang up when processing a gzipped WARC file with the last record clipped/incomplete (due to an unfinished download or a killed WARC writer). Seen with clipped.warc.gz, but I'll try to prepare a unit test which systematically checks for boundary conditions.