search

jtmoon79 / super-speedy-syslog-searcher

Speedily search and merge log messages by datetime
MIT License
38 stars 1 forks source link

entire `.bz2` files must be read before processing #300

Open jtmoon79 opened 3 months ago

jtmoon79 commented 3 months ago

Summary

The entire .bz2 file is uncompressed to get it's uncompressed size before processing.

Current behavior

BZIP2 file format does not specify an uncompressed size field.

Conclusion

It doesn't appear there is anything that can be done about this. This Issue is merely denoting the problem exists for reference from elsewhere (like the README.md)

Also see

Follow-on from #40 Similar to #293 regarding .lz4 Meta-Issue #182