xiaolu / lz4

Automatically exported from code.google.com/p/lz4
1 stars 1 forks source link

Small chunksize #69

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago
I tested LZ4 through fullbench.c and noticed that the default DEFAULT_CHUNKSIZE 
4MiB and if it reduced (for example up to 256 bytes) then speed and quality of 
LZ4 compression becomes worse than LZO1.
So, LZ4 will show the performance claimed only for large chunks?

Original issue reported on code.google.com by bratsi...@gmail.com on 11 Jun 2013 at 10:49

GoogleCodeExporter commented 9 years ago
OK, maybe this part is not clear,
fullbench.c is at its first version, so it sure has some shortcomings.

Supported chunksizes are :
-B4 : 64KB
-B5 : 256KB
-B6 : 1MB
-B7 : 4MB

You can, as you did, modify DEFAULT_CHUNKSIZE to test different sizes,
but it is, at this stage, out of fullbench.c scope.

Note also that 256 bytes looks like an extreme case.
For such small blocks, compression will likely be poor. It would be advisable 
to use "inter-dependent" blocks for such a use case (-option -BD for lz4c.c, 
not yet supported by fullbench.c).

Original comment by yann.col...@gmail.com on 11 Jun 2013 at 11:43

GoogleCodeExporter commented 9 years ago

Original comment by yann.col...@gmail.com on 11 Jun 2013 at 11:49

GoogleCodeExporter commented 9 years ago

Original comment by yann.col...@gmail.com on 1 Jul 2013 at 7:53