search

krishnachaitanyap / xdeltaencoder

Automatically exported from code.google.com/p/xdeltaencoder
0 stars 0 forks source link

Process target blocks in memory #7

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago 
Introduce processing of target blocks in memory. Should be faster than 
processing target from disk.

Original issue reported on code.google.com by mantl...@gmail.com on 25 Jun 2013 at 6:10

GoogleCodeExporter commented 9 years ago 
This issue was updated by revision 9ac53bd65688.

Introduced two new command line switches:
-tb <size> - process target in blocks of given <size>
-bt <size> - process only source block which matched at least <size> bytes in 
the preprocessing stage.

Original comment by mantl...@gmail.com on 25 Jun 2013 at 6:19

GoogleCodeExporter commented 9 years ago 
This issue was updated by revision 1fe3dd38627a.

Blocks for processing are selected at the end of pre-processing pass instead of 
preprocessing block delta stage of each pass.
This speeds up processing for very large files with a lot of small chunks.

Original comment by mantl...@gmail.com on 17 Oct 2013 at 10:04