ERROR: Length of target window (100001916) exceeds limit of 67108864 bytes

[GoogleCodeExporter]

I'm using VCDIFF without a dictionary and thus to copy only within the 
target file. So a sort of GZIP with a large window. So I'm trying to 
extend the size of the window within the target file from where a "copy" 
can be found. 

My files can be larger than 67Mb, and I wish to copy from large distances.

I played with the options max_target_window_size, max_target_file_size, 
and buffersize but I get errors, like the one in the subject, when I act 
on files larger than 50Mb.

Can you please provide me an help?

Thanks.

Original issue reported on code.google.com by ferrag...@gmail.com on 29 Jan 2009 at 9:02

[GoogleCodeExporter]

Thank you very much for reporting this issue.

open-vcdiff version 0.6, now available for download, should fix the problem.
The value of --max_target_file_size is no longer limited to INT32_MAX, and the 
value
of --buffersize is no longer ignored if it is less than 64MB.

I have tested the change against a target file of size 218MB and an empty 
dictionary,
using the default buffer size of 1MB.  The buffer size determines the target 
window
size used by the encoder.

It was necessary to specify the option --max_target_file_size=230000000; 
otherwise,
the decoder produced the following error:
ERROR: Length of target window (1048576 bytes) plus previous windows (67108864 
bytes)
would exceed maximum target file size of 67108864 bytes

I highly recommend using the new vcdiff option --allow_vcd_target=false when 
decoding
such large files.  It reduces decoder memory usage significantly.

Original comment by openvcd...@gmail.com on 9 Apr 2009 at 9:22

• Changed state: Fixed
• Added labels: Component-Logic, OpSys-All, Usability