Unable to load log files bigger than 67108864 bytes

[GoogleCodeExporter]

When opening a file that is bigger than 67108864 bytes, following error will 
occur:

libprotobuf WARNING google/protobuf/io/coded_stream.cc:497] Reading dangerously 
large protocol message.  If the message turns out to be larger than 67108864 
bytes, parsing will be halted for security reasons.  To increase the limit (or 
to disable these warnings), see CodedInputStream::SetTotalBytesLimit() in 
google/protobuf/io/coded_stream.h.
libprotobuf ERROR google/protobuf/io/coded_stream.cc:196] A protocol message 
was rejected because it was too big (more than 67108864 bytes).  To increase 
the limit (or to disable these warnings), see 
CodedInputStream::SetTotalBytesLimit() in google/protobuf/io/coded_stream.h.

The CodedInputStream::SetTotalBytesLimit() method should be used to enable 
bigger files

Original issue reported on code.google.com by nicolai....@gmail.com on 27 Jun 2012 at 12:29

[GoogleCodeExporter]

[deleted comment]

[GoogleCodeExporter]

Hello. There's a workaround for this, which allows at least the big file to be 
loaded to be recoded into separate, smaller, files. It also allows the file to 
be played normally. the file with the two lines of change is attached.

However, we should seriously consider changing how the logs are stored to a set 
of protobuf packets instead of one giant that contains multiple inside. I think 
a streaming technique would fit, and that's the opinion Joydeep gave me also 
the other day -> https://developers.google.com/protocol-buffers/docs/techniques

Original comment by jgurz...@yahoo.com.br on 4 Nov 2012 at 6:35

Attachments:

• sslvision.cc

[GoogleCodeExporter]

I put the workaround into the code and it works now.

I agree with you that is not a good and final solution. However, this has no 
high priority for us at the moment... We should keep that in mind, though...

Original comment by nicolai....@gmail.com on 8 Nov 2012 at 6:55

• Changed state: Fixed