This improves performances by a significant margin, because it means that we do not reparse many times the same line over and over again when the line is much larger than the intermediate buf used in Document::OpenFile( )
For now on my machine I went from 6sec->1sec to load a file with a single 16MB line.
And for a 64MB line I went from almost 2 minutes down to 3 sec.
This improves performances by a significant margin, because it means that we do not reparse many times the same line over and over again when the line is much larger than the intermediate buf used in
Document::OpenFile( )For now on my machine I went from 6sec->1sec to load a file with a single 16MB line. And for a 64MB line I went from almost 2 minutes down to 3 sec.