google-code-export / snaketail-net

Automatically exported from code.google.com/p/snaketail-net
0 stars 1 forks source link

Not usable with very large logfiles (sized several GB) #68

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago
SnakeTail is (practically) unable to process very large log files. I cancelled 
trying to open a 5GB log file after 5 minutes (SnakeTail indicated "loading"; 
high CPU + Kernel times load).

Looking at the memory consumption, it does not look like the full file is 
loaded into memory, so I guess it is just read through to find the tail of the 
file (maybe also to count the number of lines in order to display a proper 
scrollbar?).

It would be much faster if the file position would be set to end of file and 
then the last n characters read. This would really enable using this tool with 
the large log files I keep encountering.

Original issue reported on code.google.com by ka...@bilby.de on 20 Dec 2013 at 12:20