search

tableau / Logshark

A Tableau log file analysis utility
MIT License
112 stars 50 forks source link

Logshark process hangs on Mac #154

Open erdinculuturk-nw opened 2 years ago

erdinculuturk-nw commented 2 years ago

I am running Logshark in Docker using Mac and following the instructions: https://github.com/tableau/Logshark#build-and-run-it-using-docker

However, the process hangs after being executed for some time when 24 hours log zip file is given as input. The output files are still being created but I am not sure whether they are complete or not. On the other hand, when I try with a smaller log file of 6 hours, the process ends successfully.

Does anyone have any idea whether it is a Mac related problem or not?

The following is the partial console output showing the starting of the process and the final part where it hangs:

docker run -v ~/TableauLogs/logs-2022_05_31_00_00_01.zip:/app/logs.zip -v ~/TableauLogs/Output:/app/Output -v ~/TableauLogs/ProdConfig.json:/app/Config/LogSharkConfig.json logshark:latest logs.zip --plugins "all" -p --writer postgres
info: LogShark.LogSharkRunner[0]
      Starting to process Log set logs.zip
info: LogShark.LogSharkRunner[0]
      Generated Run ID: 22061406550338-34b8ea264a18-logs
info: LogShark.LogSharkRunner[0]
      Postgres Writer requested. Initializing writer factory...
info: LogShark.Shared.LogReading.TableauLogsExtractor[0]
      => 22061406550338-34b8ea264a18-logs
      Starting TableauLogsExtractor for log set `logs.zip`
info: LogShark.Shared.LogReading.TableauLogsExtractor[0]
      => 22061406550338-34b8ea264a18-logs
      Provided log set appears to be zip file
...
...
...
dbug: LogShark.ZipArchivePool[0]
      => 22061406550338-34b8ea264a18-logs
      Got request for ZipArchive for file `logs.zip`. Currently checked out ZipArchive count is 1
info: LogShark.TableauLogsProcessor[0]
      => 22061406550338-34b8ea264a18-logs => VizportalJava => node3/vizportal_0.20221.22.0516.17204294421438813316397/logs/vizportal-instrumentation-metrics_node3-0.log
      Starting to process log file node3/vizportal_0.20221.22.0516.17204294421438813316397/logs/vizportal-instrumentation-metrics_node3-0.log
info: LogShark.TableauLogsProcessor[0]
      => 22061406550338-34b8ea264a18-logs => VizportalJava => node3/vizportal_0.20221.22.0516.17204294421438813316397/logs/vizportal-instrumentation-metrics_node3-0.log.2022-05-29
      Completed processing file node3/vizportal_0.20221.22.0516.17204294421438813316397/logs/vizportal-instrumentation-metrics_node3-0.log.2022-05-29 in 00:04:28.5872109 (699 MB, 792889 lines, 2.60 MB/s)
dbug: LogShark.ZipArchivePool[0]
      => 22061406550338-34b8ea264a18-logs => VizportalJava => node3/vizportal_0.20221.22.0516.17204294421438813316397/logs/vizportal-instrumentation-metrics_node3-0.log.2022-05-29
      Received return request for ZipArchive for path `logs.zip`. Currently checked out ZipArchive count is 2.
dbug: LogShark.ZipArchivePool[0]
      => 22061406550338-34b8ea264a18-logs
      Got request for ZipArchive for file `logs.zip`. Currently checked out ZipArchive count is 1
info: LogShark.TableauLogsProcessor[0]
      => 22061406550338-34b8ea264a18-logs => VizportalJava => node3/vizportal_0.20221.22.0516.17204294421438813316397/logs/vizportal-instrumentation-metrics_node3-1.log.2022-05-29
      Starting to process log file node3/vizportal_0.20221.22.0516.17204294421438813316397/logs/vizportal-instrumentation-metrics_node3-1.log.2022-05-29

Thanks.