tstack / lnav

Log file navigator
http://lnav.org
BSD 2-Clause "Simplified" License
7.94k stars 317 forks source link

Segmentation fault in view_curses::mvwattrline #258

Closed outcoldman closed 9 years ago

outcoldman commented 9 years ago

Installed lnav with linuxbrew and got Segmentation fault

Program received signal SIGSEGV, Segmentation fault.
0x000000000045603d in view_curses::mvwattrline(_win_st*, int, int, attr_line_t&, line_range const&, view_colors::role_t) ()
(gdb) backtrace
#0  0x000000000045603d in view_curses::mvwattrline(_win_st*, int, int, attr_line_t&, line_range const&, view_colors::role_t) ()
#1  0x0000000000451099 in statusview_curses::do_update() ()
#2  0x0000000000426ff2 in main ()
(gdb) info sharedlibrary
From                To                  Syms Read   Shared Object Library
0x000000344fa00b00  0x000000344fa198eb  Yes (*)     /lib64/ld-linux-x86-64.so.2
0x0000003450200de0  0x0000003450201998  Yes (*)     /lib64/libdl.so.2
0x000000345ee00e10  0x000000345ee01688  Yes (*)     /lib64/libutil.so.1
0x00007ffff7d3db60  0x00007ffff7d9f362  Yes         /home/dgladkikh/.linuxbrew/lib/libstdc++.so.6
0x0000003450e03e70  0x0000003450e43fb8  Yes (*)     /lib64/libm.so.6
0x00007ffff7a9d8e0  0x00007ffff7aa95a4  Yes         /home/dgladkikh/.linuxbrew/lib/libgcc_s.so.1
0x0000003450605760  0x00000034506110c8  Yes (*)     /lib64/libpthread.so.0
0x000000344fe1ea60  0x000000344ff4022c  Yes (*)     /lib64/libc.so.6
0x00007ffff77e91f0  0x00007ffff77f1648  Yes (*)     /lib64/libnss_files.so.2
0x00007ffff75dd530  0x00007ffff75e5278  Yes (*)     /lib64/libnss_ldap.so.2
(*): Shared library is missing debugging information.
(gdb)
tstack commented 9 years ago

What were you doing when it crashed, just opening a file? Does it only happen for certain files?

What OS version were you using?

Can you run 'lnav -d /tmp/lnav.err' to generate a log dump and attach that file? It contains a lot of versioning and other information that would be useful in helping debug the issue.

thanks!

outcoldman commented 9 years ago

@tstack

CentOS release 6.3 (Final)
Linux ... 2.6.32-504.16.2.el6.x86_64 #1 SMP Wed Apr 22 06:48:29 UTC 2015 x86_64 GNU/Linux

lnav -d /tmp/lnav.err also causes segmentation fault. btw I compiled lnav from sources on my own and made it work. For some reason linuxbrew version is failing.

tstack commented 9 years ago

I think a log file would still have been generated even when it crashed, can you check and attach it?

outcoldman commented 9 years ago

@tstack you are right

2015-09-16T05:16:07.171 I lnav.cc:4351 lnav started
2015-09-16T05:16:07.172 D log_format_loader.cc:526 Loading default formats
2015-09-16T05:16:07.172 D log_format_loader.cc:82  format regex: access_log/ts-first-noquotes = ^(?<timestamp>\d{4}-\d{2}-\d{2}T\d{2}:\d{2}:\d{2}(?:\.\d{3})?) (?<c_ip>[^ ]+) (?<cs_username>[^ ]+) (?<cs_method>[A-Z]+) (?<cs_uri_stem>[^ \?]+)(?:\?(?<cs_uri_query>[^ ]*))? (?:-1|\d+) (?<sc_status>\d+) \d+
2015-09-16T05:16:07.172 D log_format_loader.cc:82  format regex: access_log/ts-first = ^(?<timestamp>\d{4}-\d{2}-\d{2}T\d{2}:\d{2}:\d{2}(?:\.\d{3})?) (?<c_ip>[^ ]+) (?<cs_username>[^ ]+) (?<cs_method>[A-Z]+) "(?<cs_uri_stem>[^ \?]+)(?:\?(?<cs_uri_query>[^ ]*))?" (?:-1|\d+) (?<sc_status>\d+) \d+
2015-09-16T05:16:07.172 D log_format_loader.cc:82  format regex: access_log/std = ^(?<c_ip>[\w\.:\-]+)\s+[\w\.\-]+\s+(?<cs_username>\S+)\s+\[(?<timestamp>[^\]]+)\] "(?:\-|(?<cs_method>\w+) (?<cs_uri_stem>[^ \?]+)(?:\?(?<cs_uri_query>[^ ]*))? (?<cs_version>[\w/\.]+))" (?<sc_status>\d+) (?<sc_bytes>\d+|-)(?: "(?<cs_referer>[^"]+)" "(?<cs_user_agent>[^"]+)")?(?<body>.*)
2015-09-16T05:16:07.172 D log_format_loader.cc:82  format regex: block_log/std = ^(?<timestamp>\w{3} \w{3}\s+\d{1,2} \d{2}:\d{2}:\d{2} \w+ \d{4})$
2015-09-16T05:16:07.172 D log_format_loader.cc:82  format regex: choose_repo_log/std = ^\[(?<level>\w+):[^\]]+] [^:]+:\d+ (?<timestamp>\d{4}-\d{2}-\d{2}[T ]\d{2}:\d{2}:\d{2}(?:[\.,]\d{3})?):(?<body>.*)
2015-09-16T05:16:07.173 D log_format_loader.cc:82  format regex: dpkg_log/std = ^(?<timestamp>\d{4}-\d{2}-\d{2}[T ]\d{2}:\d{2}:\d{2}(?:\.\d{3})?) (?:(?:(?<action>startup|status|configure|install|upgrade|trigproc|remove|purge)(?: (?<status>config-files|failed-config|half-configured|half-installed|installed|not-installed|post-inst-failed|removal-failed|triggers-awaited|triggers-pending|unpacked))? (?<package>[^ ]+) (?<installed_version>[^ ]+)(?: (?<available_version>[^ ]+))?)|update-alternatives: (?<body>.*))$
2015-09-16T05:16:07.173 D log_format_loader.cc:82  format regex: engine_log/std = ^(?<timestamp>.+) (?<level>.+) \[(?<logger>.+)\] \((?<tid>.+)\) (?<body>(?:-|\n)*)
2015-09-16T05:16:07.173 D log_format_loader.cc:82  format regex: error_log/cups = ^(?<level>\w) \[(?<timestamp>[^\]]+)\] (?<body>.*)
2015-09-16T05:16:07.173 D log_format_loader.cc:82  format regex: fsck_hfs_log/std = ^(?<device>[^:]+): fsck_hfs run at (?<timestamp>\w{3} \w{3}\s+\d{1,2} \d{2}:\d{2}:\d{2} \d{4})
2015-09-16T05:16:07.173 D log_format_loader.cc:82  format regex: glog_log/std = ^(?<level>[IWECF])(?<timestamp>\d{4} \d{2}:\d{2}:\d{2}\.\d{6}) (?<thread>\d+) (?<src_file>[^:]+):(?<src_line>\d+)\] (?<body>(?:.|\n)*)
2015-09-16T05:16:07.174 D log_format_loader.cc:82  format regex: openam_log/std = ^"(?<timestamp>\d{4}-\d{2}-\d{2} \d{2}:\d{2}:\d{2})"\s+(?<data>[^ "]+|"(?:[^"]*|"")*")\s+(?<loginid>[^ "]+|"(?:[^"]*|"")*")\s+(?<contextid>[^ "]+|"(?:[^"]|"")*")\s+(?<ipaddr>[^ "]+|"(?:[^"]|"")*")\s+(?<level>[^ "]+|"(?:[^"]|"")*")\s+(?<domain>[^ "]+|"(?:[^"]|"")*")\s+(?<loggedby>[^ "]+|"(?:[^"]|"")*")\s+(?<messageid>[^ "]+|"(?:[^"]|"")*")\s+(?<modulename>[^ "]+|"(?:[^"]|"")*")\s+(?<nameid>[^ "]+|"(?:[^"]|"")*")\s+(?<hostname>[^ "]+|"(?:[^"]|"")*")$
2015-09-16T05:16:07.174 D log_format_loader.cc:82  format regex: openamdb_log/std = ^(?<module>[\w]+):(?<timestamp>\d{2}/\d{2}/\d{4} \d{2}:\d{2}:\d{2}:\d{3} [AP]M \w+): Thread\[(?<thread>[^,]+,\d+,[^,]+)\]\n?(?:\*+|(?<body>.*))$
2015-09-16T05:16:07.174 D log_format_loader.cc:82  format regex: openstack_log/std = ^(?<timestamp>\d{4}-\d{2}-\d{2} \d{2}:\d{2}:\d{2}.\d{3}) (?<pid>\d+) (?<level>\w+) (?<logger>.+) \[(?<tid>.+)\] (?<body>.*)
2015-09-16T05:16:07.174 D log_format_loader.cc:82  format regex: page_log/pre-1.7 = ^(?<printer>[\w_\-\.]+) (?<username>[\w\.\-]+) (?<job_id>\d+) \[(?<timestamp>[^\]]+)\] (?<page_number>total|\d+) (?<num_copies>\d+) (?<job_billing>[^ ]+) (?<job_originating_hostname>[\w\.:\-]+)$
2015-09-16T05:16:07.174 D log_format_loader.cc:82  format regex: page_log/1.7 = ^(?<printer>[\w_\-\.]+) (?<username>[\w\.\-]+) (?<job_id>\d+) \[(?<timestamp>[^\]]+)\] (?<page_number>total|\d+) (?<num_copies>\d+) (?<job_billing>[^ ]+) (?<job_originating_hostname>[\w\.:\-]+) (?<job_name>.+) (?<media>[^ ]+) (?<sides>.+)$
2015-09-16T05:16:07.175 D log_format_loader.cc:82  format regex: snaplogic_log/std = ^(?<timestamp>\d{4}-\d{2}-\d{2}T\d{2}:\d{2}:\d{2}(?:\.\d{3})?) (?:(?:(?<level>\w{4,}) (?<logger>[^ ]+) (?<facility>[^ ]+) (?<msgid>[^ ]+) (?<pipe_rid>-|\d+)(?:\.(?<comp_rid>[^ ]+))? (?<resource_name>[^ ]+) (?<invoker>[^ ]+))|(?:(?:stdout|stderr): ))(?<body>.*)
2015-09-16T05:16:07.175 D log_format_loader.cc:82  format regex: strace_log/std = ^(?<timestamp>\d{2}:\d{2}:\d{2}\.\d{6}) (?<syscall>\w+)\((?<body>.*)\)\s+=\s+(?<rc>[-\w]+)(?: (?<errno>\w+) \([^\)]+\))?(?: <(?<duration>\d+\.\d+)>)?$
2015-09-16T05:16:07.175 D log_format_loader.cc:82  format regex: syslog_log/std = ^(?<timestamp>\w{3}\s+\d{1,2} \d{2}:\d{2}:\d{2})(?: (?<log_hostname>[a-zA-Z0-9:][^ ]+[a-zA-Z0-9]))?(?:(?: (?<log_procname>(?:[^\[:]+|[^:]+))(?:\[(?<log_pid>\d+)])?:(?<body>(?:.|\n)*))$|:?(?:(?: ---)? last message repeated \d+ times?(?: ---)?))
2015-09-16T05:16:07.175 D log_format_loader.cc:82  format regex: tcf_log/std = ^TCF (?<timestamp>\d{2}:\d{2}.\d{3}): (?:Server-Properties: (?:.*)|channel server|\w+: (?<dir>--->|<---) (?<type>\w)(?: (?<token>\w+))?(?: (?<service>\w+))?(?: (?<name>\w+))?(?: (?<msg>.*))?(?: <eom>))$
2015-09-16T05:16:07.176 D log_format_loader.cc:82  format regex: tcsh_history/std = ^#(?<timestamp>\+\d+)\n?(?<body>.*)?$
2015-09-16T05:16:07.176 D log_format_loader.cc:82  format regex: uwsgi_log/std = ^\[pid: (?<s_pid>\d+)\|app: (?<s_app>[\-\d]+)\|req: (?<s_req>[\-\d]+)/(?<s_worker_reqs>\d+)\] (?<c_ip>[^ ]+) \((?<cs_username>[^\)]*)\) \{(?<cs_vars>\d+) vars in (?<cs_bytes>\d+) bytes\} \[(?<timestamp>[^\]]+)\] (?<cs_method>[A-Z]+) (?<cs_uri_stem>[^ \?]+)(?:\?(?<cs_uri_query>[^ ]*))? => generated (?<sc_bytes>\d+) bytes in (?<s_runtime>\d+) (?<rt_unit>\w+) \((?<cs_version>[^ ]+) (?<sc_status>\d+)\) (?<sc_headers>\d+) headers in (?<sc_header_bytes>\d+) bytes \((?<s_switches>\d+) switches on core (?<s_core>\d+)\)
2015-09-16T05:16:07.176 D log_format_loader.cc:82  format regex: vdsm_log/std = ^(?<tid>.+)::(?<level>.+)::(?<timestamp>.+)::(?<module>.+)::(?<src_line>.+)::(?<logger>.+)::\((?<func>[^\)]+)\)(?<body>(?:.|\n)*)
2015-09-16T05:16:07.177 D log_format_loader.cc:82  format regex: vmk_log/std = ^(?<timestamp>\d{4}-\d{2}-\d{2}T\d{2}:\d{2}:\d{2}\.\d{3}Z) cpu(?<cpu>\d+):(?<world_id>\d+)\)((?<level>WARNING|ALERT): )?(?<body>.*)
2015-09-16T05:16:07.177 D log_format_loader.cc:82  format regex: vmw_log/6.0+ = ^(?<timestamp>\d{4}-\d{2}-\d{2}T\d{2}:\d{2}:\d{2}\.\d{3}(?:Z|[-+]\d{2}:\d{2})) (?:Section for VMware VirtualCenter,.*|(?<level>\w+) (?<prc>\w+)\[(?<tid>\w+)\] \[(?<src>[^ \]]+)\s*(?: sub=(?<sub>[^ \]]+))?(?: opID=(?<opid>[^ \]]+))?(?: user=(?<user>[\w\-]+))?\](?<body>.*)(?:\n(?:.|\n)*)?)$
2015-09-16T05:16:07.177 D log_format_loader.cc:82  format regex: vmw_log/5.0+ = ^(?<timestamp>\d{4}-\d{2}-\d{2}T\d{2}:\d{2}:\d{2}\.\d{3}(?:Z|[-+]\d{2}:\d{2})) \[(?<tid>\w+) (?<level>\w+) '(?<comp>[^']+)'(?: opID=(?<opid>[^ \]]+))?(?: user=(?<user>[\w\-]+))?\](?<body>.*)(?:\n(?:.|\n)*)?$
2015-09-16T05:16:07.177 D log_format_loader.cc:82  format regex: vmw_log/pre-5.0 = ^\[(?<timestamp>\d{4}-\d{2}-\d{2} \d{2}:\d{2}:\d{2}\.\d{3}) (?<tid>\w+) (?<level>\w+) '(?<comp>[^']+)'(?: opID=(?<opid>[^ \]]+))?(?: user=(?<user>[\w\-]+))?\](?<body>.*)(?:\n(?:.|\n)*)?$
2015-09-16T05:16:07.177 I log_format_loader.cc:495 loading formats from path: /etc/lnav/formats/*/*.json
2015-09-16T05:16:07.177 I log_format_loader.cc:495 loading formats from path: /home/dgladkikh/.linuxbrew/Cellar/lnav/0.7.3/etc/lnav/formats/*/*.json
2015-09-16T05:16:07.177 I log_format_loader.cc:495 loading formats from path: /home/dgladkikh/.lnav//formats/*/*.json
2015-09-16T05:16:07.179 E pcrepp.hh:422 pcre err -8
2015-09-16T05:16:07.184 I log_format_loader.cc:614 Format order:
2015-09-16T05:16:07.184 I log_format_loader.cc:618   access_log
2015-09-16T05:16:07.184 I log_format_loader.cc:618   block_log
2015-09-16T05:16:07.184 I log_format_loader.cc:618   choose_repo_log
2015-09-16T05:16:07.184 I log_format_loader.cc:618   dpkg_log
2015-09-16T05:16:07.184 I log_format_loader.cc:618   engine_log
2015-09-16T05:16:07.184 I log_format_loader.cc:618   error_log
2015-09-16T05:16:07.184 I log_format_loader.cc:618   fsck_hfs_log
2015-09-16T05:16:07.184 I log_format_loader.cc:618   glog_log
2015-09-16T05:16:07.184 I log_format_loader.cc:618   openam_log
2015-09-16T05:16:07.184 I log_format_loader.cc:618   openamdb_log
2015-09-16T05:16:07.184 I log_format_loader.cc:618   openstack_log
2015-09-16T05:16:07.184 I log_format_loader.cc:618   page_log
2015-09-16T05:16:07.184 I log_format_loader.cc:618   snaplogic_log
2015-09-16T05:16:07.184 I log_format_loader.cc:618   strace_log
2015-09-16T05:16:07.184 I log_format_loader.cc:618   syslog_log
2015-09-16T05:16:07.184 I log_format_loader.cc:618   tcf_log
2015-09-16T05:16:07.184 I log_format_loader.cc:618   tcsh_history
2015-09-16T05:16:07.184 I log_format_loader.cc:618   uwsgi_log
2015-09-16T05:16:07.184 I log_format_loader.cc:618   vdsm_log
2015-09-16T05:16:07.184 I log_format_loader.cc:618   vmk_log
2015-09-16T05:16:07.184 I log_format_loader.cc:618   vmw_log
2015-09-16T05:16:07.185 D log_vtab_impl.cc:147 creating log format table: generic_log = 0x166ca18
2015-09-16T05:16:07.185 D log_vtab_impl.cc:147 creating log format table: access_log = 0x165a9c8
2015-09-16T05:16:07.186 D log_vtab_impl.cc:147 creating log format table: block_log = 0x16726f8
2015-09-16T05:16:07.186 D log_vtab_impl.cc:147 creating log format table: choose_repo_log = 0x166d188
2015-09-16T05:16:07.186 D log_vtab_impl.cc:147 creating log format table: dpkg_log = 0x166d068
2015-09-16T05:16:07.186 D log_vtab_impl.cc:147 creating log format table: engine_log = 0x1675f08
2015-09-16T05:16:07.186 D log_vtab_impl.cc:147 creating log format table: error_log = 0x166eed8
2015-09-16T05:16:07.186 D log_vtab_impl.cc:147 creating log format table: fsck_hfs_log = 0x1674a58
2015-09-16T05:16:07.187 D log_vtab_impl.cc:147 creating log format table: glog_log = 0x16794d8
2015-09-16T05:16:07.187 D log_vtab_impl.cc:147 creating log format table: openam_log = 0x167c578
2015-09-16T05:16:07.187 D log_vtab_impl.cc:147 creating log format table: openamdb_log = 0x1675c78
2015-09-16T05:16:07.187 D log_vtab_impl.cc:147 creating log format table: openstack_log = 0x166c138
2015-09-16T05:16:07.187 D log_vtab_impl.cc:147 creating log format table: page_log = 0x167f0c8
2015-09-16T05:16:07.187 D log_vtab_impl.cc:147 creating log format table: snaplogic_log = 0x1681ee8
2015-09-16T05:16:07.187 D log_vtab_impl.cc:147 creating log format table: strace_log = 0x1681df8
2015-09-16T05:16:07.188 D log_vtab_impl.cc:147 creating log format table: syslog_log = 0x1683a38
2015-09-16T05:16:07.188 D log_vtab_impl.cc:147 creating log format table: tcf_log = 0x166be88
2015-09-16T05:16:07.188 D log_vtab_impl.cc:147 creating log format table: tcsh_history = 0x167ee68
2015-09-16T05:16:07.188 D log_vtab_impl.cc:147 creating log format table: uwsgi_log = 0x1688178
2015-09-16T05:16:07.188 D log_vtab_impl.cc:147 creating log format table: vdsm_log = 0x16865a8
2015-09-16T05:16:07.188 D log_vtab_impl.cc:147 creating log format table: vmk_log = 0x167c168
2015-09-16T05:16:07.189 D log_vtab_impl.cc:147 creating log format table: vmw_log = 0x168d938
2015-09-16T05:16:07.190 I lnav.cc:3247 loading new file: /var/log/messages
2015-09-16T05:16:07.190 I lnav.cc:4639 startup: lnav 0.7.3
2015-09-16T05:16:07.190 I lnav_log.cc:159 uname:
2015-09-16T05:16:07.190 I lnav_log.cc:160   sysname=Linux
2015-09-16T05:16:07.190 I lnav_log.cc:161   nodename=hostname.domain.com
2015-09-16T05:16:07.190 I lnav_log.cc:162   machine=x86_64
2015-09-16T05:16:07.190 I lnav_log.cc:163   release=2.6.32-504.16.2.el6.x86_64
2015-09-16T05:16:07.190 I lnav_log.cc:164   version=#1 SMP Wed Apr 22 06:48:29 UTC 2015
2015-09-16T05:16:07.190 I lnav_log.cc:165 Environment:
2015-09-16T05:16:07.190 I lnav_log.cc:166   HOME=/home/dgladkikh
2015-09-16T05:16:07.190 I lnav_log.cc:167   LANG=en_US.UTF-8
2015-09-16T05:16:07.190 I lnav_log.cc:168   PATH=/home/dgladkikh/.linuxbrew/bin:/usr/local/bin:/usr/local/sbin:/home/dgladkikh/.dotfiles/scripts:/home/dgladkikh/.dotfiles/bin:/usr/lib64/distcc/bin:/usr/lib64/qt-3.3/bin:/bin:/usr/bin:/usr/sbin:/sbin:/home/dgladkikh/bin
2015-09-16T05:16:07.190 I lnav_log.cc:169   TERM=screen-256color
2015-09-16T05:16:07.190 I lnav_log.cc:170   TZ=(null)
2015-09-16T05:16:07.190 I lnav_log.cc:171 Process:
2015-09-16T05:16:07.190 I lnav_log.cc:172   pid=52147
2015-09-16T05:16:07.190 I lnav_log.cc:173   ppid=35402
2015-09-16T05:16:07.190 I lnav_log.cc:174   pgrp=52147
2015-09-16T05:16:07.190 I lnav_log.cc:175   uid=788273
2015-09-16T05:16:07.190 I lnav_log.cc:176   gid=20
2015-09-16T05:16:07.190 I lnav_log.cc:177   euid=788273
2015-09-16T05:16:07.190 I lnav_log.cc:178   egid=20
2015-09-16T05:16:07.190 I lnav_log.cc:180   cwd=/home/dgladkikh
2015-09-16T05:16:07.190 I lnav_log.cc:181 Executable:
2015-09-16T05:16:07.190 I lnav_log.cc:182   version=lnav 0.7.3
2015-09-16T05:16:07.190 I lnav.cc:4641 Libraries:
2015-09-16T05:16:07.190 I lnav.cc:4643   bzip=1.0.6, 6-Sept-2010
2015-09-16T05:16:07.190 I lnav.cc:4645   ncurses=6.0
2015-09-16T05:16:07.190 I lnav.cc:4646   pcre=8.37 2015-04-28
2015-09-16T05:16:07.190 I lnav.cc:4647   readline=6.3
2015-09-16T05:16:07.190 I lnav.cc:4648   sqlite=3.8.11.1
2015-09-16T05:16:07.190 I lnav.cc:4649   zlib=1.2.8
2015-09-16T05:16:07.190 I lnav.cc:4650 lnav_data:
2015-09-16T05:16:07.190 I lnav.cc:4651   flags=1
2015-09-16T05:16:07.190 I lnav.cc:4652   commands:
2015-09-16T05:16:07.190 I lnav.cc:4659   files:
2015-09-16T05:16:07.190 I lnav.cc:4664     /var/log/messages
2015-09-16T05:16:07.190 I session_data.cc:268 init_session: time=1442405767; id=641fce15d4738a01020e0cb0d28610cf
2015-09-16T05:16:07.190 I lnav.cc:4745   session_id=641fce15d4738a01020e0cb0d28610cf
outcoldman commented 9 years ago

@tstack I have tried to reproduce this issue on another machine and I could not. So don't want to waste your time, it is some local issue. I could build it without using linuxbrew. So I am fine now.

Thank you for the great tool. I am going to close this ticket.