Commit Graph

762 Commits

Author SHA1 Message Date
Timothy Stack
c96ab11d0f [scanner] tweak to the time scanner 2015-12-31 21:00:31 -08:00
Timothy Stack
e5f786bc2c [script] add metadata to script files 2015-12-28 20:30:04 -08:00
Timothy Stack
ab62d27757 [cmd] replace wordexp with shlex 2015-12-25 12:03:44 -08:00
Timothy Stack
16e988d132 [shlex] add a readline highlighter for shlex 2015-12-24 03:35:02 -08:00
Timothy Stack
6e196bff79 [line_buffer] clear cached data when doing a read 2015-12-22 22:44:42 -08:00
Timothy Stack
87b07a0087 [sql] allow log_part to be updated 2015-12-22 05:27:36 -08:00
Timothy Stack
84c157d543 [build] more build 2015-12-19 06:13:12 -08:00
Timothy Stack
cedd89d9b6 [build] try to fix some warnings and debug breakage 2015-12-19 06:08:56 -08:00
Timothy Stack
e07b4e448f [exec] add a prompt to execute lnav scripts 2015-12-18 22:39:27 -08:00
Timothy Stack
c4ae8d158c [fmt] minor fix for the generic_log format and add another pattern to vmw_log 2015-12-10 20:36:25 -08:00
Timothy Stack
feab733742 [cmd] add reltime possibilities for some commands 2015-12-09 23:13:41 -08:00
Timothy Stack
27f300b677 [sql] some more json-related updates/fixes 2015-12-09 21:20:49 -08:00
Timothy Stack
187d62334f [json] record the type of json data in json_ptr_walk 2015-12-08 23:10:48 -08:00
Timothy Stack
e987a5164f [hist] rewrite the histogram code 2015-12-08 22:46:10 -08:00
Timothy Stack
224a7196e4 [cmd] hide lines commands 2015-12-05 20:38:21 -08:00
Timothy Stack
aa0999bd0e [opid] missed adding opid to the json log and some other bug fixes
Defect Number:
    Reviewed By:
   Testing Done:
2015-12-04 19:04:37 -08:00
Timothy Stack
d1bbc433b7 [view] start to refactor the bar chart code 2015-12-03 21:56:35 -08:00
Timothy Stack
7c92d16297 [sql] add an overlay showing the values in json columns 2015-12-03 05:30:01 -08:00
Timothy Stack
e5a32362e0 build fix 2015-12-01 23:06:30 -08:00
Timothy Stack
7489dd514c [sql] graph columns that contain json objects 2015-12-01 22:59:27 -08:00
Timothy Stack
f3ca72f42d [jget] fix the jget function 2015-11-30 21:07:18 -08:00
Timothy Stack
b6e10f4ee4 bump the max line size to try and solve some json log issues 2015-11-29 20:35:13 -08:00
Timothy Stack
5a718bc0ec [sql] missed checking for null in graphable columns 2015-11-29 20:10:40 -08:00
Timothy Stack
62075fb340 [sql] add json_group_object aggregate function 2015-11-29 19:56:10 -08:00
Timothy Stack
4eb797ce9a [hist] start to replace the old hist_source class 2015-11-28 21:52:24 -08:00
Timothy Stack
8964232374 [json] fixes for json log parsing
I was careless with the initial json log impl since it did not deal
with incomplete log lines very well.  This seems to fix some cases.
But, I was still able to replicate a lockup at one point, so it
might not be complete.
2015-11-27 12:47:42 -08:00
Timothy Stack
64cbab1281 [sql] exec .sql files in format dirs 2015-11-26 22:19:53 -08:00
Timothy Stack
91406be91e [nav] add "opid" support with a hotkey 2015-11-24 20:59:24 -08:00
Timothy Stack
885f65f402 [fmt] add an ELB format 2015-11-16 22:58:11 -08:00
Timothy Stack
3c9ba126a9 [glob] ignore files picked up by a glob that are not readable 2015-11-14 22:17:59 -08:00
Timothy Stack
ff929391f3 need to fflush(stdout) to get the mouse working again 2015-11-14 12:39:36 -08:00
Timothy Stack
e799638889 missed flushing the stream when setting the term title, it could cause some screen corruption 2015-11-13 22:01:13 -08:00
Timothy Stack
6cb42fc690 the log_search table regex should be case-insensitive 2015-11-03 22:17:11 -08:00
Timothy Stack
0c3a303066 set 'level' as the default name for the level field 2015-11-01 20:47:42 -08:00
Timothy Stack
0237aaad21 [release] update the release Makefile 2015-10-14 21:01:39 -07:00
Timothy Stack
dfb009595b [loader] prefer user-provided formats when breaking a cycle 2015-10-14 21:01:39 -07:00
Timothy Stack
4f775dc1ae [pt] don't poll if max time is set 2015-10-04 20:50:49 -07:00
Timothy Stack
f11cca2366 [sql] add a timeslice() function 2015-10-03 14:58:01 -07:00
Timothy Stack
99d103cd58 [logline] add a log_msg_instance column to the table 2015-10-02 21:24:52 -07:00
Timothy Stack
9c23431779 [all_logs] add a .msgformats SQL command 2015-09-20 21:03:51 -07:00
Timothy Stack
ecd3eb05bc [coverity] next set of fixes 2015-09-19 21:13:46 -07:00
Timothy Stack
69e927e91b [coverity] some more fixes 2015-09-19 20:30:39 -07:00
Timothy Stack
d298f45fe0 some coverity fixes 2015-09-15 00:24:56 -07:00
Timothy Stack
c3a26ceb6f fix some copy pasta in pt-time commands 2015-09-15 00:14:27 -07:00
Timothy Stack
4f32bddd93 [pt] allow relative times for papertrail time bounds 2015-09-14 23:32:05 -07:00
Timothy Stack
ec473edc85 [cmd] add support for times in goto 2015-09-14 08:56:42 -07:00
Timothy Stack
7407fd429d user alerter instead of flash() 2015-09-06 22:51:58 -07:00
Timothy Stack
4422e9d82b [curl] use ssh-agent for auth 2015-09-04 22:10:26 -07:00
Timothy Stack
3c0d78d28e [sql] fix spurious loading bar flash while searching 2015-09-03 21:23:29 -07:00
Timothy Stack
399c78d86d [pretty] pretty-print the contents of strings
Fixes #250
2015-08-26 21:28:30 -07:00
Timothy Stack
443053da62 [all_logs] add log_msg_schema hidden column to the all_logs table and refine the msg format 2015-08-26 09:41:45 -07:00
Timothy Stack
e95bd90dfc [filter] check for too many filters being created 2015-08-24 22:09:33 -07:00
Timothy Stack
0fee92b08f add 're-' prefix to data_scanner 2015-08-21 07:00:47 -07:00
Timothy Stack
feaff13b13 [data_parser] some fixes for the debugger and some parsing improvements 2015-08-21 06:48:05 -07:00
Timothy Stack
a6ffff5126 don't restore time-offset mode since people might not know how to turn it off 2015-08-19 21:13:21 -07:00
Timothy Stack
25a375f08d [misc] fix various bugs 2015-08-19 21:02:26 -07:00
Timothy Stack
6ce2d9e6a1 [pt] write out the error message for a request 2015-08-18 22:15:00 -07:00
Timothy Stack
0d37a8c142 [text] pretty-printing should work in the text view 2015-08-18 20:58:20 -07:00
Timothy Stack
b4cb092ce1 [view] stop scrolling to the right when the end is reached
Fixes #84
2015-08-14 20:45:23 -07:00
Timothy Stack
87cfe63613 fix an issue with module formats 2015-08-10 21:50:30 -07:00
Timothy Stack
5bb0599d7e [fmt] add a sudo_log format 2015-08-10 20:41:27 -07:00
Timothy Stack
bedae8c8c2 [fmt] install/update formats from git repos
Fixes #244
2015-08-09 21:03:23 -07:00
Timothy Stack
9139e6de5b [search-table] guess the column types based on the regex 2015-08-07 20:04:28 -07:00
Timothy Stack
2b5447f59c [sql] add a log_search table 2015-08-05 23:18:19 -07:00
Timothy Stack
6f26aa7f3e [sql] multiline text was not returned correctly 2015-08-04 21:49:13 -07:00
Timothy Stack
b76b6175c6 build fix 2015-08-04 08:47:33 -07:00
Timothy Stack
cd0145a49d build fix 2015-08-04 08:43:45 -07:00
Timothy Stack
83b92c3b65 [papertrail] add support for time ranges 2015-08-04 08:39:32 -07:00
Timothy Stack
9df95b33e1 build fix 2015-08-03 08:27:33 -07:00
Timothy Stack
cc5e70fb30 [cmd] add help to the command prompt 2015-08-03 06:49:07 -07:00
Timothy Stack
e9a96caf09 [papertrail] use the curl_looper 2015-08-02 20:12:21 -07:00
Timothy Stack
9555ad911a more build fixes 2015-08-02 07:41:09 -07:00
Timothy Stack
4f52a5ea5c build fix 2015-08-02 06:49:33 -07:00
Timothy Stack
f286950854 [curl] add a curl looper to handle url requests 2015-08-02 06:43:57 -07:00
Timothy Stack
b7d7fe70c7 [pretty] remove extraneous newline 2015-07-23 23:35:56 -07:00
Timothy Stack
82574e2e27 [line_buffer] missed invalidating a sb ref 2015-07-23 23:06:52 -07:00
Timothy Stack
fa89ecc5e5 redo the search in the pretty view
Fixes #245
2015-07-23 22:29:08 -07:00
Timothy Stack
d616509958 build fix 2015-07-22 07:41:23 -07:00
Timothy Stack
d2d8c75135 [sql] add an lnav_views table 2015-07-22 07:09:51 -07:00
Timothy Stack
9496a960f6 [check] print the partial match of non-matching lines when checking a log file 2015-07-20 06:33:52 -07:00
Timothy Stack
3a87a65ab2 [fmt] add warnings for missing fields 2015-07-20 05:33:02 -07:00
Timothy Stack
010131aaba [docs] update the docs for recent changes 2015-07-19 21:38:37 -07:00
Timothy Stack
27bb9bb2ee [fmt] highlight identifiers in module formats 2015-07-19 02:40:02 -07:00
Timothy Stack
5e77e9f256 [readline] try a different behavior when tab-completing quoted stuff in the SQL context 2015-07-17 20:51:44 -07:00
Timothy Stack
3f4e11a693 [fmt] first pass at supporting sub-formats (called module formats) 2015-07-17 20:39:06 -07:00
Timothy Stack
4573964fd2 always build papertrail_proc 2015-07-14 20:15:48 -07:00
Timothy Stack
0bd9b29bea adjustments to the generic_log so the body is picked up correctly 2015-07-13 22:33:40 -07:00
Timothy Stack
a8bf7e39b0 log the version of libcurl 2015-07-12 10:23:01 -07:00
Timothy Stack
5ef60412db [pt] pass search query to papertrail 2015-07-12 09:57:02 -07:00
Timothy Stack
7ef92dab79 [format] try to validate formats against a given file 2015-07-11 16:32:48 -07:00
Timothy Stack
f392822aa8 [parse] show the path of the pattern used to parse the top line 2015-07-10 21:39:03 -07:00
Timothy Stack
e2c08d1da7 these files got dropped from the last checkin 2015-07-08 23:18:52 -07:00
Timothy Stack
f1dd99328d [lnav.cc] move more stuff out of lnav.cc 2015-07-08 22:26:54 -07:00
Timothy Stack
7679599afc fix a refactor error 2015-07-08 07:05:11 -07:00
Timothy Stack
6b971ccd66 move stuff out of lnav.cc
Defect Number:
    Reviewed By:
   Testing Done:
2015-07-08 06:35:36 -07:00
Timothy Stack
879bbd581e [pt] rough draft of tail for papertrail 2015-07-06 20:53:42 -07:00
Timothy Stack
4ceddbe82e [ptimec] fix handling of month in interpreted formats
Also missed the null terminator on the list of custom
timestamp formats.
2015-06-30 21:53:01 -07:00
Suresh Sundriyal
b4f2c1683a [coverity] Avoid a buffer-overrun.
'escape_index' is ensured to be less than 'sizeof(escape_buffer)-1'.
This guarantees enough space for one more character in the
escape_buffer. However, if we meet this condition, we go ahead and shove
a character and a null-terminator in to the string, potentially leading
to a buffer overrun.
2015-06-27 21:37:08 -07:00
Timothy Stack
87ec101f9c [fmts] log format contributions 2015-06-24 21:32:45 -07:00
Timothy Stack
92dd59285b some fixes to the re2c change 2015-06-10 20:42:46 -07:00
Timothy Stack
054e8d489b [data-scanner] convert to using re2c 2015-06-08 06:27:45 -07:00
Timothy Stack
bb5f3cc9c4 [all_logs] tweak log_msg_format generation 2015-06-04 05:30:50 -07:00
Timothy Stack
504b5747fe [sql] add an all_logs table that exposes the message format with values, like numbers, replaced with hashes 2015-06-03 06:36:58 -07:00
Suresh Sundriyal
f476f904db [syslog_log] Case-insensitive search for level strings
While looking through syslog messages on OS X, came across plenty of
error/warning messages where the level was in all-caps and as a result
were not recognized. There was also a lot of false positives due to the
word error turning up as part of a longer string.

This change:
- Changes the log level regex to do a case-insensitive search.
- Ognores the string 'error', if it is part of a longer string.
2015-05-31 22:47:39 -07:00
Timothy Stack
100e4233d5 [ptime] fix parsing for double digit year 2015-05-29 21:41:30 -07:00
Suresh Sundriyal
e9c48fbf39 [log_format] Don't capture the sub-groups.
I don't think there is any reason to capture the (OR) sub-group in
ERR(OR) separately.
2015-05-20 00:41:00 -07:00
Timothy Stack
cec3d0cb72 [generic_log] add time format that includes zone 2015-05-17 05:15:41 -07:00
Timothy Stack
04f8ceadab [file-marker] some more cleanup 2015-05-14 22:07:28 -07:00
Timothy Stack
b8b16bd8e5 [view] differentiate messages from different log files 2015-05-13 22:13:47 -07:00
Timothy Stack
e07f3f5b24 [docs] update docs for horizontal move change 2015-05-12 06:37:41 -07:00
Tim Stack
ba1191d730 Merge pull request #234 from PaulWay/PaulWay_shift_horizontal_movement
Adding smaller movements to left and right via shift-arrows or H and L.
2015-05-11 06:46:42 -07:00
Suresh Sundriyal
d6b32d60be [lo-fi shortcut] Change shortcut to 'Ctrl-l'.
* Change the 'lo-fi' shortcut to 'Ctrl-l'
* Remove the shortcut for 'redraw'
2015-05-08 22:31:56 -07:00
Paul Wayper
de38b11e67 Fixed missing semicolon from last break statement in previous commit. 2015-05-06 08:41:17 +10:00
Suresh Sundriyal
97d3c53565 [autodeploy_log] rename the Auto Deploy log format 2015-05-04 23:16:26 -07:00
Suresh Sundriyal
280d0cb718 [top_status_view] Increase the format name column width 2015-05-04 23:15:53 -07:00
Paul Wayper
e5acc0e6ba Adding smaller movements to left and right via shift-arrows or H and L. 2015-05-05 09:57:05 +10:00
Timothy Stack
94459f2cb1 [generic_log] fix log levels for generic_log 2015-05-01 20:52:00 -07:00
Suresh Sundriyal
eee628a272 [format] Add a format for Auto Deploy. 2015-04-28 21:55:17 -07:00
Timothy Stack
021b7cb3aa [test] add a test for nested json log formats 2015-04-26 04:57:36 -07:00
Timothy Stack
9948eeba77 [build] use isdigit 2015-04-25 12:29:54 -07:00
Timothy Stack
1d0233bbfa [json-format] support for full paths 2015-04-25 12:15:51 -07:00
Suresh Sundriyal
fcb2db38b0 [timer] Start off disarmed + refactoring. 2015-04-24 01:58:39 -07:00
Suresh Sundriyal
da582ce00f [timer] Add 'disarm' method 2015-04-24 00:43:30 -07:00
Suresh Sundriyal
99094a9cf8 [timer] Some refactoring 2015-04-24 00:37:57 -07:00
Suresh Sundriyal
55e912d21e [pretty] Don't wait indefinitely for reverse IP lookups.
Reverse lookup for pretty print should be a best effort undertaking. So,
+ Give up on EAI_AGAIN.
+ Don't block on the getnameinfo call indefinitely, resolv.conf might be
  set up with a large timeout.
+ Disable lookups after the first failure.
+ Lots of OCD error checking.
2015-04-23 23:42:51 -07:00
Timothy Stack
5a7c5a2139 [piper] the piper was not exiting if the stream it was reading did not terminate with a line feed 2015-04-21 22:25:54 -07:00
Suresh Sundriyal
5cd1da8e1a [pretty] More restrictive IPv4 regex.
The regular expression seems to match arbitrary version strings in
pretty-print view. Adding a more restrictive regular expression,
that should be able to distinguish between valid IPv4 addresses and
arbitrary version strings.
2015-04-19 00:00:43 -07:00
Timothy Stack
9ac53b114e add subsystem to the vmk_log format 2015-04-18 21:29:14 -07:00
Suresh Sundriyal
8e70980f7f [init.sql] Check in a static init.sql and remove init_sql.py.
- The codes from httplib.py don't contain all the HTTP status codes and
  might differ between different versions of Python installed on the
  systems the binary is built on.
- Add the complete list from:
  http://www.iana.org/assignments/http-status-codes/http-status-codes.xhtml
- Remove ```init_sql.py``` from the source directory.
- Remove the ```init.sql``` targets from Makefile.am
2015-04-11 14:59:43 -07:00
Timothy Stack
1c41731c33 remove -Werror=sign-compare for now since it's not supported on some older compilers 2015-04-11 11:31:07 -07:00
Suresh Sundriyal
4e9f6f9b2a [coverity] Uninitialized pointer field : textview_curses.hh 2015-04-11 00:42:46 -07:00
Timothy Stack
245a3c3d1b [fmt] allow timestamp to be specified in the log format
Fixes #155
2015-04-10 22:55:57 -07:00
Timothy Stack
ae64b599bd [format] add more log levels and fix some more pretty-printer glitches
Fixes #212
2015-04-10 19:50:05 -07:00
Suresh Sundriyal
13337a75a5 [coverity] buffer overrun. 2015-04-10 00:44:06 -07:00
Suresh Sundriyal
fd157ac42c [pretty] 'A-f' covers a lot of printable characters. 2015-04-09 05:33:36 -07:00
Timothy Stack
488d24b847 [pretty] word-wrap should work in the pretty-printer view 2015-04-08 23:06:43 -07:00
Timothy Stack
a50ec2eb42 update usage 2015-04-08 21:12:16 -07:00
Timothy Stack
8d421d0cd4 do not dump stdin if -q is specified 2015-04-08 21:06:38 -07:00
Timothy Stack
a2f298de8c forgot to check for POLLHUP 2015-04-08 20:58:12 -07:00
Timothy Stack
e1874c0278 use poll instead of select so we can handle more than FD_SETSIZE files 2015-04-08 20:36:45 -07:00
Suresh Sundriyal
9f53d1d3d1 [regex] VMKernel logs have ALERT as well as WARNING. 2015-04-08 19:08:29 -07:00
Tim Stack
20e1fc06dd Merge pull request #207 from sureshsundriyal/wip
[terminal] Print out an error when openpty fails.
2015-04-08 09:20:18 -07:00
Suresh Sundriyal
7e5d5a72bd [terminal] Print out an error when openpty fails.
tstack/lnav#206
2015-04-08 03:57:34 -07:00
Timothy Stack
0b232a7588 [headless] multiline support for command files 2015-04-07 22:13:44 -07:00
Timothy Stack
2dfae4f7f9 [pretty] add some more tests and leave leading spaces alone in some cases 2015-04-07 21:25:01 -07:00
Suresh Sundriyal
1de2a30560 [wsign-compare] FreeBSD builds fail while comparing int with FD_SETSIZE. 2015-04-07 19:39:27 -07:00
Timothy Stack
5f7344874b [pretty] only start a new line after a comma if we're in a structure 2015-04-07 17:24:56 -07:00
Timothy Stack
d6d652ec38 various tweaks 2015-04-07 06:09:49 -07:00
Suresh Sundriyal
7da767bc07 [build] More changes for git version string. 2015-04-06 21:51:16 -07:00
Suresh Sundriyal
0c979afc09 [build] Add the git cln to the lnav version. 2015-04-06 21:35:47 -07:00