Commit Graph

402 Commits

Author SHA1 Message Date
Timothy Stack
3167302722 [data-parser] fix some issues with parsing hierarchical data and improve the debugger 2016-04-28 23:34:13 -07:00
Suresh Sundriyal
88833c8035 [commands] Read and honor the 'LNAVSECURE' environment variable.
Read the value of the 'LNAVSECURE' environment variable upfront and
store it in the lnav_data structure. When this variable is set prior to
the binary execution, the following commands are disabled:

* 'open'
* 'pipe-to'
* 'pipe-line-to'
* 'write-*-to'

This is a proposed fix for tstack/lnav#305.
2016-04-23 10:34:17 -07:00
Timothy Stack
54b9c5ebf5 [parser] handle empty groups 2016-04-12 06:18:26 -07:00
Timothy Stack
2b76181fd6 [parser] try to handle apostrophes better 2016-04-11 08:39:16 -07:00
Timothy Stack
a8cd28097b [spectro] add some better error messages for the spectrogram command and fix some vtable glitches 2016-04-08 06:21:58 -07:00
Timothy Stack
23020e8a89 [test] missed setting TZ 2016-04-02 21:18:28 -07:00
Timothy Stack
4f05af6408 [time] add support for TAI64N timestamps
Fixes #300
2016-04-02 20:58:20 -07:00
Timothy Stack
a384e240f9 missed updating the makefile 2016-03-27 15:28:47 -07:00
Timothy Stack
afc8cc44b6 [json-format] support integer values for log levels in json formats 2016-03-27 15:14:52 -07:00
Timothy Stack
7a6429519f [summary-line] change error count to error rate and do some cleanup on message levels 2016-03-24 23:58:25 -07:00
Timothy Stack
13c90726a2 [tests] some more testing and stats for logfiles 2016-03-23 22:14:59 -07:00
Timothy Stack
e8f400abfa [logfile] truncation detection was not taking into account compressed files 2016-03-21 21:10:52 -07:00
Timothy Stack
fdc2748e3e [spectro] add a spectrogram view that works with known message fields 2016-03-20 15:15:50 -07:00
Timothy Stack
8de5d3b749 [logfile] add more options when opening files 2016-03-12 14:12:23 -08:00
Timothy Stack
4b318e45e0 [parser] some more parser tweaking and fix a jget() issue 2016-03-10 22:11:53 -08:00
Timothy Stack
2d04d047e4 [sql] change extract() to regexp_match() and make extract() an interface to the data_parser 2016-03-10 06:03:32 -08:00
Timothy Stack
d4a69cbf22 no joy
Revert "[sql] change extract() to regexp_match() and make extract() an interface to the data_parser"

This reverts commit 85eee6514b.
2016-03-09 23:30:34 -08:00
Timothy Stack
85eee6514b [sql] change extract() to regexp_match() and make extract() an interface to the data_parser 2016-03-09 23:14:54 -08:00
Timothy Stack
9feb53f02a [sql] add extract() function to extract values from a string using a regex
This function should be preferred over creating log search tables
for scripts.
2016-03-08 06:48:43 -08:00
Timothy Stack
cdd43549ab [cmds] automatically capture echo/write output from scripts so they can generate reports
Add another example script, dhclient-summary.

Add a 'search-table' section to formats so you can automatically
define a search-based table.
2016-03-06 23:58:37 -08:00
Timothy Stack
53e2d92eef [ui] highlight out-of-time-order messages in yellow with an underline 2016-03-03 06:05:26 -08:00
Timothy Stack
d12fe9e0a9 [json] add some schema validation code 2016-03-02 05:54:42 -08:00
Timothy Stack
89be76ef42 [filters] clear the state for filters that have been deleted
Fixes #292
2016-02-24 23:42:02 -08:00
Timothy Stack
68070678b5 try to fix test error 2016-01-05 06:41:33 -08:00
Timothy Stack
a2b381ca19 [config] initial impl with clock-format as the only option at the moment 2016-01-05 06:18:58 -08:00
Timothy Stack
e5f786bc2c [script] add metadata to script files 2015-12-28 20:30:04 -08:00
Timothy Stack
ab62d27757 [cmd] replace wordexp with shlex 2015-12-25 12:03:44 -08:00
Timothy Stack
16e988d132 [shlex] add a readline highlighter for shlex 2015-12-24 03:35:02 -08:00
Timothy Stack
6e196bff79 [line_buffer] clear cached data when doing a read 2015-12-22 22:44:42 -08:00
Timothy Stack
87b07a0087 [sql] allow log_part to be updated 2015-12-22 05:27:36 -08:00
Timothy Stack
2a10fa7d37 [build] some more build warnings 2015-12-20 13:40:25 -08:00
Timothy Stack
150590cfd6 [build] missing files from dist 2015-12-19 06:18:47 -08:00
Timothy Stack
6821bae882 fix one part of the build break 2015-12-18 22:54:32 -08:00
Timothy Stack
e07b4e448f [exec] add a prompt to execute lnav scripts 2015-12-18 22:39:27 -08:00
Timothy Stack
27f300b677 [sql] some more json-related updates/fixes 2015-12-09 21:20:49 -08:00
Timothy Stack
187d62334f [json] record the type of json data in json_ptr_walk 2015-12-08 23:10:48 -08:00
Timothy Stack
e987a5164f [hist] rewrite the histogram code 2015-12-08 22:46:10 -08:00
Timothy Stack
c874d95042 build fix 2015-12-05 22:17:27 -08:00
Timothy Stack
ba25c77b07 build stuff 2015-12-05 20:47:39 -08:00
Timothy Stack
224a7196e4 [cmd] hide lines commands 2015-12-05 20:38:21 -08:00
Timothy Stack
f3ca72f42d [jget] fix the jget function 2015-11-30 21:07:18 -08:00
Timothy Stack
5a718bc0ec [sql] missed checking for null in graphable columns 2015-11-29 20:10:40 -08:00
Timothy Stack
62075fb340 [sql] add json_group_object aggregate function 2015-11-29 19:56:10 -08:00
Timothy Stack
8964232374 [json] fixes for json log parsing
I was careless with the initial json log impl since it did not deal
with incomplete log lines very well.  This seems to fix some cases.
But, I was still able to replicate a lockup at one point, so it
might not be complete.
2015-11-27 12:47:42 -08:00
Timothy Stack
64cbab1281 [sql] exec .sql files in format dirs 2015-11-26 22:19:53 -08:00
Timothy Stack
65a4803955 [tests] some more test fixes 2015-11-15 06:25:08 -08:00
Timothy Stack
c0fc73d4ea [tests] fix test_sql.sh 2015-11-15 06:16:59 -08:00
Timothy Stack
3996eef593 use an empty file 2015-11-14 22:47:04 -08:00
Timothy Stack
3c9ba126a9 [glob] ignore files picked up by a glob that are not readable 2015-11-14 22:17:59 -08:00
Timothy Stack
6cb42fc690 the log_search table regex should be case-insensitive 2015-11-03 22:17:11 -08:00
Timothy Stack
7a476ca42d use a more reliable ip address for test 2015-10-21 07:12:50 -07:00
Timothy Stack
f11cca2366 [sql] add a timeslice() function 2015-10-03 14:58:01 -07:00
Timothy Stack
99d103cd58 [logline] add a log_msg_instance column to the table 2015-10-02 21:24:52 -07:00
Timothy Stack
4f32bddd93 [pt] allow relative times for papertrail time bounds 2015-09-14 23:32:05 -07:00
Timothy Stack
ec473edc85 [cmd] add support for times in goto 2015-09-14 08:56:42 -07:00
Timothy Stack
399c78d86d [pretty] pretty-print the contents of strings
Fixes #250
2015-08-26 21:28:30 -07:00
Timothy Stack
443053da62 [all_logs] add log_msg_schema hidden column to the all_logs table and refine the msg format 2015-08-26 09:41:45 -07:00
Timothy Stack
e95bd90dfc [filter] check for too many filters being created 2015-08-24 22:09:33 -07:00
Timothy Stack
feaff13b13 [data_parser] some fixes for the debugger and some parsing improvements 2015-08-21 06:48:05 -07:00
Timothy Stack
a3b417c2d5 fix timestamps in test 2015-08-19 21:15:34 -07:00
Timothy Stack
25a375f08d [misc] fix various bugs 2015-08-19 21:02:26 -07:00
Timothy Stack
0d37a8c142 [text] pretty-printing should work in the text view 2015-08-18 20:58:20 -07:00
Timothy Stack
1ad3966a95 [tests] add a couple more tests for the loader 2015-08-12 22:34:41 -07:00
Timothy Stack
bedae8c8c2 [fmt] install/update formats from git repos
Fixes #244
2015-08-09 21:03:23 -07:00
Timothy Stack
84c5db2e70 sigh, just remove the test sample to satisfy travis 2015-08-07 20:33:58 -07:00
Timothy Stack
c60b2c2ed6 try to fix the pcrepp test 2015-08-07 20:12:52 -07:00
Timothy Stack
9139e6de5b [search-table] guess the column types based on the regex 2015-08-07 20:04:28 -07:00
Timothy Stack
2b5447f59c [sql] add a log_search table 2015-08-05 23:18:19 -07:00
Timothy Stack
6f26aa7f3e [sql] multiline text was not returned correctly 2015-08-04 21:49:13 -07:00
Timothy Stack
f286950854 [curl] add a curl looper to handle url requests 2015-08-02 06:43:57 -07:00
Timothy Stack
b7d7fe70c7 [pretty] remove extraneous newline 2015-07-23 23:35:56 -07:00
Timothy Stack
d2d8c75135 [sql] add an lnav_views table 2015-07-22 07:09:51 -07:00
Timothy Stack
9496a960f6 [check] print the partial match of non-matching lines when checking a log file 2015-07-20 06:33:52 -07:00
Timothy Stack
27bb9bb2ee [fmt] highlight identifiers in module formats 2015-07-19 02:40:02 -07:00
Timothy Stack
7ef92dab79 [format] try to validate formats against a given file 2015-07-11 16:32:48 -07:00
Timothy Stack
054e8d489b [data-scanner] convert to using re2c 2015-06-08 06:27:45 -07:00
Timothy Stack
504b5747fe [sql] add an all_logs table that exposes the message format with values, like numbers, replaced with hashes 2015-06-03 06:36:58 -07:00
Timothy Stack
cec3d0cb72 [generic_log] add time format that includes zone 2015-05-17 05:15:41 -07:00
Timothy Stack
94459f2cb1 [generic_log] fix log levels for generic_log 2015-05-01 20:52:00 -07:00
Timothy Stack
b01b962ea7 [build] forgot to add some new data files 2015-04-26 07:12:30 -07:00
Timothy Stack
021b7cb3aa [test] add a test for nested json log formats 2015-04-26 04:57:36 -07:00
Timothy Stack
5a7c5a2139 [piper] the piper was not exiting if the stream it was reading did not terminate with a line feed 2015-04-21 22:25:54 -07:00
Suresh Sundriyal
5cd1da8e1a [pretty] More restrictive IPv4 regex.
The regular expression seems to match arbitrary version strings in
pretty-print view. Adding a more restrictive regular expression,
that should be able to distinguish between valid IPv4 addresses and
arbitrary version strings.
2015-04-19 00:00:43 -07:00
Suresh Sundriyal
ace51f0848 [build] Get rid of the sqlite3 dependency. 2015-04-16 00:28:31 -07:00
Suresh Sundriyal
9894db83be [test] Add tests for attaching to sqlite3 db.
* Test for attaching db when passed in through as a command line
  argument.
* Test for attaching db from within lnav.
2015-04-13 23:41:40 -07:00
Suresh Sundriyal
b2959ce6bd Revert "[build] Remove the build dependency on 'sqlite3' command-line tool."
This reverts commit ce7a32b587.
2015-04-12 16:39:03 -07:00
Suresh Sundriyal
ce7a32b587 [build] Remove the build dependency on 'sqlite3' command-line tool. 2015-04-12 00:24:51 -07:00
Timothy Stack
1c41731c33 remove -Werror=sign-compare for now since it's not supported on some older compilers 2015-04-11 11:31:07 -07:00
Suresh Sundriyal
d9a85507af [build] Fix the broken 'make distcheck' target. 2015-04-11 00:52:06 -07:00
Timothy Stack
245a3c3d1b [fmt] allow timestamp to be specified in the log format
Fixes #155
2015-04-10 22:55:57 -07:00
Timothy Stack
ae64b599bd [format] add more log levels and fix some more pretty-printer glitches
Fixes #212
2015-04-10 19:50:05 -07:00
Timothy Stack
e1874c0278 use poll instead of select so we can handle more than FD_SETSIZE files 2015-04-08 20:36:45 -07:00
Timothy Stack
66d258dd44 [test] use doc ip range 2015-04-08 20:01:20 -07:00
Timothy Stack
8a91c96bed [build] bump version to 0.7.3 since we will release soon 2015-04-08 02:26:25 -07:00
Timothy Stack
0b232a7588 [headless] multiline support for command files 2015-04-07 22:13:44 -07:00
Timothy Stack
269dfac33e [build] missed adding test file to makefile 2015-04-07 21:37:25 -07:00
Timothy Stack
2dfae4f7f9 [pretty] add some more tests and leave leading spaces alone in some cases 2015-04-07 21:25:01 -07:00
Timothy Stack
c58f44bb3f [headless] completely read stdin in headless mode before running commands 2015-04-06 02:53:53 -07:00
Suresh Sundriyal
c64ec91eb5 [build] Fix 'make distcheck'/package logfile_vami.0 2015-04-05 13:19:45 -07:00
Timothy Stack
7b8bc67cc9 [pretty] drop extra new lines 2015-04-05 11:59:14 -07:00
Timothy Stack
da73110578 Revert "Revert "[pretty-print] add a test for the pretty-printer""
This reverts commit 42b809427d.
2015-04-05 11:00:13 -07:00
Timothy Stack
a300ce9977 [format] order the formats based on sample matches 2015-04-05 07:12:20 -07:00
Suresh Sundriyal
05b408b568 [cleanup] Remove generated files and add to .gitignore.
- Remove the build generated files from the source tree.
  - This should take care of these files going out of sync or not be
    compatible with the version of autotools installed on users'
    machines.
- Add the generated files to .gitignore.
- Add a note in the installation instructions to run autogen.sh before
  running configure.
2015-04-05 02:43:54 -07:00
Suresh Sundriyal
7e3036cb86 [build] autogen 2015-04-05 01:39:14 -07:00
Suresh Sundriyal
fc91faaa00 Enable '-Werror' on the tests. 2015-04-05 00:34:36 -07:00
Suresh Sundriyal
bfee33b7fd Turn on 'sign-compare' error check for tests. 2015-04-05 00:23:25 -07:00
Timothy Stack
a0ccbc9872 [build] quiet a format warning 2015-04-04 16:32:14 -07:00
Suresh Sundriyal
89cc9e09fd [build] Fix 'make distcheck' 2015-04-04 15:17:57 -07:00
Timothy Stack
8d20474e42 set the timestamp for the syslog file 2015-04-04 14:06:32 -07:00
Timothy Stack
38e56b63ea [hist] fix the histogram when filters change 2015-04-04 13:36:53 -07:00
Timothy Stack
408c690192 [log] some more logging cleanup 2015-04-04 02:15:34 -07:00
Timothy Stack
f0f819b119 [log] dump more state on a crash 2015-04-04 02:15:34 -07:00
Suresh Sundriyal
e62172fb63 [-Wformat] Fix scripty.cc again.
Seems like timeval is defined differently on OS X than on Linux. So
fixing the format specifier on one breaks it on the other. Explicitly
cast the value being passed in to fix the problem on both the platforms.
2015-04-02 19:06:46 -07:00
Suresh Sundriyal
e359f8552a [-Wunused-result] Bunch of test files. 2015-04-02 13:44:27 -07:00
Suresh Sundriyal
c45496b593 [-Wformat] test/scripty.cc 2015-04-02 10:42:40 -07:00
Suresh Sundriyal
7d5ddc5994 [travis] Fix travis behavior.
Something seems to have changed in the travis infrastructure. It has
suddenly started complaining about 'test' usage in test_logfile.sh and
not printing out the test logs after the run.
2015-04-01 17:15:10 -07:00
Timothy Stack
033c861028 [cmd] next/prev-mark commands 2015-03-29 14:50:34 -07:00
Suresh Sundriyal
a46d33de2b [pretty print] Avoid extra new lines.
With the recent change to enable pretty print on all the log lines in
the current view, 'lnav' adds extra new lines between all the normal log
lines. This change removes the extra new lines.
2015-03-29 03:28:05 -07:00
Suresh Sundriyal
27b0a67168 [build] autogen 2015-03-29 01:23:57 -07:00
Suresh Sundriyal
707ccce9c0 [build] Stop readline macro from polluting the environment variables. 2015-03-29 01:19:51 -07:00
Tim Stack
fdcb75d198 Merge pull request #157 from sureshsundriyal/wip
Fix the tests when not compiled with bz2 support.
2015-03-28 12:11:03 -07:00
Timothy Stack
44d2e12403 [text] add filtering support to the plain text view
Fixes #149 #148
2015-03-28 06:30:30 -07:00
Suresh Sundriyal
94e3051257 [tests] Fix the conditional. 2015-03-28 02:32:59 -07:00
Suresh Sundriyal
521767eeb9 [build] autogen 2015-03-28 01:26:28 -07:00
Suresh Sundriyal
b371a680b3 [tests] Skip bzip2 tests if not compiled with bzip2. 2015-03-28 01:25:09 -07:00
Suresh Sundriyal
ed0baf7c1c [build] Add custom silent rules.
Add custom silent rules for ptime/bin2c/sqlite3/rm commands.
2015-03-25 03:03:34 -07:00
Timothy Stack
8fb15e455a [cmd] add a relative-goto command 2015-03-24 23:07:47 -07:00
Suresh Sundriyal
23e2d86421 [build] autogen run 2015-03-23 03:28:24 -07:00
Suresh Sundriyal
d1c267b0b1 [Warning] conversion from string literal to 'char *'
Fix the deprecation warning about conversion from string literal to
'char *' by implicitly casting the literal.
2015-03-21 13:11:26 -07:00
Timothy Stack
fa2ed5621d [build] autogen run 2015-03-20 20:32:40 -07:00
Timothy Stack
ff724e4941 [pipe-to] set env vars for each log line column 2015-03-19 22:16:55 -07:00
Timothy Stack
12b81fe4e7 [format] fix full message read for json formats 2015-03-18 22:57:30 -07:00
Timothy Stack
3e7063a522 [pretty-print] put closing curlys on their own line 2015-03-17 22:38:50 -07:00
Timothy Stack
42b809427d Revert "[pretty-print] add a test for the pretty-printer"
This reverts commit e0cec10445.
2015-03-16 23:51:36 -07:00
Timothy Stack
e0cec10445 [pretty-print] add a test for the pretty-printer 2015-03-16 23:44:05 -07:00
Timothy Stack
c670a86d04 [pretty-print] first pass at a pretty-printer
Defect Number:
    Reviewed By:
   Testing Done:
2015-03-16 23:10:34 -07:00
Timothy Stack
1d3481c3fa [cmd] add pipe-to and pipe-line-to commands 2015-03-16 09:16:49 -07:00
Timothy Stack
9ded31f647 display autotools version 2015-03-13 19:59:28 -07:00
Suresh Sundriyal
bd2ae532de Update the generated build files. 2015-03-12 00:55:40 -07:00
Timothy Stack
fad59bfaf1 [ptime] fix endianness and parsing issues 2015-03-09 06:30:12 -07:00
Timothy Stack
f54c9d41fc missing test file 2014-12-10 07:19:31 -08:00
Timothy Stack
c2e44c5998 [filter] fix for multiple filter-ins being applied 2014-12-10 07:03:01 -08:00
Timothy Stack
17db6e38fe add a lo-fi mode
Fixes #113
2014-11-11 08:44:44 -08:00
Timothy Stack
fc31831286 [vdsm_log] add new format 2014-11-10 08:56:35 -08:00
Timothy Stack
eef375c525 [build] cleanup a test file 2014-11-06 20:41:25 -08:00
Timothy Stack
04e5617553 [test] make the append file writable 2014-11-06 20:36:09 -08:00
Timothy Stack
a06d620018 [filter] add tests for filtering with append 2014-11-06 06:40:32 -08:00
Timothy Stack
671dca60dc [cmd] do not error out if filter exists, just enable it
Defect Number:
    Reviewed By:
   Testing Done:
2014-11-05 21:29:31 -08:00
Timothy Stack
c7cd0961ab [build] make dist fixes 2014-11-03 20:41:38 -08:00
Timothy Stack
0ab2400d2d [cmd] add a clear-highlight command
Defect Number: Fixes #109
    Reviewed By:
   Testing Done:
2014-10-29 20:53:23 -07:00