Commit Graph

443 Commits (7fe811da07768bcf6e90e51600f1d3d5baf43447)

Author SHA1 Message Date
Timothy Stack c0684a97cc [sql] add a regexp_capture tablue-valued function
Fixup the release makefile a bit.
7 years ago
Timothy Stack f6138662ae [test] update test for vtab change 7 years ago
Timothy Stack fa296fca1b [listview] get a batch of rows from the source instead of a single one at a time
Also: bump to c++14 and added a helper template for creating sqlite virtual tables
7 years ago
Timothy Stack 32c9dacd0a [files_vtab] add a vtable for opened files
Defect Number:
    Reviewed By:
   Testing Done:
7 years ago
Timothy Stack c180c44e49 [vtab] add an lnav_view_stack table to get programmatic access to the view stack
More progress towards #377
7 years ago
Timothy Stack 1a87184c82 [log] allow parts of log messages to be hidden
Fixes #412
7 years ago
Timothy Stack 89f8ef9c2b [hotkeys] hotkey configuration
First steps to implementing #350
8 years ago
Timothy Stack 04eda90244 [db] missed checking for a null progress callback
Fixes #404
8 years ago
Timothy Stack 0138d13297 [cmds] execute scripts from stdin/fds
Issues mentioned in #397
8 years ago
Timothy Stack d799cc227e some tweaks to these changes 8 years ago
Timothy Stack f567aafe3b [c++11] migration #1
Just a start
8 years ago
Timothy Stack 5e2d8842f2 forgot the actual file, sigh 8 years ago
Timothy Stack 93848faae7 add new file to dist 8 years ago
Timothy Stack 44d93dddc3 [pretty-print] allow formats to do transforms before pretty-printing
Also started upgrading to C++11.

Fixes #353
8 years ago
Timothy Stack 642a94e7b7 [open] check for FIFOs
Fixes #380
8 years ago
Timothy Stack fb4e66e0b5 [build] package logfile_epoch.1 8 years ago
Timothy Stack 1b8b773184 [tests] print logfile::error exception 8 years ago
Timothy Stack 6618fe1947 [build] test 8 years ago
Timothy Stack 26cd9f5930 [ptime] make sure the full time stamp is matched
Fixes #389
Fixes #390
8 years ago
Timothy Stack 592ee60693 [log] fix rewriting machine-oriented timestamps
Fixes #371
8 years ago
Timothy Stack 4712bb6f76 update test for json logs with objects/arrays 8 years ago
Timothy Stack a59e0b290e [format] allow json log fields to be hidden
Fixes #303
8 years ago
Timothy Stack b392886f0c [highlight] choose highlight color based on the regex
Defect Number:
    Reviewed By:
   Testing Done:
8 years ago
Timothy Stack 9f79dcc31a [format] point out the location of a pcre-compile error
Defect Number:
    Reviewed By:
   Testing Done:
8 years ago
Timothy Stack 41a2eed239 [pretty-print] fix printing of quoted strings that have escaped characters
Fixes #354
8 years ago
Timothy Stack 2e68f48a18 [hist] check for zoom with no logs
Fixes #346
8 years ago
Timothy Stack b216993760 [tests] missed a format file in the makefile 8 years ago
Timothy Stack 5539e21c05 [log-format] fix line-format where a variable can span lines
Fixes #337
8 years ago
Timothy Stack c05dfafae8 [log-format] abbreviate long fields when formatting JSON logs
Fixes #340
8 years ago
Timothy Stack 9ee18c26d3 [log-format] add min-width and align options to line-format
Also some fixes for validating the format definitions.

Fixes #338
8 years ago
Timothy Stack 41854cf637 [json-log] custom date formats
Fixes #341
8 years ago
Timothy Stack 8dbf018814 [loader] the loader was not converting the level name to the enum value correctly
Closes #329
8 years ago
Eli Young 5602af33f8 [fmt] Fix glog_log format
The log format used by glog uses spaces to left-pad the thread to 7
digits, per the code:

https://github.com/golang/glog/blob/65d6746/glog.go#L577

This fixes the regular expression to correctly match the extra
whitespace.
8 years ago
Tim Stack 91633d089f Merge pull request #320 from sureshsundriyal/db-attach
[secure-mode] Disallow ATTACH statements completely.
8 years ago
Suresh Sundriyal 6663740c5e [secure-mode] Disallow ATTACH statements completely.
The code to handle in-memory db exceptions is hideous and unreliable,
given the fact that SQLite does not expose much in terms of getting the
current value and the methods to check the compile time options can
themselves be disabled by a compile=time option in SQLite.

There really isn't much use for in-memory databases and if someone
really needs it, they can always choose to run in normal mode, so just
remove the extra code.
8 years ago
Tim Stack 1850c4f678 Merge pull request #318 from sureshsundriyal/db-attach
[secure-mode] Prevent users from attaching db files.
8 years ago
Timothy Stack 5ea5504aec [time] fix time rollover for days
Fixes #304
8 years ago
Timothy Stack a4deaa1e8b [spectro] log_time must be in ascending order 8 years ago
Suresh Sundriyal 1e6878164f [secure-mode] Refactoring and check for sqlite version.
'mode=memory' query parameter is only supported from sqlite3 version
3.8.0 onwards. Make sure to check for the version before continuing with
the 'ATTACH' statement.

Turning off some of the tests, since they fail on the Travis CI setup
which uses sqlite version 3.6.0.
8 years ago
Suresh Sundriyal e6c87678e9 [secure-mode] Prevent users from attaching db files.
Prevent the users from attaching an external db file which they may not
have ownership of.

The current authorizer method is hooked in only when the LNAVSECURE
variable is set. This is done deliberately, since the method will be
called on every sqlite query and I did not want to incur a performance
hit.

If the scope of this authorizer increases, we should consider passing in
the lnav_data as pUserData and do the checks inside the authorizer
itself.
8 years ago
Timothy Stack 82f970c09e [config] add a config option to control A_DIM for text
Fixes #298
8 years ago
Timothy Stack 3167302722 [data-parser] fix some issues with parsing hierarchical data and improve the debugger 8 years ago
Suresh Sundriyal 88833c8035 [commands] Read and honor the 'LNAVSECURE' environment variable.
Read the value of the 'LNAVSECURE' environment variable upfront and
store it in the lnav_data structure. When this variable is set prior to
the binary execution, the following commands are disabled:

* 'open'
* 'pipe-to'
* 'pipe-line-to'
* 'write-*-to'

This is a proposed fix for tstack/lnav#305.
8 years ago
Timothy Stack 54b9c5ebf5 [parser] handle empty groups 8 years ago
Timothy Stack 2b76181fd6 [parser] try to handle apostrophes better 8 years ago
Timothy Stack a8cd28097b [spectro] add some better error messages for the spectrogram command and fix some vtable glitches 8 years ago
Timothy Stack 23020e8a89 [test] missed setting TZ 8 years ago
Timothy Stack 4f05af6408 [time] add support for TAI64N timestamps
Fixes #300
8 years ago
Timothy Stack a384e240f9 missed updating the makefile 8 years ago
Timothy Stack afc8cc44b6 [json-format] support integer values for log levels in json formats 8 years ago
Timothy Stack 7a6429519f [summary-line] change error count to error rate and do some cleanup on message levels 8 years ago
Timothy Stack 13c90726a2 [tests] some more testing and stats for logfiles 8 years ago
Timothy Stack e8f400abfa [logfile] truncation detection was not taking into account compressed files 8 years ago
Timothy Stack fdc2748e3e [spectro] add a spectrogram view that works with known message fields 8 years ago
Timothy Stack 8de5d3b749 [logfile] add more options when opening files 8 years ago
Timothy Stack 4b318e45e0 [parser] some more parser tweaking and fix a jget() issue 8 years ago
Timothy Stack 2d04d047e4 [sql] change extract() to regexp_match() and make extract() an interface to the data_parser 8 years ago
Timothy Stack d4a69cbf22 no joy
Revert "[sql] change extract() to regexp_match() and make extract() an interface to the data_parser"

This reverts commit 85eee6514b.
8 years ago
Timothy Stack 85eee6514b [sql] change extract() to regexp_match() and make extract() an interface to the data_parser 8 years ago
Timothy Stack 9feb53f02a [sql] add extract() function to extract values from a string using a regex
This function should be preferred over creating log search tables
for scripts.
8 years ago
Timothy Stack cdd43549ab [cmds] automatically capture echo/write output from scripts so they can generate reports
Add another example script, dhclient-summary.

Add a 'search-table' section to formats so you can automatically
define a search-based table.
8 years ago
Timothy Stack 53e2d92eef [ui] highlight out-of-time-order messages in yellow with an underline 8 years ago
Timothy Stack d12fe9e0a9 [json] add some schema validation code 8 years ago
Timothy Stack 89be76ef42 [filters] clear the state for filters that have been deleted
Fixes #292
8 years ago
Timothy Stack 68070678b5 try to fix test error 9 years ago
Timothy Stack a2b381ca19 [config] initial impl with clock-format as the only option at the moment 9 years ago
Timothy Stack e5f786bc2c [script] add metadata to script files 9 years ago
Timothy Stack ab62d27757 [cmd] replace wordexp with shlex 9 years ago
Timothy Stack 16e988d132 [shlex] add a readline highlighter for shlex 9 years ago
Timothy Stack 6e196bff79 [line_buffer] clear cached data when doing a read 9 years ago
Timothy Stack 87b07a0087 [sql] allow log_part to be updated 9 years ago
Timothy Stack 2a10fa7d37 [build] some more build warnings 9 years ago
Timothy Stack 150590cfd6 [build] missing files from dist 9 years ago
Timothy Stack 6821bae882 fix one part of the build break 9 years ago
Timothy Stack e07b4e448f [exec] add a prompt to execute lnav scripts 9 years ago
Timothy Stack 27f300b677 [sql] some more json-related updates/fixes 9 years ago
Timothy Stack 187d62334f [json] record the type of json data in json_ptr_walk 9 years ago
Timothy Stack e987a5164f [hist] rewrite the histogram code 9 years ago
Timothy Stack c874d95042 build fix 9 years ago
Timothy Stack ba25c77b07 build stuff 9 years ago
Timothy Stack 224a7196e4 [cmd] hide lines commands 9 years ago
Timothy Stack f3ca72f42d [jget] fix the jget function 9 years ago
Timothy Stack 5a718bc0ec [sql] missed checking for null in graphable columns 9 years ago
Timothy Stack 62075fb340 [sql] add json_group_object aggregate function 9 years ago
Timothy Stack 8964232374 [json] fixes for json log parsing
I was careless with the initial json log impl since it did not deal
with incomplete log lines very well.  This seems to fix some cases.
But, I was still able to replicate a lockup at one point, so it
might not be complete.
9 years ago
Timothy Stack 64cbab1281 [sql] exec .sql files in format dirs 9 years ago
Timothy Stack 65a4803955 [tests] some more test fixes 9 years ago
Timothy Stack c0fc73d4ea [tests] fix test_sql.sh 9 years ago
Timothy Stack 3996eef593 use an empty file 9 years ago
Timothy Stack 3c9ba126a9 [glob] ignore files picked up by a glob that are not readable 9 years ago
Timothy Stack 6cb42fc690 the log_search table regex should be case-insensitive 9 years ago
Timothy Stack 7a476ca42d use a more reliable ip address for test 9 years ago
Timothy Stack f11cca2366 [sql] add a timeslice() function 9 years ago
Timothy Stack 99d103cd58 [logline] add a log_msg_instance column to the table 9 years ago
Timothy Stack 4f32bddd93 [pt] allow relative times for papertrail time bounds 9 years ago
Timothy Stack ec473edc85 [cmd] add support for times in goto 9 years ago
Timothy Stack 399c78d86d [pretty] pretty-print the contents of strings
Fixes #250
9 years ago
Timothy Stack 443053da62 [all_logs] add log_msg_schema hidden column to the all_logs table and refine the msg format 9 years ago
Timothy Stack e95bd90dfc [filter] check for too many filters being created 9 years ago
Timothy Stack feaff13b13 [data_parser] some fixes for the debugger and some parsing improvements 9 years ago
Timothy Stack a3b417c2d5 fix timestamps in test 9 years ago
Timothy Stack 25a375f08d [misc] fix various bugs 9 years ago
Timothy Stack 0d37a8c142 [text] pretty-printing should work in the text view 9 years ago
Timothy Stack 1ad3966a95 [tests] add a couple more tests for the loader 9 years ago
Timothy Stack bedae8c8c2 [fmt] install/update formats from git repos
Fixes #244
9 years ago
Timothy Stack 84c5db2e70 sigh, just remove the test sample to satisfy travis 9 years ago
Timothy Stack c60b2c2ed6 try to fix the pcrepp test 9 years ago
Timothy Stack 9139e6de5b [search-table] guess the column types based on the regex 9 years ago
Timothy Stack 2b5447f59c [sql] add a log_search table 9 years ago
Timothy Stack 6f26aa7f3e [sql] multiline text was not returned correctly 9 years ago
Timothy Stack f286950854 [curl] add a curl looper to handle url requests 9 years ago
Timothy Stack b7d7fe70c7 [pretty] remove extraneous newline 9 years ago
Timothy Stack d2d8c75135 [sql] add an lnav_views table 9 years ago
Timothy Stack 9496a960f6 [check] print the partial match of non-matching lines when checking a log file 9 years ago
Timothy Stack 27bb9bb2ee [fmt] highlight identifiers in module formats 9 years ago
Timothy Stack 7ef92dab79 [format] try to validate formats against a given file 9 years ago
Timothy Stack 054e8d489b [data-scanner] convert to using re2c 9 years ago
Timothy Stack 504b5747fe [sql] add an all_logs table that exposes the message format with values, like numbers, replaced with hashes 9 years ago
Timothy Stack cec3d0cb72 [generic_log] add time format that includes zone 9 years ago
Timothy Stack 94459f2cb1 [generic_log] fix log levels for generic_log 9 years ago
Timothy Stack b01b962ea7 [build] forgot to add some new data files 9 years ago
Timothy Stack 021b7cb3aa [test] add a test for nested json log formats 9 years ago
Timothy Stack 5a7c5a2139 [piper] the piper was not exiting if the stream it was reading did not terminate with a line feed 9 years ago
Suresh Sundriyal 5cd1da8e1a [pretty] More restrictive IPv4 regex.
The regular expression seems to match arbitrary version strings in
pretty-print view. Adding a more restrictive regular expression,
that should be able to distinguish between valid IPv4 addresses and
arbitrary version strings.
9 years ago
Suresh Sundriyal ace51f0848 [build] Get rid of the sqlite3 dependency. 9 years ago
Suresh Sundriyal 9894db83be [test] Add tests for attaching to sqlite3 db.
* Test for attaching db when passed in through as a command line
  argument.
* Test for attaching db from within lnav.
9 years ago
Suresh Sundriyal b2959ce6bd Revert "[build] Remove the build dependency on 'sqlite3' command-line tool."
This reverts commit ce7a32b587.
9 years ago
Suresh Sundriyal ce7a32b587 [build] Remove the build dependency on 'sqlite3' command-line tool. 9 years ago
Timothy Stack 1c41731c33 remove -Werror=sign-compare for now since it's not supported on some older compilers 9 years ago
Suresh Sundriyal d9a85507af [build] Fix the broken 'make distcheck' target. 9 years ago
Timothy Stack 245a3c3d1b [fmt] allow timestamp to be specified in the log format
Fixes #155
9 years ago
Timothy Stack ae64b599bd [format] add more log levels and fix some more pretty-printer glitches
Fixes #212
9 years ago
Timothy Stack e1874c0278 use poll instead of select so we can handle more than FD_SETSIZE files 9 years ago
Timothy Stack 66d258dd44 [test] use doc ip range 9 years ago
Timothy Stack 8a91c96bed [build] bump version to 0.7.3 since we will release soon 9 years ago
Timothy Stack 0b232a7588 [headless] multiline support for command files 9 years ago
Timothy Stack 269dfac33e [build] missed adding test file to makefile 9 years ago
Timothy Stack 2dfae4f7f9 [pretty] add some more tests and leave leading spaces alone in some cases 9 years ago
Timothy Stack c58f44bb3f [headless] completely read stdin in headless mode before running commands 9 years ago
Suresh Sundriyal c64ec91eb5 [build] Fix 'make distcheck'/package logfile_vami.0 9 years ago
Timothy Stack 7b8bc67cc9 [pretty] drop extra new lines 9 years ago
Timothy Stack da73110578 Revert "Revert "[pretty-print] add a test for the pretty-printer""
This reverts commit 42b809427d.
9 years ago
Timothy Stack a300ce9977 [format] order the formats based on sample matches 9 years ago
Suresh Sundriyal 05b408b568 [cleanup] Remove generated files and add to .gitignore.
- Remove the build generated files from the source tree.
  - This should take care of these files going out of sync or not be
    compatible with the version of autotools installed on users'
    machines.
- Add the generated files to .gitignore.
- Add a note in the installation instructions to run autogen.sh before
  running configure.
9 years ago
Suresh Sundriyal 7e3036cb86 [build] autogen 9 years ago
Suresh Sundriyal fc91faaa00 Enable '-Werror' on the tests. 9 years ago
Suresh Sundriyal bfee33b7fd Turn on 'sign-compare' error check for tests. 9 years ago
Timothy Stack a0ccbc9872 [build] quiet a format warning 9 years ago
Suresh Sundriyal 89cc9e09fd [build] Fix 'make distcheck' 9 years ago
Timothy Stack 8d20474e42 set the timestamp for the syslog file 9 years ago