Commit Graph

475 Commits (6cf5cc82134b583a9e58e7185b38834b401ed8ba)

Author SHA1 Message Date
Timothy Stack 283293e019 [tests] update expected output for default colors change 7 years ago
Timothy Stack 485a931793 [headless] always switch to the DB view after executing a SQL command, even if the result set is empty 7 years ago
Timothy Stack 5e4ca5bbed [test] comment out mvwattrline test for now 7 years ago
Timothy Stack 753e12d606 [unicode] do not clobber wide chars when applying attributes
Attempt to address #414
7 years ago
Timothy Stack a9fd0e37f6 [formats] add rfc5424 syslog format
Fixes #444
7 years ago
Timothy Stack 9d249004ac [time-offset] add days to offset
Fixes #435
7 years ago
Timothy Stack 6306659362 [test] remove extra test 7 years ago
Timothy Stack ef5347b0eb [build] even more 7 years ago
Timothy Stack 4fb6e24be9 [build] one more time 7 years ago
Timothy Stack c3688e87f7 [build] fix some tests
Defect Number:
    Reviewed By:
   Testing Done:
7 years ago
Timothy Stack 36e46fc67b [log] do a full sort if there is a year rollover
Fixes #437
7 years ago
Timothy Stack 7f5916d480 [crash] call endwin() after a crash
Fixes #438
7 years ago
Timothy Stack 9764cb1a93 [loader] add line numbers for parse errors
Fixes #442
7 years ago
Timothy Stack f0c884ddc3 [build] another bro log test fix 7 years ago
Timothy Stack 867504b2b5 [build] try to fix some tests
Defect Number:
    Reviewed By:
   Testing Done:
7 years ago
Timothy Stack 8ea51a6fd8 [formats] support for CSV/TSV log formats
Defect Number:
    Reviewed By:
   Testing Done:
7 years ago
Timothy Stack 16fd7ec785 [help] remove old command help and add some more filesystem extensions 7 years ago
Timothy Stack 5e8d6aa3a8 [session] add hidden fields to the session
Fixes #433
7 years ago
Timothy Stack 5016ea9e71 [help] fix a help text issue 7 years ago
Timothy Stack 4cedde9a43 [help] add builtin help to the main help text as a reference
Defect Number:
    Reviewed By:
   Testing Done:
7 years ago
Timothy Stack a973f7f934 [misc] some more miscellaneous bugs
Defect Number:
    Reviewed By:
   Testing Done:
7 years ago
Timothy Stack aa21234164 [hist] need to rebuild hist to reflect marks
Defect Number:
    Reviewed By:
   Testing Done:
7 years ago
Timothy Stack 035460eb61 update expected output 7 years ago
Timothy Stack 407c5c67b1 [build] missed some new files 7 years ago
Timothy Stack df399a36a4 [docs] some more docs, command-help, and tests for #428 7 years ago
Timothy Stack 04e60fd79d [build] sign warnings 7 years ago
Timothy Stack 78119dc9f1 fixing some minor issues
Fixes #255
7 years ago
Timothy Stack 411ea1fbee [help] show help text for SQL functions
Defect Number:
    Reviewed By:
   Testing Done:
7 years ago
Timothy Stack cd76eae5b8 [build] convert some C files to C++
Defect Number:
    Reviewed By:
   Testing Done:
7 years ago
Timothy Stack 6fcfd35395 [sql] add "search" column to the lnav_views table
Fixes #388
7 years ago
Timothy Stack 8776f6a703 [sql] do some minimal parsing/annotation of SQL statements
Defect Number:
    Reviewed By:
   Testing Done:
7 years ago
Timothy Stack 0b157ff867 [sql] add function adapter template
Defect Number:
    Reviewed By:
   Testing Done:
7 years ago
Timothy Stack c0684a97cc [sql] add a regexp_capture tablue-valued function
Fixup the release makefile a bit.
7 years ago
Timothy Stack f6138662ae [test] update test for vtab change 7 years ago
Timothy Stack fa296fca1b [listview] get a batch of rows from the source instead of a single one at a time
Also: bump to c++14 and added a helper template for creating sqlite virtual tables
7 years ago
Timothy Stack 32c9dacd0a [files_vtab] add a vtable for opened files
Defect Number:
    Reviewed By:
   Testing Done:
7 years ago
Timothy Stack c180c44e49 [vtab] add an lnav_view_stack table to get programmatic access to the view stack
More progress towards #377
7 years ago
Timothy Stack 1a87184c82 [log] allow parts of log messages to be hidden
Fixes #412
7 years ago
Timothy Stack 89f8ef9c2b [hotkeys] hotkey configuration
First steps to implementing #350
8 years ago
Timothy Stack 04eda90244 [db] missed checking for a null progress callback
Fixes #404
8 years ago
Timothy Stack 0138d13297 [cmds] execute scripts from stdin/fds
Issues mentioned in #397
8 years ago
Timothy Stack d799cc227e some tweaks to these changes 8 years ago
Timothy Stack f567aafe3b [c++11] migration #1
Just a start
8 years ago
Timothy Stack 5e2d8842f2 forgot the actual file, sigh 8 years ago
Timothy Stack 93848faae7 add new file to dist 8 years ago
Timothy Stack 44d93dddc3 [pretty-print] allow formats to do transforms before pretty-printing
Also started upgrading to C++11.

Fixes #353
8 years ago
Timothy Stack 642a94e7b7 [open] check for FIFOs
Fixes #380
8 years ago
Timothy Stack fb4e66e0b5 [build] package logfile_epoch.1 8 years ago
Timothy Stack 1b8b773184 [tests] print logfile::error exception 8 years ago
Timothy Stack 6618fe1947 [build] test 8 years ago
Timothy Stack 26cd9f5930 [ptime] make sure the full time stamp is matched
Fixes #389
Fixes #390
8 years ago
Timothy Stack 592ee60693 [log] fix rewriting machine-oriented timestamps
Fixes #371
8 years ago
Timothy Stack 4712bb6f76 update test for json logs with objects/arrays 8 years ago
Timothy Stack a59e0b290e [format] allow json log fields to be hidden
Fixes #303
8 years ago
Timothy Stack b392886f0c [highlight] choose highlight color based on the regex
Defect Number:
    Reviewed By:
   Testing Done:
8 years ago
Timothy Stack 9f79dcc31a [format] point out the location of a pcre-compile error
Defect Number:
    Reviewed By:
   Testing Done:
8 years ago
Timothy Stack 41a2eed239 [pretty-print] fix printing of quoted strings that have escaped characters
Fixes #354
8 years ago
Timothy Stack 2e68f48a18 [hist] check for zoom with no logs
Fixes #346
8 years ago
Timothy Stack b216993760 [tests] missed a format file in the makefile 8 years ago
Timothy Stack 5539e21c05 [log-format] fix line-format where a variable can span lines
Fixes #337
8 years ago
Timothy Stack c05dfafae8 [log-format] abbreviate long fields when formatting JSON logs
Fixes #340
8 years ago
Timothy Stack 9ee18c26d3 [log-format] add min-width and align options to line-format
Also some fixes for validating the format definitions.

Fixes #338
8 years ago
Timothy Stack 41854cf637 [json-log] custom date formats
Fixes #341
8 years ago
Timothy Stack 8dbf018814 [loader] the loader was not converting the level name to the enum value correctly
Closes #329
8 years ago
Eli Young 5602af33f8 [fmt] Fix glog_log format
The log format used by glog uses spaces to left-pad the thread to 7
digits, per the code:

https://github.com/golang/glog/blob/65d6746/glog.go#L577

This fixes the regular expression to correctly match the extra
whitespace.
8 years ago
Tim Stack 91633d089f Merge pull request #320 from sureshsundriyal/db-attach
[secure-mode] Disallow ATTACH statements completely.
8 years ago
Suresh Sundriyal 6663740c5e [secure-mode] Disallow ATTACH statements completely.
The code to handle in-memory db exceptions is hideous and unreliable,
given the fact that SQLite does not expose much in terms of getting the
current value and the methods to check the compile time options can
themselves be disabled by a compile=time option in SQLite.

There really isn't much use for in-memory databases and if someone
really needs it, they can always choose to run in normal mode, so just
remove the extra code.
8 years ago
Tim Stack 1850c4f678 Merge pull request #318 from sureshsundriyal/db-attach
[secure-mode] Prevent users from attaching db files.
8 years ago
Timothy Stack 5ea5504aec [time] fix time rollover for days
Fixes #304
8 years ago
Timothy Stack a4deaa1e8b [spectro] log_time must be in ascending order 8 years ago
Suresh Sundriyal 1e6878164f [secure-mode] Refactoring and check for sqlite version.
'mode=memory' query parameter is only supported from sqlite3 version
3.8.0 onwards. Make sure to check for the version before continuing with
the 'ATTACH' statement.

Turning off some of the tests, since they fail on the Travis CI setup
which uses sqlite version 3.6.0.
8 years ago
Suresh Sundriyal e6c87678e9 [secure-mode] Prevent users from attaching db files.
Prevent the users from attaching an external db file which they may not
have ownership of.

The current authorizer method is hooked in only when the LNAVSECURE
variable is set. This is done deliberately, since the method will be
called on every sqlite query and I did not want to incur a performance
hit.

If the scope of this authorizer increases, we should consider passing in
the lnav_data as pUserData and do the checks inside the authorizer
itself.
8 years ago
Timothy Stack 82f970c09e [config] add a config option to control A_DIM for text
Fixes #298
8 years ago
Timothy Stack 3167302722 [data-parser] fix some issues with parsing hierarchical data and improve the debugger 8 years ago
Suresh Sundriyal 88833c8035 [commands] Read and honor the 'LNAVSECURE' environment variable.
Read the value of the 'LNAVSECURE' environment variable upfront and
store it in the lnav_data structure. When this variable is set prior to
the binary execution, the following commands are disabled:

* 'open'
* 'pipe-to'
* 'pipe-line-to'
* 'write-*-to'

This is a proposed fix for tstack/lnav#305.
8 years ago
Timothy Stack 54b9c5ebf5 [parser] handle empty groups 8 years ago
Timothy Stack 2b76181fd6 [parser] try to handle apostrophes better 8 years ago
Timothy Stack a8cd28097b [spectro] add some better error messages for the spectrogram command and fix some vtable glitches 8 years ago
Timothy Stack 23020e8a89 [test] missed setting TZ 8 years ago
Timothy Stack 4f05af6408 [time] add support for TAI64N timestamps
Fixes #300
8 years ago
Timothy Stack a384e240f9 missed updating the makefile 8 years ago
Timothy Stack afc8cc44b6 [json-format] support integer values for log levels in json formats 8 years ago
Timothy Stack 7a6429519f [summary-line] change error count to error rate and do some cleanup on message levels 8 years ago
Timothy Stack 13c90726a2 [tests] some more testing and stats for logfiles 8 years ago
Timothy Stack e8f400abfa [logfile] truncation detection was not taking into account compressed files 8 years ago
Timothy Stack fdc2748e3e [spectro] add a spectrogram view that works with known message fields 8 years ago
Timothy Stack 8de5d3b749 [logfile] add more options when opening files 8 years ago
Timothy Stack 4b318e45e0 [parser] some more parser tweaking and fix a jget() issue 8 years ago
Timothy Stack 2d04d047e4 [sql] change extract() to regexp_match() and make extract() an interface to the data_parser 8 years ago
Timothy Stack d4a69cbf22 no joy
Revert "[sql] change extract() to regexp_match() and make extract() an interface to the data_parser"

This reverts commit 85eee6514b.
8 years ago
Timothy Stack 85eee6514b [sql] change extract() to regexp_match() and make extract() an interface to the data_parser 8 years ago
Timothy Stack 9feb53f02a [sql] add extract() function to extract values from a string using a regex
This function should be preferred over creating log search tables
for scripts.
8 years ago
Timothy Stack cdd43549ab [cmds] automatically capture echo/write output from scripts so they can generate reports
Add another example script, dhclient-summary.

Add a 'search-table' section to formats so you can automatically
define a search-based table.
8 years ago
Timothy Stack 53e2d92eef [ui] highlight out-of-time-order messages in yellow with an underline 8 years ago
Timothy Stack d12fe9e0a9 [json] add some schema validation code 8 years ago
Timothy Stack 89be76ef42 [filters] clear the state for filters that have been deleted
Fixes #292
8 years ago
Timothy Stack 68070678b5 try to fix test error 9 years ago
Timothy Stack a2b381ca19 [config] initial impl with clock-format as the only option at the moment 9 years ago
Timothy Stack e5f786bc2c [script] add metadata to script files 9 years ago
Timothy Stack ab62d27757 [cmd] replace wordexp with shlex 9 years ago
Timothy Stack 16e988d132 [shlex] add a readline highlighter for shlex 9 years ago
Timothy Stack 6e196bff79 [line_buffer] clear cached data when doing a read 9 years ago
Timothy Stack 87b07a0087 [sql] allow log_part to be updated 9 years ago
Timothy Stack 2a10fa7d37 [build] some more build warnings 9 years ago
Timothy Stack 150590cfd6 [build] missing files from dist 9 years ago
Timothy Stack 6821bae882 fix one part of the build break 9 years ago
Timothy Stack e07b4e448f [exec] add a prompt to execute lnav scripts 9 years ago
Timothy Stack 27f300b677 [sql] some more json-related updates/fixes 9 years ago
Timothy Stack 187d62334f [json] record the type of json data in json_ptr_walk 9 years ago
Timothy Stack e987a5164f [hist] rewrite the histogram code 9 years ago
Timothy Stack c874d95042 build fix 9 years ago
Timothy Stack ba25c77b07 build stuff 9 years ago
Timothy Stack 224a7196e4 [cmd] hide lines commands 9 years ago
Timothy Stack f3ca72f42d [jget] fix the jget function 9 years ago
Timothy Stack 5a718bc0ec [sql] missed checking for null in graphable columns 9 years ago
Timothy Stack 62075fb340 [sql] add json_group_object aggregate function 9 years ago
Timothy Stack 8964232374 [json] fixes for json log parsing
I was careless with the initial json log impl since it did not deal
with incomplete log lines very well.  This seems to fix some cases.
But, I was still able to replicate a lockup at one point, so it
might not be complete.
9 years ago
Timothy Stack 64cbab1281 [sql] exec .sql files in format dirs 9 years ago
Timothy Stack 65a4803955 [tests] some more test fixes 9 years ago
Timothy Stack c0fc73d4ea [tests] fix test_sql.sh 9 years ago
Timothy Stack 3996eef593 use an empty file 9 years ago
Timothy Stack 3c9ba126a9 [glob] ignore files picked up by a glob that are not readable 9 years ago
Timothy Stack 6cb42fc690 the log_search table regex should be case-insensitive 9 years ago
Timothy Stack 7a476ca42d use a more reliable ip address for test 9 years ago
Timothy Stack f11cca2366 [sql] add a timeslice() function 9 years ago
Timothy Stack 99d103cd58 [logline] add a log_msg_instance column to the table 9 years ago
Timothy Stack 4f32bddd93 [pt] allow relative times for papertrail time bounds 9 years ago
Timothy Stack ec473edc85 [cmd] add support for times in goto 9 years ago
Timothy Stack 399c78d86d [pretty] pretty-print the contents of strings
Fixes #250
9 years ago
Timothy Stack 443053da62 [all_logs] add log_msg_schema hidden column to the all_logs table and refine the msg format 9 years ago
Timothy Stack e95bd90dfc [filter] check for too many filters being created 9 years ago
Timothy Stack feaff13b13 [data_parser] some fixes for the debugger and some parsing improvements 9 years ago
Timothy Stack a3b417c2d5 fix timestamps in test 9 years ago
Timothy Stack 25a375f08d [misc] fix various bugs 9 years ago
Timothy Stack 0d37a8c142 [text] pretty-printing should work in the text view 9 years ago
Timothy Stack 1ad3966a95 [tests] add a couple more tests for the loader 9 years ago
Timothy Stack bedae8c8c2 [fmt] install/update formats from git repos
Fixes #244
9 years ago
Timothy Stack 84c5db2e70 sigh, just remove the test sample to satisfy travis 9 years ago
Timothy Stack c60b2c2ed6 try to fix the pcrepp test 9 years ago
Timothy Stack 9139e6de5b [search-table] guess the column types based on the regex 9 years ago
Timothy Stack 2b5447f59c [sql] add a log_search table 9 years ago
Timothy Stack 6f26aa7f3e [sql] multiline text was not returned correctly 9 years ago
Timothy Stack f286950854 [curl] add a curl looper to handle url requests 9 years ago
Timothy Stack b7d7fe70c7 [pretty] remove extraneous newline 9 years ago
Timothy Stack d2d8c75135 [sql] add an lnav_views table 9 years ago
Timothy Stack 9496a960f6 [check] print the partial match of non-matching lines when checking a log file 9 years ago
Timothy Stack 27bb9bb2ee [fmt] highlight identifiers in module formats 9 years ago
Timothy Stack 7ef92dab79 [format] try to validate formats against a given file 9 years ago
Timothy Stack 054e8d489b [data-scanner] convert to using re2c 9 years ago
Timothy Stack 504b5747fe [sql] add an all_logs table that exposes the message format with values, like numbers, replaced with hashes 9 years ago