Archives/lnav
2
0
Fork 0
mirror of https://github.com/tstack/lnav synced 2024-11-19 15:25:34 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,985 Commits 4 Branches 71 Tags 35 MiB
5d4f08b1b4
Commit Graph

601 Commits

Author SHA1 Message Date
Timothy Stack
07f4b56646 [tests] update some expected results 
so lazy...
 2020-01-17 05:43:15 -08:00
Timothy Stack
e525d247ae [json-log] some more fixes for handling invalid json logs 2019-10-19 07:11:47 -07:00
Timothy Stack
8b750c83f1 update expected output 2019-09-11 08:12:56 -07:00
Timothy Stack
98519b045a [help] mention hide/show-unmarked-lines 
Fixes #631
 2019-09-10 05:50:10 -07:00
Timothy Stack
b7255419e6 [test] fix sed usage 
Fixes #572
 2019-09-10 05:39:34 -07:00
Timothy Stack
9d6e6e4638 [build] fix a typo 2019-09-09 22:10:50 -07:00
Timothy Stack
27587ee917 [test] get test working on OS X 2019-09-09 21:47:41 -07:00
Tim Stack
b2463e44a3
Merge pull request #677 from phord/gzip-index 
Add a gzip indexing class for faster gz navigation
 2019-09-09 21:35:44 -07:00
Timothy Stack
f11364660d [build] missed file in makefile 2019-09-03 07:27:24 -07:00
Timothy Stack
73e902f7d8 [json-log] handle invalid json log lines 
Header from folded patch 'foldme1.patch':

[local] foldme
 2019-09-03 06:19:57 -07:00
Phil Hord
5513deeade Add a gzip indexing class for faster gz navigation 
The gzread function is slow.  Every time you seek to a new location, the
whole file up to that position has to be decompressed again.  This causes
massive lags when trying to do simple things in lnav on a large .gz file.

Use the zlib inflate* functions instead and record the dictionary
periodically while processing the file the first time.  Then use
inflateSetDictionary to restore the dictionary to a convenient
location when trying to seek into the file again in the future.

Use a default period of 1MB of compressed data for syncpoints.
Each syncpoint uses 32KB. This is a ratio of 3.2%.  For example,
a 1GB .gz file (compressed size) will require us to keep 32MB
of index data in memory. A better method may be to use a fixed
number of syncpoints and divide the file appropriately. This
would keep the memory bounded at the cost of slower file
navigation on large .gz files.

Use pread to read the data for the stream decompressor and remove
the lock_hack previously employed.

NB. The documentation on these zlib functions is sparse. I followed
the example in zlib/examples/zran.c, but I used the z_stream total_in
and total_out variables instead of keeping my own separately as zran.c
does.  Maybe this is incompatible with some very old zlib versions.
I haven't looked.
 2019-08-17 18:40:55 -07:00
Timothy Stack
585986057d [build] missed cleaning a dir up 2019-08-10 21:59:43 -07:00
Timothy Stack
56a341f7f8 [view_curses] colors 
Defect Number:
    Reviewed By:
   Testing Done:
 2019-08-07 09:46:19 -07:00
Timothy Stack
9a05b9d186 [config] pay attention to XDG_CONFIG_HOME 
Fixes #105
 2019-08-01 07:14:47 -07:00
Timothy Stack
e442f84e80 [textview] pause loading of files by pressing = 
Fixes #670
 2019-07-30 06:28:42 -07:00
Timothy Stack
63dba408ec [stdin] Keep the stdin piper file in .lnav so that it can be reopened 
When piping the output of a program into lnav, the data would
be dumped to the terminal on exit so that it would not be
lost.  Since that is a bit noisy, the temp file used to store
the data is now left in .lnav so that it can be reopened later.
Older stdin captures are automatically removed after a day.

Also took the opportunity to start using filesystem::path more.

Fixes #436
 2019-07-29 22:18:32 -07:00
Timothy Stack
ffd9d88add [log_format] ignore line-format field if timestamp-format is set 
Fixes #661
 2019-07-26 01:16:37 -07:00
Timothy Stack
34db64aa32 [logfile] the index rebuild didn't check the mtime if the file size was the same 
Fixes #668
 2019-07-25 07:31:46 -07:00
Timothy Stack
7c485f64dc [cmake] fix some test targets 2019-07-15 10:08:14 -07:00
Timothy Stack
1257fcd62a [codacy] fix a few issues turned up 2019-07-11 14:59:54 -07:00
Timothy Stack
325e4a15d9 [build] test out the hunter package manager 2019-07-09 08:34:55 -07:00
Timothy Stack
76edd2a9d1 [line_buffer] refactor left a bug with non-blocking files 
Fixes #662
 2019-06-27 10:19:54 -07:00
Timothy Stack
b81b35c866 [log-view] in time-offset mode, show negative times for messages before the first mark 
Prototype for #395
 2019-06-26 21:52:40 -07:00
Timothy Stack
d61f2568d6 [ptimec] fix a case of undefined behavior 2019-06-21 17:19:56 -07:00
Timothy Stack
a10fa06b10 [build] remove test file 2019-06-15 06:48:33 -07:00
Timothy Stack
02c53976b4 Some refactoring for the line buffer and other cleanups 
Fixes #649
 2019-06-15 06:32:02 -07:00
Timothy Stack
6cf5cc8213 [logfile] fix issue when files have headers 
Defect Number:
    Reviewed By:
   Testing Done:
 2019-05-17 07:42:05 -07:00
Timothy Stack
1fc24ecabf [bin2c] improve building of data files that are incorporated into the binary 2019-05-15 09:13:56 -07:00
Timothy Stack
c7046b0b54 [json] newlines in the line format cause problems 
Fixes #644
 2019-05-13 10:44:33 -07:00
Timothy Stack
76b08f5fe3 [build] fix other lib order 2019-05-08 09:11:22 -07:00
Timothy Stack
fb7d6eafaf [build] some refactoring of files 2019-05-08 05:30:59 -07:00
Timothy Stack
63e53377c3 [theme] add monocai theme 2019-05-04 10:35:23 -07:00
Timothy Stack
a8e1f62da6 [build] add fmt lib 2019-05-04 07:07:39 -07:00
Timothy Stack
fc9f9f43cf add bad-config to the dist 2019-05-03 14:29:27 -07:00
Timothy Stack
06d1098211 [config] initial support for themes 
For #422

Still more to do
 2019-05-03 13:50:19 -07:00
Timothy Stack
6f451eec35 [pretty] fix crash when rewriting lines 2019-04-18 04:26:24 -07:00
Timothy Stack
5e8a1cebe9 [json-log] handle arrays in json log message fields 
Fixes #635
 2019-04-17 06:17:11 -07:00
Timothy Stack
062d480fea [sql] fix some issues found while trying to query some logs 2019-03-21 07:46:51 -07:00
Timothy Stack
2fa603d07e [tests] fix a test 2019-03-15 22:38:10 -07:00
Timothy Stack
78d80fddd5 [cli] add -r flag for recursively loading files from a directory hierarchy 
Fixes #431
 2019-03-14 22:24:57 -07:00
Timothy Stack
33cdbefaaa [help] some online help additions 2019-03-13 23:07:39 -07:00
Timothy Stack
21c5c52843 [format] allow multiple log format patterns per log file 
This tries to address #624
 2019-03-13 16:37:41 -07:00
Timothy Stack
0e12f98ae7 [sql] change base_time to time_offset 2019-03-12 22:41:39 -07:00
Timothy Stack
469124d72b [time-offset] fixes 
Defect Number:
    Reviewed By:
   Testing Done:
 2019-03-12 07:06:31 -07:00
Timothy Stack
4614cbcb75 [sql] fix joins on some vtables 2019-02-18 14:44:59 -08:00
Timothy Stack
43243c7ba3 [build] revive freebsd release build 
Some misc fixes for filtering as well
 2019-02-17 07:40:35 -08:00
Timothy Stack
02b9e13343 [filters] add the number of hits for each filter in the editor 
Might be useful to know the number of hits for a given filter.
 2019-02-15 09:22:32 -08:00
Timothy Stack
659f01c9ae [filters] add a log_filters column to log tables that contains the matched filters 
Related to #597
 2019-02-14 22:42:44 -08:00
Timothy Stack
153b59ea8a [status] some fixes for the bottom status bar 
Fixes #603
Fixes #578
 2019-02-05 07:30:57 -08:00
Timothy Stack
104b8736e8 [vtab] fix for failed update to log_tags column and fix filtering with json logs 2019-02-01 13:31:28 -08:00
Timothy Stack
3d77fb2acf [cmds] change :write-raw-to to write all the lines in the view 
Fixes #606
 2019-01-29 07:30:37 -08:00
Timothy Stack
31c440777f [hotkeys] add ctrl+f to toggle filters 
Fixes #604
 2019-01-27 08:05:44 -08:00
Timothy Stack
0c2f84a3c0 [hotkeys] press 7/8 for previous/next minute 
Fixes #382
 2019-01-25 07:45:17 -08:00
Timothy Stack
5fff4d8784 [help] add some initial help text for search/SQL prompts 
Also:
  * You can now "scroll out" of the visual editor to
    return to the main view.  This should alleviate the
    frustration of pressing up/down arrows thinking the
    main view should move but, really, you're stuck in
    the editor.
  * The three-dot-ellipsis for hidden fields has been
    replaced with a unicode vertical ellipsis so that
    less space is taken up.
 2019-01-24 22:05:15 -08:00
Timothy Stack
dcccebe797 [sql] add some help for regexp_capture() 
Fixes #593
 2019-01-13 19:02:50 -08:00
Timothy Stack
7dfa0e9dd4 [textview] highlights that start from the beginning of the line are not working in the log view 
The log view prefixes lines with some extra characters and they
were mistakenly being included when performing the highlight
regex.

Fixes #590
 2019-01-01 08:24:02 -08:00
Timothy Stack
a63b6a199c [filter] in the filter editor, use "t" to toggle the type of filter 
Related to #423
 2018-12-14 07:10:50 -08:00
Timothy Stack
814ad03ec9 [view] keep a history of view positions 
Fixes #577
 2018-12-14 06:18:56 -08:00
Timothy Stack
e001b49e28 [format] hidden object/array fields add sub-lines when they should not 
Fixes #576
 2018-11-26 10:30:27 -08:00
Timothy Stack
1a08eb0d12 [cmds] allow commands to set the prompt 
Fixes #574 and #573
 2018-11-21 17:00:28 -08:00
Timothy Stack
8b5b8743b1 try make locale test optional 
Fixes #562
 2018-11-16 07:32:07 -08:00
Timothy Stack
64d4226a89 disable test_top_status for now 2018-11-15 09:47:54 -08:00
Timothy Stack
5c6cc5fe2a [readline] pressing escape should exit the command prompt 
Fixes #316
 2018-11-15 06:43:28 -08:00
Timothy Stack
6336fa56e9 [cmds] :write-json-to should passthru JSON columns as JSON instead of strings 
Fixes #565
 2018-11-14 21:46:49 -08:00
Timothy Stack
aa0bfd6c62 [sql] add a spooky_hash() function 
Fixes #567
 2018-11-13 20:55:04 -08:00
Timothy Stack
ec82ecda62 [filter] display the number of filters 2018-11-10 22:55:08 -08:00
Timothy Stack
efe6ccf0d1 [filter] change from backquote to tab for activating filter panel 2018-11-09 13:59:27 -08:00
Timothy Stack
2345a32423 [filter] add panel that shows the set of filters 
Initial version, still needs some cleanup
 2018-11-09 09:45:19 -08:00
Timothy Stack
b1a6d06490 [lss] refactor the force flag during indexing and some other stuff 2018-10-25 21:26:58 -07:00
Timothy Stack
8b9536100e [build] fix a typo in test_sql.sh 2018-10-17 07:54:59 -07:00
Timothy Stack
2589345e5c [perf] improve initial indexing times 2018-10-17 07:03:33 -07:00
Timothy Stack
2e10ca09d0 [line_buffer] fix crlf handling in log files 2018-10-12 07:46:18 -07:00
Timothy Stack
9fa3714c85 [build] missed cleaning test files 2018-10-12 07:23:28 -07:00
Timothy Stack
ac7ae1275a [cmds] add :redirect-to command for redirecting the output of commands in scripts 
Related to #551
 2018-10-12 07:12:35 -07:00
Timothy Stack
ea5ac46c0e [cmds] the output of the :pipe commands should go to the top of the output stack and not to a temp file 2018-10-11 07:09:52 -07:00
Timothy Stack
5f5e2d5c4e [cleanup] prune some includes and some other cleaning 
Defect Number:
    Reviewed By:
   Testing Done:
 2018-10-11 05:50:28 -07:00
Timothy Stack
9664b015c6 [textview] preserve location in view when changing filters 
Defect Number:
    Reviewed By:
   Testing Done:
 2018-10-08 07:43:08 -07:00
Timothy Stack
d1856b53ba [build] avoid adding -I/usr/include to CPPFLAGS 
Defect Number:
    Reviewed By:
   Testing Done:
 2018-10-02 23:04:14 -07:00
Timothy Stack
d09e1509dd [test] remove debugging 2018-08-27 07:19:54 -07:00
Timothy Stack
265f80c60d [test] locale tweak 2018-08-22 06:45:20 -07:00
Timothy Stack
2c36d97a35 [build] try some more things to fix travis test failures 2018-08-22 05:55:58 -07:00
Timothy Stack
bc26b92199 [json] some more journald log tweaks 
Defect Number:
    Reviewed By:
   Testing Done:
 2018-08-22 05:33:20 -07:00
Timothy Stack
26cccdafce [locale] some tweaks for recognizing non-english logs 
Try to address some locale issues brought up in #533
 2018-08-21 21:43:32 -07:00
Timothy Stack
0b36da15a6 add monotonic timestamp back to the journald format, map priority 1 to fatal as well 2018-08-21 11:39:47 -07:00
Timothy Stack
dcf24f34ee use UTC for json log timezone 2018-08-21 11:33:39 -07:00
Timothy Stack
f360732957 missed new file 2018-08-21 11:21:57 -07:00
Timothy Stack
b1ff6b3a3b [json-log] fix some inconsistencies with json logs 
Fill some gaps brought up in #535
 2018-08-21 11:10:03 -07:00
Timothy Stack
ae460526da [tests] disable test_view_colors for now 2018-08-18 23:20:12 -07:00
Timothy Stack
a554d67875 [build] try to fix a build issue 2018-08-18 23:11:02 -07:00
Timothy Stack
3e457e30ca [json-format] fix json file recognition for crlf line-endings 
Fixes #528
 2018-08-13 05:30:47 -07:00
Timothy Stack
00ed12557b [keymap] add more keys to the keymap 2018-08-12 08:37:16 -07:00
Timothy Stack
086eb2e552 [build] update news and fix test failure 2018-07-22 07:27:59 -07:00
Timothy Stack
0ee6bdd5bf [sql] the log_part column was not correct in some cases 2018-07-22 06:51:05 -07:00
Timothy Stack
5e8983b857 [sql-view] pressing tab should hide bart charts 
Fixes #514
 2018-06-12 07:50:40 -07:00
Timothy Stack
d1da7b800c [ptime] fix %p and %l 2018-05-28 08:15:42 -07:00
Timothy Stack
b94571c58e [build] fixes... 2018-05-25 06:43:35 -07:00
Timothy Stack
5689984702 [yajlpp] use pointer to member over nullobj() 2018-05-25 06:32:01 -07:00
Timothy Stack
9e1411f113 [ptime] fix am/pm issue again 
Fixes #520
 2018-05-23 08:31:05 -07:00
Timothy Stack
5e0dabb231 [ptime] fix offset in failed parse for a few cases 2018-05-22 22:38:01 -07:00
Timothy Stack
2070c669de [ptime] fix PM offset 
Fixes #517
 2018-05-22 07:14:37 -07:00
Timothy Stack
a741236c76 [sql] missed a null check on log_time in vt_filter 
Fixes #518
 2018-05-22 06:45:54 -07:00
Timothy Stack
36d5ff8b86 [lo-fi] display fixes 
Fixes #513
Fixes #516
 2018-05-18 22:11:40 -07:00
Timothy Stack
ab2980f5dd [build] remove meta-sessions test dir 2018-05-17 07:37:58 -07:00
Timothy Stack
4ccae48aea [bookmarks] add support for tags and comments for log lines 
Initial work for #446 and #447
  TODO: filtering on tags/comments

Also did a bunch of clang-tidy cleanups and improvements to
the online help.
 2018-05-17 07:06:50 -07:00
Timothy Stack
7fb881222d [pretty] highlight log messages in the pretty view as in the normal log view 2018-05-10 06:44:03 -07:00
Timothy Stack
809159140c [unique_path] fix an infinite loop when files rolled 2018-04-09 21:16:15 -07:00
Timothy Stack
a4faac4628 [tests] update drive_mvwattrline 2018-04-04 08:00:25 -07:00
Timothy Stack
7c5fc44f7d [view_curses] fix highlighting when a line contains unicode 
Take into account unicode codepoint lengths when adjusting
attribute ranges
 2018-04-04 07:41:09 -07:00
Timothy Stack
9f91d3b447 [log-view] display the unique parts of the file name instead of just the base 
Instead of just displaying the base name of the file, try to include some
additional parts of the path that make a unique string.
 2018-04-03 07:36:09 -07:00
Timothy Stack
1ed0ff7e0f [pretty-print] check if lines are XML before indenting them as such 
Also, update the scanner for changes to re2c
 2018-04-02 13:25:07 -07:00
Timothy Stack
ecb1af304d [view_curses] fix search highlights 
Cleanup the styling code, never really redid it after
switching to use mvwin_wchnstr

Fixes #493
 2018-04-02 08:02:41 -07:00
Timothy Stack
6b9ca15f21 [tests] update expected output 2018-03-30 22:01:55 -07:00
Timothy Stack
e4432cfdeb [tests] fix an issue with the last commit 2018-03-29 13:45:59 -07:00
Phil Hord
3f7f80e32c Squash various compiler warnings 
Unused-result from sensitive APIs, printf/scanf formatting types, set
but never used variables, and uninitialized variables.

Also there's one select(enum) that doesn't cover all cases.
 2018-03-29 10:49:45 -07:00
Timothy Stack
ef34a6aaaf [search] display lines matching the search in preview instead of jumping to the first 
Jumping around can be disruptive, instead show matches in
the preview window.
 2018-03-28 07:25:10 -07:00
Timothy Stack
8257f188cb [hotkeys] change the filename hotkey to left/right arrow 2018-03-27 22:11:57 -07:00
Phil Hord
95e294decb fix failing unit test 
The help output changed with the toggle-filenames option, but
the test for help wasn't updated.

Maybe the help needs to be updated a bit to include the two
filename column modes, now that I think about it.  But we should
discuss the merits of that first, I suppose.
 2018-03-27 16:36:57 -07:00
Timothy Stack
fe6781d3e8 [reltime] support milliseconds when specifying a partial absolute time 
Fixes #499
 2018-03-23 07:09:50 -07:00
Timothy Stack
7f99955cbc [misc] fix a perf issue when previewing commands and some sql fixes 2018-02-07 11:06:59 -08:00
Timothy Stack
bdcfc5cfdd [misc] rounding some corners 2018-01-08 10:03:11 -08:00
Timothy Stack
74b58ed9fc [highlights] allow the highlight color to be specified in log formats 
Defect Number:
    Reviewed By:
   Testing Done:
 2017-12-29 06:51:09 -08:00
Timothy Stack
4b40b3f9f5 [date-time] add a formatter for 0x0p+0 
Defect Number:
    Reviewed By:
   Testing Done:
 2017-12-07 06:36:12 -08:00
Timothy Stack
b5f5b4137c [search] redo search after filtering 
Fixes #480
 2017-12-04 08:52:40 -08:00
Timothy Stack
f25980df03 [ui] rework the default colors change 
The default colors change resulted in some parts of the lnav
UI being colored incorrectly.  I've reworked it a bit so that
the ansi color pairs are preserved and the default colors are
only used with the color pairs for roles.  I've also replaced
references to ansi colors with roles in a few places to make
things work consistently.
 2017-12-02 22:11:34 -08:00
Suresh Sundriyal
fb41673532 [test] Fix printf format specifier for size_t. 
Suppress compiler warnings.
 2017-10-18 12:52:49 -07:00
Suresh Sundriyal
150252e578 [command] Add a ':quit' command. 
Add a ':quit' command and add ':q' as the alias for the
quit command.

Closes #470
 2017-10-17 21:36:58 -07:00
Timothy Stack
283293e019 [tests] update expected output for default colors change 2017-10-01 21:05:47 -07:00
Timothy Stack
485a931793 [headless] always switch to the DB view after executing a SQL command, even if the result set is empty 2017-08-18 21:46:38 -07:00
Timothy Stack
5e4ca5bbed [test] comment out mvwattrline test for now 2017-08-01 10:35:33 -07:00
Timothy Stack
753e12d606 [unicode] do not clobber wide chars when applying attributes 
Attempt to address #414
 2017-08-01 10:17:30 -07:00
Timothy Stack
a9fd0e37f6 [formats] add rfc5424 syslog format 
Fixes #444
 2017-04-29 07:31:55 -07:00
Timothy Stack
9d249004ac [time-offset] add days to offset 
Fixes #435
 2017-04-25 05:41:14 -07:00
Timothy Stack
6306659362 [test] remove extra test 2017-04-24 10:31:07 -07:00
Timothy Stack
ef5347b0eb [build] even more 2017-04-24 07:50:24 -07:00
Timothy Stack
4fb6e24be9 [build] one more time 2017-04-24 07:34:29 -07:00
Timothy Stack
c3688e87f7 [build] fix some tests 
Defect Number:
    Reviewed By:
   Testing Done:
 2017-04-24 07:29:55 -07:00
Timothy Stack
36e46fc67b [log] do a full sort if there is a year rollover 
Fixes #437
 2017-04-24 07:03:46 -07:00
Timothy Stack
7f5916d480 [crash] call endwin() after a crash 
Fixes #438
 2017-04-24 06:36:17 -07:00
Timothy Stack
9764cb1a93 [loader] add line numbers for parse errors 
Fixes #442
 2017-04-24 06:18:04 -07:00
Timothy Stack
f0c884ddc3 [build] another bro log test fix 2017-04-23 16:05:26 -07:00
Timothy Stack
867504b2b5 [build] try to fix some tests 
Defect Number:
    Reviewed By:
   Testing Done:
 2017-04-23 15:57:24 -07:00
Timothy Stack
8ea51a6fd8 [formats] support for CSV/TSV log formats 
Defect Number:
    Reviewed By:
   Testing Done:
 2017-04-23 07:11:21 -07:00
Timothy Stack
16fd7ec785 [help] remove old command help and add some more filesystem extensions 2017-04-16 15:07:41 -07:00
Timothy Stack
5e8d6aa3a8 [session] add hidden fields to the session 
Fixes #433
 2017-04-15 21:11:11 -07:00
Timothy Stack
5016ea9e71 [help] fix a help text issue 2017-04-15 06:56:25 -07:00
Timothy Stack
4cedde9a43 [help] add builtin help to the main help text as a reference 
Defect Number:
    Reviewed By:
   Testing Done:
 2017-04-14 22:49:36 -07:00
Timothy Stack
a973f7f934 [misc] some more miscellaneous bugs 
Defect Number:
    Reviewed By:
   Testing Done:
 2017-04-12 15:54:54 -07:00
Timothy Stack
aa21234164 [hist] need to rebuild hist to reflect marks 
Defect Number:
    Reviewed By:
   Testing Done:
 2017-04-11 07:25:54 -07:00
Timothy Stack
035460eb61 update expected output 2017-04-10 23:04:50 -07:00
Timothy Stack
407c5c67b1 [build] missed some new files 2017-04-06 23:20:02 -07:00