Commit Graph

907 Commits (3cc827d613f47fb6afa4d951fd5c4900be28d638)

Author SHA1 Message Date
Timothy Stack bfa1877f4e [tests] try to fix test build 3 years ago
Timothy Stack def50ee6cf [build] try fix 3 years ago
Timothy Stack c0ed59e61e [sqlite] implement .dump SQL command 3 years ago
Timothy Stack 6f4791ec35 [sqlite] include generate_series() extension 3 years ago
Timothy Stack 92e20ffd51 [reltime] add support for weekdays and having timeslice() return NULL when a time is out-of-range 3 years ago
Timothy Stack 4f4d90a65d [tests] include more information in error message 3 years ago
Timothy Stack 5d4f08b1b4 [scripty] add a timeout 3 years ago
Timothy Stack 1b16376076 [build] other build fix stuff 3 years ago
Timothy Stack 3c10b1f34b [build] try to fix some tests 3 years ago
Timothy Stack 749fdacfa8 [build] fixes 3 years ago
Timothy Stack 7b0e1c4f54 [filters] fix previews when created in the editor 3 years ago
Timothy Stack def2fe4bcb [test] try to fix test 3 years ago
Timothy Stack f6128240ab [sql] add lnav_top_file() SQL function 3 years ago
Timothy Stack 68759ada2d [data_scanner] fix quoted string regex
Fixes #842
3 years ago
Timothy Stack c177a321fb [leak] try to fix leak in a test 3 years ago
Timothy Stack d45d7d6c58 [docs] add report generation to cookbook 3 years ago
Timothy Stack f5e88b7158 [docs] add ARCHITECTURE.md and various other things 3 years ago
Timothy Stack a4368223ea some docs and test fixup 3 years ago
Timothy Stack 351ad7a8fc [xml/xpath] suggest xpath() calls for xml fields 3 years ago
Timothy Stack 6deb7032a6 [tests] add more CSIs to scripty 3 years ago
Tim Stack 0269aa1d47
Delete tui_echo.0 3 years ago
Timothy Stack 2750d23b07 [tests] add more TUI tests 3 years ago
Timothy Stack 58f1c9df1c [tests] fix tui test 3 years ago
Timothy Stack 0a701394fe [tests] add an initial TUI test 3 years ago
Timothy Stack 37523fe7d0 [test] test SQL state funcs 3 years ago
Timothy Stack 3b5a5b448a [tests] test old date 3 years ago
Timothy Stack 7e6b3dcc23 [scripty] fix handling of 'C' escape sequence 3 years ago
Timothy Stack b847ae7164 [tests] more coverage 3 years ago
Timothy Stack 7821d07b7c [tests] coverage for relative_time.hh 3 years ago
Timothy Stack 85b9329332 [tests] more coverage stuff 3 years ago
Timothy Stack f35c0c397e [tests] increasing coverage a bit 3 years ago
Timothy Stack caa5cc9003 [tests] add realpath() test 3 years ago
Timothy Stack 5c02766485 [tests] add test for realpath() 3 years ago
Timothy Stack 47fb48eaf3 [tests] add SQL readlink() test 3 years ago
Timothy Stack 7778042847 [tests] set TZ for test 3 years ago
Timothy Stack c5ab97352d [cover] add some tests for :unix-time 3 years ago
Timothy Stack efea67e61c [tests] move test_pcrepp 3 years ago
Timothy Stack 00890970cd [tests] disable a couple of tests 3 years ago
Timothy Stack 49ebde5953 [build] remove pcrecpp and other stuff
Linking against a binary c++ lib suuuucckkkkkssss...
3 years ago
Timothy Stack cac1175973 [services] initial pass at injecting services and a bunch of other stuff 3 years ago
Timothy Stack 56bee6f4c9 [archive] remove old unpacked archives and a bunch of other stuff 4 years ago
Timothy Stack 8851c4492f [tests] add a test for decompression 4 years ago
Timothy Stack 6be36eda19 [build] isdigit() instead of isnumber() 4 years ago
Timothy Stack 8235f9af5d [tests] try to make scripty output readable 4 years ago
Timothy Stack 4d936f7bba [build] add more tests to cmake build 4 years ago
Timothy Stack cc072d29ea [tests] update another date-sensitive test 4 years ago
Timothy Stack 60dde499ac [tests] fix test to make it insensitive to the current date 4 years ago
Timothy Stack 1cefe583fa [debt] fix a leak in lnav_view_filters 4 years ago
Timothy Stack 2996a90afa [format] use the module level for a message 4 years ago
Timothy Stack 63c31838eb [debt] fixing some more debt 4 years ago
Timothy Stack 7476dd5bb9 [misc] misc bugs 4 years ago
Timothy Stack 4ca6fd7bfd [sqlite] add an xml/xpath extension 4 years ago
Timothy Stack 4ff2b710d5 [log_format] change w3c_log to put extra columns into a JSON column 4 years ago
Timothy Stack 941504a4cb [help] fix word wrap for example desc 4 years ago
Timothy Stack e6df0fba0a [humanize] something seems wrong 4 years ago
Timothy Stack 04da95eb95 [installer] fix file type check for formats
Fixes #801
4 years ago
Timothy Stack 8a2fb80888 [build] fix distcheck 4 years ago
Timothy Stack 267e32d479 [tests] update expected output 4 years ago
Timothy Stack e3f28eaa43 [logfile] a captured file cannot be overwritten
Fixes #741
4 years ago
Timothy Stack 623da1fe33 [build] add w3c logfiles to dist 4 years ago
Timothy Stack 32f112b8de [formats] add w3c extended log format impl
Fiexes #798
4 years ago
Timothy Stack 19e0624ab6 [debt] even more mem leaks
Defect Number:
    Reviewed By:
   Testing Done:
4 years ago
Timothy Stack 22c2e95df0 [filters] sql filter
Related to #568
4 years ago
Timothy Stack 6d0054d3b6 [logfile] refactor visibility 4 years ago
Timothy Stack 2aad7985a6 [build] opt build
Defect Number:
    Reviewed By:
   Testing Done:
4 years ago
Timothy Stack 8e629b166a [build] some more compiler profiling
Defect Number:
    Reviewed By:
   Testing Done:
4 years ago
Timothy Stack 51d1204a96 [arc] add content hash to archive temp dir and tech debt 4 years ago
Timothy Stack 0765c07010 [view] migrate view_action stuff to function objects 4 years ago
Timothy Stack f192cb7c3e [input_dispatcher] fix handling of unicode input
Fixes #791
4 years ago
Timothy Stack db8a3c4d38 [debt] doing some cleanup
Defect Number:
    Reviewed By:
   Testing Done:
4 years ago
Timothy Stack e4ea9ca584 [arc] report errors when opening archives 4 years ago
Timothy Stack 8b38bb0970 [session] store file visibility 4 years ago
Timothy Stack c22c78220c [text] hide text files 4 years ago
Timothy Stack 7b77a612c2 [files] make file scanning async 4 years ago
Timothy Stack dfd18a4be5 [view] add files view 4 years ago
Timothy Stack 3b0168025d [cmds] add support for hiding files 4 years ago
Timothy Stack 579e4274f9 [files] initial impl for opening archives 4 years ago
Timothy Stack 9f524136bd [fs] remove old filesystem impl 4 years ago
Timothy Stack d8a083f0fe [filters] add :toggle-filtering command 4 years ago
Timothy Stack 74bfa21050 [build] missed a file 4 years ago
Timothy Stack 65c991919b [loader] fix format loader and add $schema refs to formats 4 years ago
Suresh Sundriyal 63ed3ee677 [dist] Prevent distributing built sources 4 years ago
Timothy Stack a5171058c7 [build] some built files were being included in the dist 4 years ago
Suresh Sundriyal f35f855458 [tests] Remove use of deprecated std::random_shuffle 4 years ago
Timothy Stack ce0383dee1 [build] fix some warnings 4 years ago
Timothy Stack 349991a695 [shlex] fix handling of tilde 4 years ago
Timothy Stack 815a05577e [keymap] suggest the config option to set for an unknown keystroke
Also, add a unicode green-check/red-X mark for the success/error
message for commands.
4 years ago
Timothy Stack ba1bc28209 [build] fix issues with test files 4 years ago
Timothy Stack 82b34bb02a [config] remove :save-config 4 years ago
Timothy Stack 84a7079e3f [main] capture stderr only after initscr() and fix curl configure detection 4 years ago
Timothy Stack a2b3427502 [tests] add tests for SQL annotation functionality 4 years ago
Timothy Stack d695febe14 [cmd] add :write-jsonlines-to command 4 years ago
Timothy Stack d040e75d42 [build] fix a test 4 years ago
Timothy Stack 07d5aba7b5 [build] remove test files 4 years ago
Timothy Stack ebd1038057 [pretty] include linefeeds in the pretty output
Defect Number:
    Reviewed By:
   Testing Done:
4 years ago
Timothy Stack e85fff0b88 [sql] add json_concat() function and misc fixes 4 years ago
Timothy Stack 9cbe4d73a9 [docs] start to flesh out command and sql docs 4 years ago
Timothy Stack defb00303f [docs] some changes 4 years ago
Timothy Stack 6073464722 [build] disable test for now 4 years ago
Timothy Stack a8e97a180b [build] remove stale dep 4 years ago
Timothy Stack 8413dd13d8 [config] add configs directory 4 years ago
Timothy Stack 99a8eb9850 [build] try again 4 years ago
Timothy Stack 7e538c85f9 [tests] try to fix breakage 4 years ago
Timothy Stack 3da3ec799a [session] allow the name 4 years ago
Timothy Stack 138a506b1a [perf] a few performance tweaks 4 years ago
Timothy Stack 0744a9b6de [docs] mention the view tables
Defect Number:
    Reviewed By:
   Testing Done:
4 years ago
Timothy Stack 07f4b56646 [tests] update some expected results
so lazy...
5 years ago
Timothy Stack e525d247ae [json-log] some more fixes for handling invalid json logs 5 years ago
Timothy Stack 8b750c83f1 update expected output 5 years ago
Timothy Stack 98519b045a [help] mention hide/show-unmarked-lines
Fixes #631
5 years ago
Timothy Stack b7255419e6 [test] fix sed usage
Fixes #572
5 years ago
Timothy Stack 9d6e6e4638 [build] fix a typo 5 years ago
Timothy Stack 27587ee917 [test] get test working on OS X 5 years ago
Tim Stack b2463e44a3
Merge pull request #677 from phord/gzip-index
Add a gzip indexing class for faster gz navigation
5 years ago
Timothy Stack f11364660d [build] missed file in makefile 5 years ago
Timothy Stack 73e902f7d8 [json-log] handle invalid json log lines
Header from folded patch 'foldme1.patch':

[local] foldme
5 years ago
Phil Hord 5513deeade Add a gzip indexing class for faster gz navigation
The gzread function is slow.  Every time you seek to a new location, the
whole file up to that position has to be decompressed again.  This causes
massive lags when trying to do simple things in lnav on a large .gz file.

Use the zlib inflate* functions instead and record the dictionary
periodically while processing the file the first time.  Then use
inflateSetDictionary to restore the dictionary to a convenient
location when trying to seek into the file again in the future.

Use a default period of 1MB of compressed data for syncpoints.
Each syncpoint uses 32KB. This is a ratio of 3.2%.  For example,
a 1GB .gz file (compressed size) will require us to keep 32MB
of index data in memory. A better method may be to use a fixed
number of syncpoints and divide the file appropriately. This
would keep the memory bounded at the cost of slower file
navigation on large .gz files.

Use pread to read the data for the stream decompressor and remove
the lock_hack previously employed.

NB. The documentation on these zlib functions is sparse. I followed
the example in zlib/examples/zran.c, but I used the z_stream total_in
and total_out variables instead of keeping my own separately as zran.c
does.  Maybe this is incompatible with some very old zlib versions.
I haven't looked.
5 years ago
Timothy Stack 585986057d [build] missed cleaning a dir up 5 years ago
Timothy Stack 56a341f7f8 [view_curses] colors
Defect Number:
    Reviewed By:
   Testing Done:
5 years ago
Timothy Stack 9a05b9d186 [config] pay attention to XDG_CONFIG_HOME
Fixes #105
5 years ago
Timothy Stack e442f84e80 [textview] pause loading of files by pressing =
Fixes #670
5 years ago
Timothy Stack 63dba408ec [stdin] Keep the stdin piper file in .lnav so that it can be reopened
When piping the output of a program into lnav, the data would
be dumped to the terminal on exit so that it would not be
lost.  Since that is a bit noisy, the temp file used to store
the data is now left in .lnav so that it can be reopened later.
Older stdin captures are automatically removed after a day.

Also took the opportunity to start using filesystem::path more.

Fixes #436
5 years ago
Timothy Stack ffd9d88add [log_format] ignore line-format field if timestamp-format is set
Fixes #661
5 years ago
Timothy Stack 34db64aa32 [logfile] the index rebuild didn't check the mtime if the file size was the same
Fixes #668
5 years ago
Timothy Stack 7c485f64dc [cmake] fix some test targets 5 years ago
Timothy Stack 1257fcd62a [codacy] fix a few issues turned up 5 years ago
Timothy Stack 325e4a15d9 [build] test out the hunter package manager 5 years ago
Timothy Stack 76edd2a9d1 [line_buffer] refactor left a bug with non-blocking files
Fixes #662
5 years ago
Timothy Stack b81b35c866 [log-view] in time-offset mode, show negative times for messages before the first mark
Prototype for #395
5 years ago
Timothy Stack d61f2568d6 [ptimec] fix a case of undefined behavior 5 years ago
Timothy Stack a10fa06b10 [build] remove test file 5 years ago
Timothy Stack 02c53976b4 Some refactoring for the line buffer and other cleanups
Fixes #649
5 years ago
Timothy Stack 6cf5cc8213 [logfile] fix issue when files have headers
Defect Number:
    Reviewed By:
   Testing Done:
5 years ago
Timothy Stack 1fc24ecabf [bin2c] improve building of data files that are incorporated into the binary 5 years ago
Timothy Stack c7046b0b54 [json] newlines in the line format cause problems
Fixes #644
5 years ago
Timothy Stack 76b08f5fe3 [build] fix other lib order 5 years ago
Timothy Stack fb7d6eafaf [build] some refactoring of files 5 years ago
Timothy Stack 63e53377c3 [theme] add monocai theme 5 years ago
Timothy Stack a8e1f62da6 [build] add fmt lib 5 years ago
Timothy Stack fc9f9f43cf add bad-config to the dist 5 years ago
Timothy Stack 06d1098211 [config] initial support for themes
For #422

Still more to do
5 years ago
Timothy Stack 6f451eec35 [pretty] fix crash when rewriting lines 5 years ago
Timothy Stack 5e8a1cebe9 [json-log] handle arrays in json log message fields
Fixes #635
5 years ago
Timothy Stack 062d480fea [sql] fix some issues found while trying to query some logs 5 years ago
Timothy Stack 2fa603d07e [tests] fix a test 5 years ago
Timothy Stack 78d80fddd5 [cli] add -r flag for recursively loading files from a directory hierarchy
Fixes #431
5 years ago
Timothy Stack 33cdbefaaa [help] some online help additions 5 years ago
Timothy Stack 21c5c52843 [format] allow multiple log format patterns per log file
This tries to address #624
5 years ago
Timothy Stack 0e12f98ae7 [sql] change base_time to time_offset 5 years ago
Timothy Stack 469124d72b [time-offset] fixes
Defect Number:
    Reviewed By:
   Testing Done:
5 years ago
Timothy Stack 4614cbcb75 [sql] fix joins on some vtables 5 years ago
Timothy Stack 43243c7ba3 [build] revive freebsd release build
Some misc fixes for filtering as well
5 years ago
Timothy Stack 02b9e13343 [filters] add the number of hits for each filter in the editor
Might be useful to know the number of hits for a given filter.
5 years ago
Timothy Stack 659f01c9ae [filters] add a log_filters column to log tables that contains the matched filters
Related to #597
5 years ago
Timothy Stack 153b59ea8a [status] some fixes for the bottom status bar
Fixes #603
Fixes #578
5 years ago
Timothy Stack 104b8736e8 [vtab] fix for failed update to log_tags column and fix filtering with json logs 5 years ago
Timothy Stack 3d77fb2acf [cmds] change :write-raw-to to write all the lines in the view
Fixes #606
6 years ago
Timothy Stack 31c440777f [hotkeys] add ctrl+f to toggle filters
Fixes #604
6 years ago
Timothy Stack 0c2f84a3c0 [hotkeys] press 7/8 for previous/next minute
Fixes #382
6 years ago
Timothy Stack 5fff4d8784 [help] add some initial help text for search/SQL prompts
Also:
  * You can now "scroll out" of the visual editor to
    return to the main view.  This should alleviate the
    frustration of pressing up/down arrows thinking the
    main view should move but, really, you're stuck in
    the editor.
  * The three-dot-ellipsis for hidden fields has been
    replaced with a unicode vertical ellipsis so that
    less space is taken up.
6 years ago
Timothy Stack dcccebe797 [sql] add some help for regexp_capture()
Fixes #593
6 years ago
Timothy Stack 7dfa0e9dd4 [textview] highlights that start from the beginning of the line are not working in the log view
The log view prefixes lines with some extra characters and they
were mistakenly being included when performing the highlight
regex.

Fixes #590
6 years ago
Timothy Stack a63b6a199c [filter] in the filter editor, use "t" to toggle the type of filter
Related to #423
6 years ago
Timothy Stack 814ad03ec9 [view] keep a history of view positions
Fixes #577
6 years ago
Timothy Stack e001b49e28 [format] hidden object/array fields add sub-lines when they should not
Fixes #576
6 years ago
Timothy Stack 1a08eb0d12 [cmds] allow commands to set the prompt
Fixes #574 and #573
6 years ago
Timothy Stack 8b5b8743b1 try make locale test optional
Fixes #562
6 years ago
Timothy Stack 64d4226a89 disable test_top_status for now 6 years ago
Timothy Stack 5c6cc5fe2a [readline] pressing escape should exit the command prompt
Fixes #316
6 years ago
Timothy Stack 6336fa56e9 [cmds] :write-json-to should passthru JSON columns as JSON instead of strings
Fixes #565
6 years ago
Timothy Stack aa0bfd6c62 [sql] add a spooky_hash() function
Fixes #567
6 years ago
Timothy Stack ec82ecda62 [filter] display the number of filters 6 years ago
Timothy Stack efe6ccf0d1 [filter] change from backquote to tab for activating filter panel 6 years ago
Timothy Stack 2345a32423 [filter] add panel that shows the set of filters
Initial version, still needs some cleanup
6 years ago
Timothy Stack b1a6d06490 [lss] refactor the force flag during indexing and some other stuff 6 years ago
Timothy Stack 8b9536100e [build] fix a typo in test_sql.sh 6 years ago
Timothy Stack 2589345e5c [perf] improve initial indexing times 6 years ago
Timothy Stack 2e10ca09d0 [line_buffer] fix crlf handling in log files 6 years ago
Timothy Stack 9fa3714c85 [build] missed cleaning test files 6 years ago
Timothy Stack ac7ae1275a [cmds] add :redirect-to command for redirecting the output of commands in scripts
Related to #551
6 years ago
Timothy Stack ea5ac46c0e [cmds] the output of the :pipe commands should go to the top of the output stack and not to a temp file 6 years ago
Timothy Stack 5f5e2d5c4e [cleanup] prune some includes and some other cleaning
Defect Number:
    Reviewed By:
   Testing Done:
6 years ago
Timothy Stack 9664b015c6 [textview] preserve location in view when changing filters
Defect Number:
    Reviewed By:
   Testing Done:
6 years ago
Timothy Stack d1856b53ba [build] avoid adding -I/usr/include to CPPFLAGS
Defect Number:
    Reviewed By:
   Testing Done:
6 years ago
Timothy Stack d09e1509dd [test] remove debugging 6 years ago
Timothy Stack 265f80c60d [test] locale tweak 6 years ago
Timothy Stack 2c36d97a35 [build] try some more things to fix travis test failures 6 years ago
Timothy Stack bc26b92199 [json] some more journald log tweaks
Defect Number:
    Reviewed By:
   Testing Done:
6 years ago
Timothy Stack 26cccdafce [locale] some tweaks for recognizing non-english logs
Try to address some locale issues brought up in #533
6 years ago
Timothy Stack 0b36da15a6 add monotonic timestamp back to the journald format, map priority 1 to fatal as well 6 years ago
Timothy Stack dcf24f34ee use UTC for json log timezone 6 years ago
Timothy Stack f360732957 missed new file 6 years ago
Timothy Stack b1ff6b3a3b [json-log] fix some inconsistencies with json logs
Fill some gaps brought up in #535
6 years ago
Timothy Stack ae460526da [tests] disable test_view_colors for now 6 years ago
Timothy Stack a554d67875 [build] try to fix a build issue 6 years ago
Timothy Stack 3e457e30ca [json-format] fix json file recognition for crlf line-endings
Fixes #528
6 years ago
Timothy Stack 00ed12557b [keymap] add more keys to the keymap 6 years ago
Timothy Stack 086eb2e552 [build] update news and fix test failure 6 years ago
Timothy Stack 0ee6bdd5bf [sql] the log_part column was not correct in some cases 6 years ago
Timothy Stack 5e8983b857 [sql-view] pressing tab should hide bart charts
Fixes #514
6 years ago
Timothy Stack d1da7b800c [ptime] fix %p and %l 6 years ago
Timothy Stack b94571c58e [build] fixes... 6 years ago
Timothy Stack 5689984702 [yajlpp] use pointer to member over nullobj() 6 years ago
Timothy Stack 9e1411f113 [ptime] fix am/pm issue again
Fixes #520
6 years ago
Timothy Stack 5e0dabb231 [ptime] fix offset in failed parse for a few cases 6 years ago
Timothy Stack 2070c669de [ptime] fix PM offset
Fixes #517
6 years ago
Timothy Stack a741236c76 [sql] missed a null check on log_time in vt_filter
Fixes #518
6 years ago
Timothy Stack 36d5ff8b86 [lo-fi] display fixes
Fixes #513
Fixes #516
6 years ago
Timothy Stack ab2980f5dd [build] remove meta-sessions test dir 6 years ago
Timothy Stack 4ccae48aea [bookmarks] add support for tags and comments for log lines
Initial work for #446 and #447
  TODO: filtering on tags/comments

Also did a bunch of clang-tidy cleanups and improvements to
the online help.
6 years ago
Timothy Stack 7fb881222d [pretty] highlight log messages in the pretty view as in the normal log view 6 years ago
Timothy Stack 809159140c [unique_path] fix an infinite loop when files rolled 6 years ago
Timothy Stack a4faac4628 [tests] update drive_mvwattrline 6 years ago
Timothy Stack 7c5fc44f7d [view_curses] fix highlighting when a line contains unicode
Take into account unicode codepoint lengths when adjusting
attribute ranges
6 years ago
Timothy Stack 9f91d3b447 [log-view] display the unique parts of the file name instead of just the base
Instead of just displaying the base name of the file, try to include some
additional parts of the path that make a unique string.
6 years ago
Timothy Stack 1ed0ff7e0f [pretty-print] check if lines are XML before indenting them as such
Also, update the scanner for changes to re2c
6 years ago
Timothy Stack ecb1af304d [view_curses] fix search highlights
Cleanup the styling code, never really redid it after
switching to use mvwin_wchnstr

Fixes #493
6 years ago
Timothy Stack 6b9ca15f21 [tests] update expected output 6 years ago
Timothy Stack e4432cfdeb [tests] fix an issue with the last commit 6 years ago
Phil Hord 3f7f80e32c Squash various compiler warnings
Unused-result from sensitive APIs, printf/scanf formatting types, set
but never used variables, and uninitialized variables.

Also there's one select(enum) that doesn't cover all cases.
6 years ago
Timothy Stack ef34a6aaaf [search] display lines matching the search in preview instead of jumping to the first
Jumping around can be disruptive, instead show matches in
the preview window.
6 years ago
Timothy Stack 8257f188cb [hotkeys] change the filename hotkey to left/right arrow 6 years ago
Phil Hord 95e294decb fix failing unit test
The help output changed with the toggle-filenames option, but
the test for help wasn't updated.

Maybe the help needs to be updated a bit to include the two
filename column modes, now that I think about it.  But we should
discuss the merits of that first, I suppose.
6 years ago
Timothy Stack fe6781d3e8 [reltime] support milliseconds when specifying a partial absolute time
Fixes #499
6 years ago
Timothy Stack 7f99955cbc [misc] fix a perf issue when previewing commands and some sql fixes 6 years ago
Timothy Stack bdcfc5cfdd [misc] rounding some corners 7 years ago
Timothy Stack 74b58ed9fc [highlights] allow the highlight color to be specified in log formats
Defect Number:
    Reviewed By:
   Testing Done:
7 years ago
Timothy Stack 4b40b3f9f5 [date-time] add a formatter for 0x0p+0
Defect Number:
    Reviewed By:
   Testing Done:
7 years ago
Timothy Stack b5f5b4137c [search] redo search after filtering
Fixes #480
7 years ago
Timothy Stack f25980df03 [ui] rework the default colors change
The default colors change resulted in some parts of the lnav
UI being colored incorrectly.  I've reworked it a bit so that
the ansi color pairs are preserved and the default colors are
only used with the color pairs for roles.  I've also replaced
references to ansi colors with roles in a few places to make
things work consistently.
7 years ago
Suresh Sundriyal fb41673532 [test] Fix printf format specifier for size_t.
Suppress compiler warnings.
7 years ago
Suresh Sundriyal 150252e578 [command] Add a ':quit' command.
Add a ':quit' command and add ':q' as the alias for the
quit command.

Closes #470
7 years ago
Timothy Stack 283293e019 [tests] update expected output for default colors change 7 years ago
Timothy Stack 485a931793 [headless] always switch to the DB view after executing a SQL command, even if the result set is empty 7 years ago
Timothy Stack 5e4ca5bbed [test] comment out mvwattrline test for now 7 years ago
Timothy Stack 753e12d606 [unicode] do not clobber wide chars when applying attributes
Attempt to address #414
7 years ago
Timothy Stack a9fd0e37f6 [formats] add rfc5424 syslog format
Fixes #444
7 years ago
Timothy Stack 9d249004ac [time-offset] add days to offset
Fixes #435
7 years ago
Timothy Stack 6306659362 [test] remove extra test 7 years ago
Timothy Stack ef5347b0eb [build] even more 7 years ago
Timothy Stack 4fb6e24be9 [build] one more time 7 years ago
Timothy Stack c3688e87f7 [build] fix some tests
Defect Number:
    Reviewed By:
   Testing Done:
7 years ago
Timothy Stack 36e46fc67b [log] do a full sort if there is a year rollover
Fixes #437
7 years ago
Timothy Stack 7f5916d480 [crash] call endwin() after a crash
Fixes #438
7 years ago
Timothy Stack 9764cb1a93 [loader] add line numbers for parse errors
Fixes #442
7 years ago
Timothy Stack f0c884ddc3 [build] another bro log test fix 7 years ago
Timothy Stack 867504b2b5 [build] try to fix some tests
Defect Number:
    Reviewed By:
   Testing Done:
7 years ago
Timothy Stack 8ea51a6fd8 [formats] support for CSV/TSV log formats
Defect Number:
    Reviewed By:
   Testing Done:
7 years ago
Timothy Stack 16fd7ec785 [help] remove old command help and add some more filesystem extensions 7 years ago
Timothy Stack 5e8d6aa3a8 [session] add hidden fields to the session
Fixes #433
7 years ago
Timothy Stack 5016ea9e71 [help] fix a help text issue 7 years ago
Timothy Stack 4cedde9a43 [help] add builtin help to the main help text as a reference
Defect Number:
    Reviewed By:
   Testing Done:
7 years ago
Timothy Stack a973f7f934 [misc] some more miscellaneous bugs
Defect Number:
    Reviewed By:
   Testing Done:
7 years ago
Timothy Stack aa21234164 [hist] need to rebuild hist to reflect marks
Defect Number:
    Reviewed By:
   Testing Done:
7 years ago
Timothy Stack 035460eb61 update expected output 7 years ago
Timothy Stack 407c5c67b1 [build] missed some new files 7 years ago
Timothy Stack df399a36a4 [docs] some more docs, command-help, and tests for #428 7 years ago
Timothy Stack 04e60fd79d [build] sign warnings 7 years ago
Timothy Stack 78119dc9f1 fixing some minor issues
Fixes #255
7 years ago
Timothy Stack 411ea1fbee [help] show help text for SQL functions
Defect Number:
    Reviewed By:
   Testing Done:
7 years ago
Timothy Stack cd76eae5b8 [build] convert some C files to C++
Defect Number:
    Reviewed By:
   Testing Done:
7 years ago
Timothy Stack 6fcfd35395 [sql] add "search" column to the lnav_views table
Fixes #388
7 years ago
Timothy Stack 8776f6a703 [sql] do some minimal parsing/annotation of SQL statements
Defect Number:
    Reviewed By:
   Testing Done:
7 years ago
Timothy Stack 0b157ff867 [sql] add function adapter template
Defect Number:
    Reviewed By:
   Testing Done:
7 years ago
Timothy Stack c0684a97cc [sql] add a regexp_capture tablue-valued function
Fixup the release makefile a bit.
7 years ago
Timothy Stack f6138662ae [test] update test for vtab change 7 years ago
Timothy Stack fa296fca1b [listview] get a batch of rows from the source instead of a single one at a time
Also: bump to c++14 and added a helper template for creating sqlite virtual tables
7 years ago
Timothy Stack 32c9dacd0a [files_vtab] add a vtable for opened files
Defect Number:
    Reviewed By:
   Testing Done:
7 years ago
Timothy Stack c180c44e49 [vtab] add an lnav_view_stack table to get programmatic access to the view stack
More progress towards #377
7 years ago
Timothy Stack 1a87184c82 [log] allow parts of log messages to be hidden
Fixes #412
7 years ago
Timothy Stack 89f8ef9c2b [hotkeys] hotkey configuration
First steps to implementing #350
8 years ago
Timothy Stack 04eda90244 [db] missed checking for a null progress callback
Fixes #404
8 years ago
Timothy Stack 0138d13297 [cmds] execute scripts from stdin/fds
Issues mentioned in #397
8 years ago
Timothy Stack d799cc227e some tweaks to these changes 8 years ago
Timothy Stack f567aafe3b [c++11] migration #1
Just a start
8 years ago
Timothy Stack 5e2d8842f2 forgot the actual file, sigh 8 years ago
Timothy Stack 93848faae7 add new file to dist 8 years ago
Timothy Stack 44d93dddc3 [pretty-print] allow formats to do transforms before pretty-printing
Also started upgrading to C++11.

Fixes #353
8 years ago
Timothy Stack 642a94e7b7 [open] check for FIFOs
Fixes #380
8 years ago
Timothy Stack fb4e66e0b5 [build] package logfile_epoch.1 8 years ago
Timothy Stack 1b8b773184 [tests] print logfile::error exception 8 years ago
Timothy Stack 6618fe1947 [build] test 8 years ago
Timothy Stack 26cd9f5930 [ptime] make sure the full time stamp is matched
Fixes #389
Fixes #390
8 years ago
Timothy Stack 592ee60693 [log] fix rewriting machine-oriented timestamps
Fixes #371
8 years ago
Timothy Stack 4712bb6f76 update test for json logs with objects/arrays 8 years ago
Timothy Stack a59e0b290e [format] allow json log fields to be hidden
Fixes #303
8 years ago
Timothy Stack b392886f0c [highlight] choose highlight color based on the regex
Defect Number:
    Reviewed By:
   Testing Done:
8 years ago
Timothy Stack 9f79dcc31a [format] point out the location of a pcre-compile error
Defect Number:
    Reviewed By:
   Testing Done:
8 years ago
Timothy Stack 41a2eed239 [pretty-print] fix printing of quoted strings that have escaped characters
Fixes #354
8 years ago
Timothy Stack 2e68f48a18 [hist] check for zoom with no logs
Fixes #346
8 years ago
Timothy Stack b216993760 [tests] missed a format file in the makefile 8 years ago
Timothy Stack 5539e21c05 [log-format] fix line-format where a variable can span lines
Fixes #337
8 years ago
Timothy Stack c05dfafae8 [log-format] abbreviate long fields when formatting JSON logs
Fixes #340
8 years ago
Timothy Stack 9ee18c26d3 [log-format] add min-width and align options to line-format
Also some fixes for validating the format definitions.

Fixes #338
8 years ago
Timothy Stack 41854cf637 [json-log] custom date formats
Fixes #341
8 years ago
Timothy Stack 8dbf018814 [loader] the loader was not converting the level name to the enum value correctly
Closes #329
8 years ago
Eli Young 5602af33f8 [fmt] Fix glog_log format
The log format used by glog uses spaces to left-pad the thread to 7
digits, per the code:

https://github.com/golang/glog/blob/65d6746/glog.go#L577

This fixes the regular expression to correctly match the extra
whitespace.
8 years ago
Tim Stack 91633d089f Merge pull request #320 from sureshsundriyal/db-attach
[secure-mode] Disallow ATTACH statements completely.
8 years ago
Suresh Sundriyal 6663740c5e [secure-mode] Disallow ATTACH statements completely.
The code to handle in-memory db exceptions is hideous and unreliable,
given the fact that SQLite does not expose much in terms of getting the
current value and the methods to check the compile time options can
themselves be disabled by a compile=time option in SQLite.

There really isn't much use for in-memory databases and if someone
really needs it, they can always choose to run in normal mode, so just
remove the extra code.
8 years ago
Tim Stack 1850c4f678 Merge pull request #318 from sureshsundriyal/db-attach
[secure-mode] Prevent users from attaching db files.
8 years ago
Timothy Stack 5ea5504aec [time] fix time rollover for days
Fixes #304
8 years ago
Timothy Stack a4deaa1e8b [spectro] log_time must be in ascending order 8 years ago
Suresh Sundriyal 1e6878164f [secure-mode] Refactoring and check for sqlite version.
'mode=memory' query parameter is only supported from sqlite3 version
3.8.0 onwards. Make sure to check for the version before continuing with
the 'ATTACH' statement.

Turning off some of the tests, since they fail on the Travis CI setup
which uses sqlite version 3.6.0.
8 years ago
Suresh Sundriyal e6c87678e9 [secure-mode] Prevent users from attaching db files.
Prevent the users from attaching an external db file which they may not
have ownership of.

The current authorizer method is hooked in only when the LNAVSECURE
variable is set. This is done deliberately, since the method will be
called on every sqlite query and I did not want to incur a performance
hit.

If the scope of this authorizer increases, we should consider passing in
the lnav_data as pUserData and do the checks inside the authorizer
itself.
8 years ago
Timothy Stack 82f970c09e [config] add a config option to control A_DIM for text
Fixes #298
8 years ago
Timothy Stack 3167302722 [data-parser] fix some issues with parsing hierarchical data and improve the debugger 8 years ago
Suresh Sundriyal 88833c8035 [commands] Read and honor the 'LNAVSECURE' environment variable.
Read the value of the 'LNAVSECURE' environment variable upfront and
store it in the lnav_data structure. When this variable is set prior to
the binary execution, the following commands are disabled:

* 'open'
* 'pipe-to'
* 'pipe-line-to'
* 'write-*-to'

This is a proposed fix for tstack/lnav#305.
8 years ago
Timothy Stack 54b9c5ebf5 [parser] handle empty groups 8 years ago
Timothy Stack 2b76181fd6 [parser] try to handle apostrophes better 8 years ago
Timothy Stack a8cd28097b [spectro] add some better error messages for the spectrogram command and fix some vtable glitches 8 years ago
Timothy Stack 23020e8a89 [test] missed setting TZ 8 years ago
Timothy Stack 4f05af6408 [time] add support for TAI64N timestamps
Fixes #300
8 years ago
Timothy Stack a384e240f9 missed updating the makefile 8 years ago
Timothy Stack afc8cc44b6 [json-format] support integer values for log levels in json formats 8 years ago
Timothy Stack 7a6429519f [summary-line] change error count to error rate and do some cleanup on message levels 8 years ago
Timothy Stack 13c90726a2 [tests] some more testing and stats for logfiles 8 years ago
Timothy Stack e8f400abfa [logfile] truncation detection was not taking into account compressed files 8 years ago
Timothy Stack fdc2748e3e [spectro] add a spectrogram view that works with known message fields 8 years ago
Timothy Stack 8de5d3b749 [logfile] add more options when opening files 8 years ago
Timothy Stack 4b318e45e0 [parser] some more parser tweaking and fix a jget() issue 8 years ago
Timothy Stack 2d04d047e4 [sql] change extract() to regexp_match() and make extract() an interface to the data_parser 8 years ago
Timothy Stack d4a69cbf22 no joy
Revert "[sql] change extract() to regexp_match() and make extract() an interface to the data_parser"

This reverts commit 85eee6514b.
8 years ago
Timothy Stack 85eee6514b [sql] change extract() to regexp_match() and make extract() an interface to the data_parser 8 years ago
Timothy Stack 9feb53f02a [sql] add extract() function to extract values from a string using a regex
This function should be preferred over creating log search tables
for scripts.
8 years ago
Timothy Stack cdd43549ab [cmds] automatically capture echo/write output from scripts so they can generate reports
Add another example script, dhclient-summary.

Add a 'search-table' section to formats so you can automatically
define a search-based table.
8 years ago
Timothy Stack 53e2d92eef [ui] highlight out-of-time-order messages in yellow with an underline 8 years ago
Timothy Stack d12fe9e0a9 [json] add some schema validation code 8 years ago
Timothy Stack 89be76ef42 [filters] clear the state for filters that have been deleted
Fixes #292
8 years ago
Timothy Stack 68070678b5 try to fix test error 9 years ago
Timothy Stack a2b381ca19 [config] initial impl with clock-format as the only option at the moment 9 years ago
Timothy Stack e5f786bc2c [script] add metadata to script files 9 years ago
Timothy Stack ab62d27757 [cmd] replace wordexp with shlex 9 years ago
Timothy Stack 16e988d132 [shlex] add a readline highlighter for shlex 9 years ago
Timothy Stack 6e196bff79 [line_buffer] clear cached data when doing a read 9 years ago
Timothy Stack 87b07a0087 [sql] allow log_part to be updated 9 years ago
Timothy Stack 2a10fa7d37 [build] some more build warnings 9 years ago
Timothy Stack 150590cfd6 [build] missing files from dist 9 years ago
Timothy Stack 6821bae882 fix one part of the build break 9 years ago
Timothy Stack e07b4e448f [exec] add a prompt to execute lnav scripts 9 years ago
Timothy Stack 27f300b677 [sql] some more json-related updates/fixes 9 years ago
Timothy Stack 187d62334f [json] record the type of json data in json_ptr_walk 9 years ago
Timothy Stack e987a5164f [hist] rewrite the histogram code 9 years ago
Timothy Stack c874d95042 build fix 9 years ago
Timothy Stack ba25c77b07 build stuff 9 years ago
Timothy Stack 224a7196e4 [cmd] hide lines commands 9 years ago
Timothy Stack f3ca72f42d [jget] fix the jget function 9 years ago
Timothy Stack 5a718bc0ec [sql] missed checking for null in graphable columns 9 years ago
Timothy Stack 62075fb340 [sql] add json_group_object aggregate function 9 years ago
Timothy Stack 8964232374 [json] fixes for json log parsing
I was careless with the initial json log impl since it did not deal
with incomplete log lines very well.  This seems to fix some cases.
But, I was still able to replicate a lockup at one point, so it
might not be complete.
9 years ago
Timothy Stack 64cbab1281 [sql] exec .sql files in format dirs 9 years ago