Commit Graph

592 Commits (5af3664bc11123cdc7bc38aa006fb2bff3881303)

Author SHA1 Message Date
Timothy Stack 8e629b166a [build] some more compiler profiling
Defect Number:
    Reviewed By:
   Testing Done:
4 years ago
Timothy Stack 51d1204a96 [arc] add content hash to archive temp dir and tech debt 4 years ago
Timothy Stack 0765c07010 [view] migrate view_action stuff to function objects 4 years ago
Timothy Stack f192cb7c3e [input_dispatcher] fix handling of unicode input
Fixes #791
4 years ago
Timothy Stack db8a3c4d38 [debt] doing some cleanup
Defect Number:
    Reviewed By:
   Testing Done:
4 years ago
Timothy Stack e4ea9ca584 [arc] report errors when opening archives 4 years ago
Timothy Stack 8b38bb0970 [session] store file visibility 4 years ago
Timothy Stack c22c78220c [text] hide text files 4 years ago
Timothy Stack 7b77a612c2 [files] make file scanning async 4 years ago
Timothy Stack dfd18a4be5 [view] add files view 4 years ago
Timothy Stack 3b0168025d [cmds] add support for hiding files 4 years ago
Timothy Stack 579e4274f9 [files] initial impl for opening archives 4 years ago
Timothy Stack 9f524136bd [fs] remove old filesystem impl 4 years ago
Timothy Stack d8a083f0fe [filters] add :toggle-filtering command 4 years ago
Timothy Stack 74bfa21050 [build] missed a file 4 years ago
Timothy Stack 65c991919b [loader] fix format loader and add $schema refs to formats 4 years ago
Suresh Sundriyal 63ed3ee677 [dist] Prevent distributing built sources 4 years ago
Timothy Stack a5171058c7 [build] some built files were being included in the dist 4 years ago
Suresh Sundriyal f35f855458 [tests] Remove use of deprecated std::random_shuffle 4 years ago
Timothy Stack ce0383dee1 [build] fix some warnings 4 years ago
Timothy Stack 349991a695 [shlex] fix handling of tilde 4 years ago
Timothy Stack 815a05577e [keymap] suggest the config option to set for an unknown keystroke
Also, add a unicode green-check/red-X mark for the success/error
message for commands.
4 years ago
Timothy Stack ba1bc28209 [build] fix issues with test files 4 years ago
Timothy Stack 82b34bb02a [config] remove :save-config 4 years ago
Timothy Stack 84a7079e3f [main] capture stderr only after initscr() and fix curl configure detection 4 years ago
Timothy Stack a2b3427502 [tests] add tests for SQL annotation functionality 4 years ago
Timothy Stack d695febe14 [cmd] add :write-jsonlines-to command 4 years ago
Timothy Stack d040e75d42 [build] fix a test 4 years ago
Timothy Stack 07d5aba7b5 [build] remove test files 4 years ago
Timothy Stack ebd1038057 [pretty] include linefeeds in the pretty output
Defect Number:
    Reviewed By:
   Testing Done:
4 years ago
Timothy Stack e85fff0b88 [sql] add json_concat() function and misc fixes 4 years ago
Timothy Stack 9cbe4d73a9 [docs] start to flesh out command and sql docs 4 years ago
Timothy Stack defb00303f [docs] some changes 4 years ago
Timothy Stack 6073464722 [build] disable test for now 4 years ago
Timothy Stack a8e97a180b [build] remove stale dep 4 years ago
Timothy Stack 8413dd13d8 [config] add configs directory 4 years ago
Timothy Stack 99a8eb9850 [build] try again 4 years ago
Timothy Stack 7e538c85f9 [tests] try to fix breakage 4 years ago
Timothy Stack 3da3ec799a [session] allow the name 4 years ago
Timothy Stack 138a506b1a [perf] a few performance tweaks 4 years ago
Timothy Stack 0744a9b6de [docs] mention the view tables
Defect Number:
    Reviewed By:
   Testing Done:
4 years ago
Timothy Stack 07f4b56646 [tests] update some expected results
so lazy...
5 years ago
Timothy Stack e525d247ae [json-log] some more fixes for handling invalid json logs 5 years ago
Timothy Stack 8b750c83f1 update expected output 5 years ago
Timothy Stack 98519b045a [help] mention hide/show-unmarked-lines
Fixes #631
5 years ago
Timothy Stack b7255419e6 [test] fix sed usage
Fixes #572
5 years ago
Timothy Stack 9d6e6e4638 [build] fix a typo 5 years ago
Timothy Stack 27587ee917 [test] get test working on OS X 5 years ago
Tim Stack b2463e44a3
Merge pull request #677 from phord/gzip-index
Add a gzip indexing class for faster gz navigation
5 years ago
Timothy Stack f11364660d [build] missed file in makefile 5 years ago
Timothy Stack 73e902f7d8 [json-log] handle invalid json log lines
Header from folded patch 'foldme1.patch':

[local] foldme
5 years ago
Phil Hord 5513deeade Add a gzip indexing class for faster gz navigation
The gzread function is slow.  Every time you seek to a new location, the
whole file up to that position has to be decompressed again.  This causes
massive lags when trying to do simple things in lnav on a large .gz file.

Use the zlib inflate* functions instead and record the dictionary
periodically while processing the file the first time.  Then use
inflateSetDictionary to restore the dictionary to a convenient
location when trying to seek into the file again in the future.

Use a default period of 1MB of compressed data for syncpoints.
Each syncpoint uses 32KB. This is a ratio of 3.2%.  For example,
a 1GB .gz file (compressed size) will require us to keep 32MB
of index data in memory. A better method may be to use a fixed
number of syncpoints and divide the file appropriately. This
would keep the memory bounded at the cost of slower file
navigation on large .gz files.

Use pread to read the data for the stream decompressor and remove
the lock_hack previously employed.

NB. The documentation on these zlib functions is sparse. I followed
the example in zlib/examples/zran.c, but I used the z_stream total_in
and total_out variables instead of keeping my own separately as zran.c
does.  Maybe this is incompatible with some very old zlib versions.
I haven't looked.
5 years ago
Timothy Stack 585986057d [build] missed cleaning a dir up 5 years ago
Timothy Stack 56a341f7f8 [view_curses] colors
Defect Number:
    Reviewed By:
   Testing Done:
5 years ago
Timothy Stack 9a05b9d186 [config] pay attention to XDG_CONFIG_HOME
Fixes #105
5 years ago
Timothy Stack e442f84e80 [textview] pause loading of files by pressing =
Fixes #670
5 years ago
Timothy Stack 63dba408ec [stdin] Keep the stdin piper file in .lnav so that it can be reopened
When piping the output of a program into lnav, the data would
be dumped to the terminal on exit so that it would not be
lost.  Since that is a bit noisy, the temp file used to store
the data is now left in .lnav so that it can be reopened later.
Older stdin captures are automatically removed after a day.

Also took the opportunity to start using filesystem::path more.

Fixes #436
5 years ago
Timothy Stack ffd9d88add [log_format] ignore line-format field if timestamp-format is set
Fixes #661
5 years ago
Timothy Stack 34db64aa32 [logfile] the index rebuild didn't check the mtime if the file size was the same
Fixes #668
5 years ago
Timothy Stack 7c485f64dc [cmake] fix some test targets 5 years ago
Timothy Stack 1257fcd62a [codacy] fix a few issues turned up 5 years ago
Timothy Stack 325e4a15d9 [build] test out the hunter package manager 5 years ago
Timothy Stack 76edd2a9d1 [line_buffer] refactor left a bug with non-blocking files
Fixes #662
5 years ago
Timothy Stack b81b35c866 [log-view] in time-offset mode, show negative times for messages before the first mark
Prototype for #395
5 years ago
Timothy Stack d61f2568d6 [ptimec] fix a case of undefined behavior 5 years ago
Timothy Stack a10fa06b10 [build] remove test file 5 years ago
Timothy Stack 02c53976b4 Some refactoring for the line buffer and other cleanups
Fixes #649
5 years ago
Timothy Stack 6cf5cc8213 [logfile] fix issue when files have headers
Defect Number:
    Reviewed By:
   Testing Done:
5 years ago
Timothy Stack 1fc24ecabf [bin2c] improve building of data files that are incorporated into the binary 5 years ago
Timothy Stack c7046b0b54 [json] newlines in the line format cause problems
Fixes #644
5 years ago
Timothy Stack 76b08f5fe3 [build] fix other lib order 5 years ago
Timothy Stack fb7d6eafaf [build] some refactoring of files 5 years ago
Timothy Stack 63e53377c3 [theme] add monocai theme 5 years ago
Timothy Stack a8e1f62da6 [build] add fmt lib 5 years ago
Timothy Stack fc9f9f43cf add bad-config to the dist 5 years ago
Timothy Stack 06d1098211 [config] initial support for themes
For #422

Still more to do
5 years ago
Timothy Stack 6f451eec35 [pretty] fix crash when rewriting lines 5 years ago
Timothy Stack 5e8a1cebe9 [json-log] handle arrays in json log message fields
Fixes #635
5 years ago
Timothy Stack 062d480fea [sql] fix some issues found while trying to query some logs 5 years ago
Timothy Stack 2fa603d07e [tests] fix a test 5 years ago
Timothy Stack 78d80fddd5 [cli] add -r flag for recursively loading files from a directory hierarchy
Fixes #431
5 years ago
Timothy Stack 33cdbefaaa [help] some online help additions 5 years ago
Timothy Stack 21c5c52843 [format] allow multiple log format patterns per log file
This tries to address #624
5 years ago
Timothy Stack 0e12f98ae7 [sql] change base_time to time_offset 5 years ago
Timothy Stack 469124d72b [time-offset] fixes
Defect Number:
    Reviewed By:
   Testing Done:
5 years ago
Timothy Stack 4614cbcb75 [sql] fix joins on some vtables 5 years ago
Timothy Stack 43243c7ba3 [build] revive freebsd release build
Some misc fixes for filtering as well
5 years ago
Timothy Stack 02b9e13343 [filters] add the number of hits for each filter in the editor
Might be useful to know the number of hits for a given filter.
5 years ago
Timothy Stack 659f01c9ae [filters] add a log_filters column to log tables that contains the matched filters
Related to #597
5 years ago
Timothy Stack 153b59ea8a [status] some fixes for the bottom status bar
Fixes #603
Fixes #578
5 years ago
Timothy Stack 104b8736e8 [vtab] fix for failed update to log_tags column and fix filtering with json logs 6 years ago
Timothy Stack 3d77fb2acf [cmds] change :write-raw-to to write all the lines in the view
Fixes #606
6 years ago
Timothy Stack 31c440777f [hotkeys] add ctrl+f to toggle filters
Fixes #604
6 years ago
Timothy Stack 0c2f84a3c0 [hotkeys] press 7/8 for previous/next minute
Fixes #382
6 years ago
Timothy Stack 5fff4d8784 [help] add some initial help text for search/SQL prompts
Also:
  * You can now "scroll out" of the visual editor to
    return to the main view.  This should alleviate the
    frustration of pressing up/down arrows thinking the
    main view should move but, really, you're stuck in
    the editor.
  * The three-dot-ellipsis for hidden fields has been
    replaced with a unicode vertical ellipsis so that
    less space is taken up.
6 years ago
Timothy Stack dcccebe797 [sql] add some help for regexp_capture()
Fixes #593
6 years ago
Timothy Stack 7dfa0e9dd4 [textview] highlights that start from the beginning of the line are not working in the log view
The log view prefixes lines with some extra characters and they
were mistakenly being included when performing the highlight
regex.

Fixes #590
6 years ago
Timothy Stack a63b6a199c [filter] in the filter editor, use "t" to toggle the type of filter
Related to #423
6 years ago
Timothy Stack 814ad03ec9 [view] keep a history of view positions
Fixes #577
6 years ago
Timothy Stack e001b49e28 [format] hidden object/array fields add sub-lines when they should not
Fixes #576
6 years ago