Commit Graph

1349 Commits

Author SHA1 Message Date
Timothy Stack
9d87cfa2f0 [debt] more tech debt 2020-11-12 21:58:40 -08:00
Timothy Stack
cb7a8904c1 [build] missed header in the makefile 2020-11-09 23:11:49 -08:00
Timothy Stack
9eee6b2b64 [build] missing header 2020-11-09 23:02:08 -08:00
Timothy Stack
f192cb7c3e [input_dispatcher] fix handling of unicode input
Fixes #791
2020-11-09 22:18:17 -08:00
Timothy Stack
db8a3c4d38 [debt] doing some cleanup
Defect Number:
    Reviewed By:
   Testing Done:
2020-11-09 22:17:17 -08:00
Timothy Stack
21e78670e2 [highlighter] fix a mistake in the offset used for semantic highlights 2020-11-05 16:07:35 -08:00
Timothy Stack
00dcd86f79 [view_curses] always apply utf adjustments in mvwattrline
doh

Fixes #786
2020-11-04 10:50:37 -08:00
Timothy Stack
78d5954fd7 [build] fix conversion 2020-11-01 06:23:57 -08:00
Timothy Stack
5c73ce0a85 [build] fix noarchive build 2020-10-31 23:12:40 -07:00
Timothy Stack
e4ea9ca584 [arc] report errors when opening archives 2020-10-31 22:19:41 -07:00
Timothy Stack
563fa94d39 [log] fix fill character for file name prefix 2020-10-29 15:33:15 -07:00
Timothy Stack
9bfe1f8319 [cmds] include filename in copied log lines when shown
Fixes #789
2020-10-28 22:56:58 -07:00
Timothy Stack
df3df8369c [session] stages 2020-10-28 21:24:23 -07:00
Timothy Stack
5e42b4cb8a [debt] include cleanup 2020-10-28 21:23:46 -07:00
Timothy Stack
0dff822ade [debt] remove pthreadpp.hh 2020-10-28 21:23:41 -07:00
Timothy Stack
56866d8a33 [config-ui] support for searching 2020-10-28 21:23:34 -07:00
Timothy Stack
8b38bb0970 [session] store file visibility 2020-10-28 21:23:25 -07:00
Timothy Stack
c22c78220c [text] hide text files 2020-10-28 21:23:16 -07:00
Timothy Stack
7b77a612c2 [files] make file scanning async 2020-10-28 21:22:56 -07:00
Timothy Stack
dfd18a4be5 [view] add files view 2020-10-28 21:21:57 -07:00
Timothy Stack
4b7244d06c [archive] add locking 2020-10-28 21:20:57 -07:00
Timothy Stack
a63cf003a0 [themes] move highlights to theme definitions
Fixes #783
2020-10-28 21:19:57 -07:00
Timothy Stack
3b0168025d [cmds] add support for hiding files 2020-10-28 21:18:57 -07:00
Timothy Stack
579e4274f9 [files] initial impl for opening archives 2020-10-28 21:17:57 -07:00
Timothy Stack
9f524136bd [fs] remove old filesystem impl 2020-10-20 22:55:46 -07:00
Timothy Stack
e7f5bf3a6a [3rd-party] import ghc/filesystem 2020-10-20 22:54:59 -07:00
Phil Hord
1d127053e9 Don't try to read concatenated gzip streams
Don't try to continue reading the next stream of a concatenated
gzip file.  The next stream may be CRC noise or other garbage.

Maybe in the future we should look for a gzip header in the
following bytes of the stream and try to decode from there.
But it's not clear that anyone ever uses this supposed gzip
feature anyway.

Let's just end the stream when we reach EOS. Also, if the
stream fails to init, let's leave it closed instead of throwing
an error no one is likely to catch.  Log the error msg from
zlib if one is provided.
2020-10-19 20:49:36 -07:00
Timothy Stack
2a7db9b257 [root-config] default /ui/default-colors to true 2020-10-07 21:32:29 -07:00
Timothy Stack
d8a083f0fe [filters] add :toggle-filtering command 2020-10-02 21:17:52 -07:00
Timothy Stack
b44b6d24cf [themes] use an empty string to get the terminal default background instead of specifying black
Defect Number:
    Reviewed By:
   Testing Done:
2020-10-02 14:05:27 -07:00
Timothy Stack
276f71423e [readline] add alternate enter command 2020-09-30 21:55:37 -07:00
Tim Stack
cc6ae5ee2e
Update format2csv.py 2020-09-29 14:14:43 -07:00
Suresh Sundriyal
3a9967cbf5 [build] Get rid of BUILT_SOURCES 2020-09-24 19:17:36 -07:00
Suresh Sundriyal
cc6f0a06dd [build] Add some explicit dependencies.
This should fix the individual make targets.
2020-09-24 19:17:36 -07:00
Timothy Stack
65c991919b [loader] fix format loader and add $schema refs to formats 2020-09-24 13:12:43 -07:00
Timothy Stack
7763d2db7a [cross] try to fix armhf
Defect Number:
    Reviewed By:
   Testing Done:
2020-09-24 09:40:56 -07:00
Timothy Stack
6ec90c521b [build] dump crash log during build 2020-09-24 08:58:20 -07:00
Timothy Stack
e04d49bc98 fix a memory error in extension-functions.cc 2020-09-24 06:49:38 -07:00
Timothy Stack
c3646be987 [build] fix some issues on 32-bit arch 2020-09-23 22:36:47 -07:00
Suresh Sundriyal
f8e990cf76 [dist] Some more distribution related cleanup.
Remove init-sql.h from the distributed package and remove the redundant
files from DISTCLEAN.
2020-09-23 16:20:11 -07:00
Suresh Sundriyal
8b2bcca752 [dist] Stop packaging builtin-scripts.h 2020-09-23 14:57:17 -07:00
Timothy Stack
f39a208472 [cmake] ptimec doesn't belong in libdiag 2020-09-22 14:38:24 -07:00
Timothy Stack
f43d05a49a [build] more dist fixes 2020-09-22 14:31:27 -07:00
Suresh Sundriyal
63ed3ee677 [dist] Prevent distributing built sources 2020-09-22 13:50:37 -07:00
Timothy Stack
a5171058c7 [build] some built files were being included in the dist 2020-09-22 12:01:13 -07:00
Timothy Stack
8ff80ceff0 [lnav_log] shorten file name to the base name 2020-09-21 07:25:40 -07:00
Tim Stack
d58ce0cc90
Merge pull request #769 from sureshsundriyal/freebsd
[freebsd] Remove basename from log_msg.cc and update the FreeBSD image in the VagrantFile.
2020-09-21 07:10:16 -07:00
Timothy Stack
48d4b51fd7 [view_curses] fix mvwattrline for utf chars
Fixes #675
2020-09-21 06:53:05 -07:00
Suresh Sundriyal
70847429fa [freebsd] Remove the use of basename from log_msg.
Fix
2020-09-20 23:27:22 -07:00
Suresh Sundriyal
2062a0c740 [cross-compile] Use 'BUILD_EXEEXT' as the suffix for build binaries.
Some compilers automatically append the system binary suffix. If lnav is
cross compiled on such systems; then we should be using this suffix for
the binaries that are built and run as part of the build process.
2020-09-20 20:50:47 -07:00
Suresh Sundriyal
bc0dc337ef [cross-compiling] Disable document generation during cross-compilation
Document generation requires exec'ing lnav which might not be possible
while cross-compiling.
2020-09-19 14:39:24 -07:00
Timothy Stack
37b9b346a9 [logger] fix for queue.h removal change 2020-09-19 14:17:22 -07:00
Timothy Stack
99805c61bb [build] missing include 2020-09-19 13:04:21 -07:00
Timothy Stack
e8e89ad0fd [build] remove queue.h refs 2020-09-19 12:34:44 -07:00
Suresh Sundriyal
bc09aad96c Undo changes to cmd-ref.rst 2020-09-18 12:32:36 -07:00
Suresh Sundriyal
4946f79ec1 [ptimec] Rename ptimec.cc -> ptimec.c 2020-09-18 12:20:40 -07:00
Suresh Sundriyal
57e0b9f3f3 [cross-compiling] Fix distcheck target 2020-09-18 11:44:06 -07:00
Suresh Sundriyal
d118a60a36 [cross-compile] Allow build artifacts to be built with build compilers.
While cross-compiling; bin2c and ptimec need to run during build on the
build-host. Currently; the host compiler is picked and the generated
binaries cannont be exec'ed causing the build to fail.

The change fixes the bin2c and ptimec compilation units to use the
build host compatible compiler.
2020-09-18 10:03:12 -07:00
Timothy Stack
ba4b31b24a remove noisy debug log 2020-09-18 09:41:35 -07:00
Suresh Sundriyal
0dedb3d455 [simd] Allow toggling of simd related functionality 2020-09-17 21:20:52 -07:00
Timothy Stack
da772a6486 [build] try to fix distclean issue 2020-09-16 23:14:05 -07:00
Timothy Stack
f1a47ac1ad [log_format] make logline_value slightly less error-prone 2020-09-16 21:46:44 -07:00
Timothy Stack
90ab6ea8f1 [bro-log] fix an issue with the logline_values in the bro log format 2020-09-16 14:38:58 -07:00
Timothy Stack
ee572a2c86 [init] fix an issue with input not being taken when an empty file is loaded 2020-09-16 14:05:56 -07:00
Timothy Stack
dbe252c70c [docs] some more doc stuff 2020-09-15 15:45:29 -07:00
Timothy Stack
bbf06e78ba [init] delay initial command execution until some files are loaded
Fixes #764
2020-09-15 15:44:29 -07:00
Timothy Stack
cc7cba6514 [search] start searching a couple thousand lines before the top 2020-09-14 21:29:06 -07:00
Timothy Stack
be106fcb8d [docs] add some more keymap/theme docs 2020-09-13 23:03:23 -07:00
Timothy Stack
5e1f43b4c7 [readline] refine tab-completion for config options 2020-09-12 21:02:20 -07:00
Timothy Stack
9773efd3a5 [keymap] add german keymap 2020-09-12 14:06:23 -07:00
Timothy Stack
ce0383dee1 [build] fix some warnings 2020-09-11 23:10:11 -07:00
Suresh Sundriyal
9a49035ce6 [Format] Designate non-capturing group 2020-09-11 21:07:03 -07:00
Suresh Sundriyal
7494f5cef5 Optimize the vum-log4cpp expression 2020-09-11 19:52:24 -07:00
Suresh Sundriyal
9b2b9d50ba Remove unused header 2020-09-11 15:30:55 -07:00
Suresh Sundriyal
908c41cb64 Fix compiler warnings about unused variables. 2020-09-11 15:30:55 -07:00
Suresh Sundriyal
a24aa5e414 [Format] Make the levels regex case-insensitive. 2020-09-11 13:00:19 -07:00
Suresh Sundriyal
83a3e69118 [Format] Fix up the greedy match 2020-09-11 12:53:12 -07:00
Suresh Sundriyal
2d30bfd322 [Format] Add updatemgr's log4cpp format to vmw_log format. 2020-09-11 12:18:52 -07:00
Timothy Stack
16c5fdccb4 [build] more win build 2020-09-10 22:15:02 -07:00
Timothy Stack
f9b3884b5e [build] try to fix win build 2020-09-10 21:45:42 -07:00
Timothy Stack
349991a695 [shlex] fix handling of tilde 2020-09-10 21:19:23 -07:00
Timothy Stack
3692c76788 [build] fix uninit var warning 2020-09-10 11:23:17 -07:00
Timothy Stack
f3d172c831 [keymap] add a french keymap 2020-09-09 22:16:06 -07:00
Timothy Stack
a3264fb104 [log_format] fix issues with year rollover
Defect Number:
    Reviewed By:
   Testing Done:
2020-09-08 22:11:32 -07:00
Timothy Stack
8a3fbe6375 [cmds] fix error format strings 2020-09-08 09:26:42 -07:00
Timothy Stack
815a05577e [keymap] suggest the config option to set for an unknown keystroke
Also, add a unicode green-check/red-X mark for the success/error
message for commands.
2020-09-05 14:41:05 -07:00
Timothy Stack
8734795505 [keymap] handle unicode keys and add UK keymap
Fixes #392
2020-09-04 14:39:04 -07:00
Timothy Stack
82b34bb02a [config] remove :save-config 2020-09-03 14:09:35 -07:00
Timothy Stack
ead1d3eb36 [build] fix some more warnings 2020-09-02 23:04:21 -07:00
Timothy Stack
c5a82240ec [build] try to fix some warnings 2020-09-02 22:36:26 -07:00
Timothy Stack
84a7079e3f [main] capture stderr only after initscr() and fix curl configure detection 2020-09-02 15:39:27 -07:00
Timothy Stack
f0934a6e3c [theme] fix background color in the default theme 2020-08-30 22:48:07 -07:00
Timothy Stack
0940e97b2b [nits] fix some naming issues
Fixes #169
2020-08-30 22:13:56 -07:00
Timothy Stack
1f2cf13739 [text] highlight rust code 2020-08-27 22:24:46 -07:00
Timothy Stack
6182b6b41c [mouse] do not require xterm for mouse use
Fixes #727
2020-08-27 14:13:43 -07:00
Timothy Stack
4fa4a7057b [log_format] gracefully handle a misconfigured log format
Fixes #742
2020-08-27 13:42:10 -07:00
Timothy Stack
d0f2f9e800 [view_curses] fix attribute range when the line contains UTF-8 chars
Fixes #745
2020-08-27 13:42:05 -07:00
Timothy Stack
a2b3427502 [tests] add tests for SQL annotation functionality 2020-08-26 22:44:12 -07:00
Timothy Stack
1269654617 fix SQL prompt help lookup
Fixes #748
2020-08-25 16:27:22 -07:00
Timothy Stack
e451c7c112 [docs] more usage notes
Defect Number:
    Reviewed By:
   Testing Done:
2020-08-24 22:50:48 -07:00
Timothy Stack
d695febe14 [cmd] add :write-jsonlines-to command 2020-08-21 23:18:51 -07:00
Timothy Stack
2a37a9ce7f [build] fix the previous checkin 2020-08-17 21:55:55 -07:00
Timothy Stack
45630545ed [lss] fix identifier highlighting 2020-08-17 21:31:23 -07:00
Timothy Stack
bda6fe46b1 [view_curses] minor fix for ansi display 2020-08-15 21:58:19 -07:00
Timothy Stack
e0181a0adb [build] fix build when libcurl is available
Fixes #739
2020-06-24 11:57:41 -07:00
Timothy Stack
ebd1038057 [pretty] include linefeeds in the pretty output
Defect Number:
    Reviewed By:
   Testing Done:
2020-05-19 22:13:52 -07:00
Timothy Stack
7a0cb4359c [docs] fix lexing of lnav commands 2020-05-18 22:21:24 -07:00
Timothy Stack
ee7ffb7194 [docs] add generated sql reference 2020-05-18 21:09:47 -07:00
Timothy Stack
9c3f0eee89 [build] fix cmake build and lexing of sqlite in docs
Defect Number:
    Reviewed By:
   Testing Done:
2020-05-18 07:10:07 -07:00
Timothy Stack
e85fff0b88 [sql] add json_concat() function and misc fixes 2020-05-17 22:23:30 -07:00
Timothy Stack
9cbe4d73a9 [docs] start to flesh out command and sql docs 2020-05-15 07:38:40 -07:00
Timothy Stack
defb00303f [docs] some changes 2020-05-13 09:38:41 -07:00
Timothy Stack
f23791af18 [internals] ignore failure to open file 2020-05-09 12:05:45 -07:00
Timothy Stack
c6196fe79f [build] missed TEXT2C_FILES 2020-05-09 10:03:28 -07:00
Timothy Stack
8f4149db94 [build] need to dist the format files 2020-05-09 09:55:06 -07:00
Timothy Stack
8e9ef5765f [formats] break up default-log-formats.json into separate files for each file format
Defect Number:
    Reviewed By:
   Testing Done:
2020-05-08 22:04:39 -07:00
Timothy Stack
7e36c6b3d0 [build] do not fail if syslog is not readable during build 2020-05-08 09:36:57 -07:00
Timothy Stack
8413dd13d8 [config] add configs directory 2020-05-07 07:08:59 -07:00
Timothy Stack
9b28a90ab0 pay attention to the result of rebuild_index() 2020-04-25 15:43:31 -07:00
Timothy Stack
7e538c85f9 [tests] try to fix breakage 2020-04-25 13:30:28 -07:00
Timothy Stack
8a0193691f ignore stdin when it is from /dev/null 2020-04-25 13:19:41 -07:00
Timothy Stack
3da3ec799a [session] allow the name 2020-04-25 07:32:05 -07:00
Timothy Stack
138a506b1a [perf] a few performance tweaks 2020-04-23 06:42:48 -07:00
Timothy Stack
0744a9b6de [docs] mention the view tables
Defect Number:
    Reviewed By:
   Testing Done:
2020-04-21 21:04:03 -07:00
Timothy Stack
d5373abeb4 [sql] bind $LINES/$COLS variables to the size of the window
Fixes #698
2020-04-21 06:20:25 -07:00
Timothy Stack
eef28d61a6 [view_curses] fix out-of-bounds access in mvwattrline 2020-04-19 14:32:34 -07:00
Timothy Stack
92f28f1174 [logfile] cache line length to fix perf issues with JSON logs 2020-03-11 07:25:39 -07:00
Stéphane Blondon
70ed1c9af7 Add thread id for multithreaded Apache error log 2020-01-17 12:22:41 +01:00
edr
3e82a06302 [delete-filter] Fix issue #701: (Filter deletion before enter) 2019-11-23 19:55:32 +01:00
Timothy Stack
9db2dfa7a4 [theme] default to using default colors and, if default coloring is not enabled, turn -1 into white/black for fg/bg 2019-10-23 06:09:47 -07:00
Timothy Stack
e525d247ae [json-log] some more fixes for handling invalid json logs 2019-10-19 07:11:47 -07:00
Timothy Stack
10b8d64b03 [lnav_log] fix lldb arguments 2019-10-17 20:02:32 -07:00
Timothy Stack
0935e1c356 missed adding redirect-to to the docs 2019-09-11 08:11:20 -07:00
Timothy Stack
5901c92794 [open-cmd] use line_buffer to load preview data
Fixes #680
2019-09-11 06:01:16 -07:00
Timothy Stack
98519b045a [help] mention hide/show-unmarked-lines
Fixes #631
2019-09-10 05:50:10 -07:00
Tim Stack
03dc27f30a
Merge pull request #641 from matt-hayden/master
More clipboard commands
2019-09-09 21:37:07 -07:00
Tim Stack
b2463e44a3
Merge pull request #677 from phord/gzip-index
Add a gzip indexing class for faster gz navigation
2019-09-09 21:35:44 -07:00
Timothy Stack
73e902f7d8 [json-log] handle invalid json log lines
Header from folded patch 'foldme1.patch':

[local] foldme
2019-09-03 06:19:57 -07:00
Timothy Stack
cd3b9bbb71 [docs] start a CLI options page 2019-08-20 07:21:41 -07:00
Phil Hord
5513deeade Add a gzip indexing class for faster gz navigation
The gzread function is slow.  Every time you seek to a new location, the
whole file up to that position has to be decompressed again.  This causes
massive lags when trying to do simple things in lnav on a large .gz file.

Use the zlib inflate* functions instead and record the dictionary
periodically while processing the file the first time.  Then use
inflateSetDictionary to restore the dictionary to a convenient
location when trying to seek into the file again in the future.

Use a default period of 1MB of compressed data for syncpoints.
Each syncpoint uses 32KB. This is a ratio of 3.2%.  For example,
a 1GB .gz file (compressed size) will require us to keep 32MB
of index data in memory. A better method may be to use a fixed
number of syncpoints and divide the file appropriately. This
would keep the memory bounded at the cost of slower file
navigation on large .gz files.

Use pread to read the data for the stream decompressor and remove
the lock_hack previously employed.

NB. The documentation on these zlib functions is sparse. I followed
the example in zlib/examples/zran.c, but I used the z_stream total_in
and total_out variables instead of keeping my own separately as zran.c
does.  Maybe this is incompatible with some very old zlib versions.
I haven't looked.
2019-08-17 18:40:55 -07:00
Timothy Stack
165cd69c8d [vmw_log] allow colons in user names 2019-08-10 22:16:54 -07:00
Timothy Stack
56a341f7f8 [view_curses] colors
Defect Number:
    Reviewed By:
   Testing Done:
2019-08-07 09:46:19 -07:00
Timothy Stack
9a05b9d186 [config] pay attention to XDG_CONFIG_HOME
Fixes #105
2019-08-01 07:14:47 -07:00
Timothy Stack
07cc749c50 [stdin-capture] change save limit to 10MB 2019-07-31 10:11:23 -07:00
Timothy Stack
71f56d29da [hotkeys] remove extra call to textview_curses->handle_key() 2019-07-31 09:02:39 -07:00
Timothy Stack
ed67c6cf9f Remove noisy log message
Fixes #648
2019-07-30 21:50:02 -07:00
Timothy Stack
3669b73e5b [highlight] avoid highlighting keywords in comments and strings 2019-07-30 07:06:16 -07:00
Timothy Stack
e442f84e80 [textview] pause loading of files by pressing =
Fixes #670
2019-07-30 06:28:42 -07:00
Timothy Stack
63dba408ec [stdin] Keep the stdin piper file in .lnav so that it can be reopened
When piping the output of a program into lnav, the data would
be dumped to the terminal on exit so that it would not be
lost.  Since that is a bit noisy, the temp file used to store
the data is now left in .lnav so that it can be reopened later.
Older stdin captures are automatically removed after a day.

Also took the opportunity to start using filesystem::path more.

Fixes #436
2019-07-29 22:18:32 -07:00
Darragh O'Reilly
6e93145f23 Fix openstack_log debug level
So ":set-min-log-level info" gets rid of lines with DEBUG.
2019-07-29 17:22:51 +01:00