Commit Graph

157 Commits

Author SHA1 Message Date
Tim Stack
1c8c7089cb [log_format] try to do a better job matching JSON formats to logs
Try all formats and find the one with the highest quality
match.  For JSON logs, this means the format that matched
the most fields in the line-format.

Related to #1136
2023-06-20 09:38:11 -07:00
Tim Stack
5db31300c9 [logfile] avoid reading full log messages that are bigger than the line_buffer max size 2023-06-19 07:01:22 -07:00
Tim Stack
dd21bdfd82 [text_filter] scrub ansi when testing a filter
Related to #1163
2023-06-09 08:43:14 -07:00
Tim Stack
db1fc92fdd [ansi] missed resizing a buffer when scrubbing ansi
Fixes #1135
2023-03-30 22:06:19 -07:00
Tim Stack
faeaf477ab [yajlpp] flesh things out a bit more 2022-10-04 21:17:01 -07:00
Tim Stack
094b45f7ca [nits] minor fixes 2022-09-23 11:08:22 -07:00
Tim Stack
d940d9d5eb [logfile] plumb gzip header through file meta 2022-09-20 20:07:44 -07:00
Tim Stack
e0ecbdff10 [logfile] improve handling of ansi escapes
I think this covers the rest of the functionality
that needs to deal with ansi escapes.

Related to #1057
2022-09-19 20:15:35 -07:00
Tim Stack
740b827901 [logfile] handle logs with ANSI escapes
This is a partial fix for handling ANSI escapes in
parts of log messages that would prevent regexes
from matching.  Still more work to do.

Related to #1057
2022-09-14 21:43:36 -07:00
Tim Stack
eaa6e50a52 [log_format] perform more validations on log formats 2022-09-12 07:18:26 -07:00
Tim Stack
5a63ece31d [pcre2] migrate from pcre to pcre2
Fixes #974
2022-09-10 09:28:07 -07:00
Tim Stack
6ca01cd934 [line_buffer] fix some long-line handling 2022-09-04 06:38:39 -07:00
Tim Stack
7310f9dcec [formats] add description and level properties to tag definitions 2022-08-20 06:41:44 -07:00
Tim Stack
53c9c5cb51 [logfile] move bookmark_metadata to logfiles 2022-08-19 20:01:25 -07:00
Tim Stack
a1de8f1fc1 [search-table] fix clearing of message data 2022-08-15 21:45:31 -07:00
Tim Stack
f73e71cf30 [perf] issues with matching filenames and ansi scrubbing 2022-08-11 11:16:49 -07:00
Tim Stack
c5d11f36e1 [logfile] need to flush the buffer for single line files as well 2022-08-04 14:57:01 -07:00
Tim Stack
7b32ea9d39 [logfile] fix handling of partial lines 2022-08-02 16:03:39 -07:00
Timothy Stack
8ef581177c [line_buffer] add some performance counters for tracking SQL perf
Also, check for keyboard input during SQL execution
so we can cancel.

Fixes #894
2022-07-27 21:49:14 -07:00
Timothy Stack
b3ee092dc5 [cleanup] remove unused stuff and add a test 2022-07-22 15:31:08 -07:00
Timothy Stack
4c20b0039c [sql] some more error improvements 2022-07-13 15:43:41 -07:00
Timothy Stack
39763b2d31 [vtab] add indexes for text columns 2022-07-10 21:00:45 -07:00
Timothy Stack
8b3b8a6e3c [perf] fix some text file loading issues 2022-07-07 22:13:18 -07:00
Timothy Stack
36e9433891 [perf] try to overlap line buffer i/o 2022-07-07 10:05:06 -07:00
Timothy Stack
f9f797fc9d [logfile_sub_source] add log message watch expressions
Fixes #539
2022-06-28 22:23:56 -07:00
Timothy Stack
1891ceb7b5 [perf] fix some performance issues with log vtabs
Fixes #995
2022-06-10 21:17:02 -07:00
Timothy Stack
0b6de5ae31 [oops] remove leftover debug log 2022-06-04 15:46:00 -07:00
Timothy Stack
60251dda84 [w3c_log] handle an invalid log correctly
Fixes #988
2022-06-04 15:31:48 -07:00
Timothy Stack
dfaeee7f44 [perf] fix some performance issues 2022-06-03 19:17:00 -07:00
Timothy Stack
31a670ce27 [md4c] initial markdown support 2022-05-22 20:44:18 -07:00
Timothy Stack
a27198e8ca [regex101] add an integration with regex101
... and a pile of other changes
2022-04-30 13:06:01 -07:00
Timothy Stack
81e63784e7 [modernize] some more cleanups 2022-03-31 08:59:33 -07:00
Timothy Stack
b856cd9657 [build] silence some warnings 2022-03-28 22:00:49 -07:00
Timothy Stack
66ef5fdae1 [clang-format] init 2022-03-16 15:38:08 -07:00
Timothy Stack
4564e162d0 [build] try to optimize compile time 2022-03-13 15:49:41 -07:00
Timothy Stack
8bb034eeeb [pcap] initial pcap support
Fixes #12
2021-11-05 15:13:16 -07:00
Timothy Stack
1c5567157f [build] use other #define for max 2021-09-24 09:35:01 -07:00
Timothy Stack
458b959a13 [headless] fix an issue with headless rebuilds 2021-09-24 09:30:03 -07:00
Timothy Stack
b2f11ac27f [intern] some cleanup 2021-09-22 16:01:03 -07:00
Timothy Stack
312a97bca7 [logfile] tweak overwrite detection to ignore remote files
The mtime of a remote file is not adjusted in an atomic fashion,
so it can cause a spurious overwrite signal
2021-09-07 14:23:12 -07:00
Timothy Stack
a87c420070 [logfile] some more notes stuff 2021-05-30 15:07:09 -07:00
Timothy Stack
8f7b08c9c5 [logfile] add notes for automatic decisions and fix compile errors
Fixes #864
2021-05-30 13:33:05 -07:00
Timothy Stack
a6a411834e [lint] use enum class for logfile::rebuild_result 2021-05-29 21:46:48 -07:00
Timothy Stack
9c417afb2d [logfile] remove error exception and some optimizations 2021-05-28 22:53:50 -07:00
Timothy Stack
46bafa1dea [remote] show progress during startup 2021-05-27 22:02:26 -07:00
Timothy Stack
0dca44f487 [rebuild] add a deadline to make the UI more responsive 2021-05-26 22:09:47 -07:00
Timothy Stack
c3dc668b69 [remote] add some config options and remove the copied tailer binary
Also fix time offset issue
2021-05-19 22:05:21 -07:00
Timothy Stack
0dbe5f0f94 [logfile] increase format detection limit 2021-05-06 10:42:05 -07:00
Timothy Stack
f050c7b0a7 [remote] start to wire up remote support 2021-05-01 08:33:54 -07:00
Timothy Stack
94498878c8 [logfile_sub_source] try to avoid a full rebuild in some cases 2021-04-24 14:38:26 -07:00