Commit Graph

116 Commits

Author SHA1 Message Date
Tim Stack
2e409a8251 [vmw_log] fix for capturing sub= 2023-06-16 06:06:26 -07:00
Tim Stack
f2a0c8f21c [logfile] include microseconds when converting timestamps
Mentioned in #1145

Also, fix the field hiding issue mentioned in #1146
2023-04-28 11:37:24 -07:00
Tobias Gruetzmacher
d675a8d10e
Add support for the bunyan JSON log format
See https://github.com/trentm/node-bunyan
2023-03-23 14:42:17 +01:00
Tobias Gruetzmacher
0958a9b189
Handle empty referer in access log (fixes #1059)
It seems most web servers log an empty referer as `"-"`, but GitLab's
nginx actually logs an empty field instead (`""`). Allow this in the
standard CLF format parser.
2022-09-20 16:34:25 +02:00
Tim Stack
eb0bd4ac9a [anon] add an anonymizer to help with support requests
Fixes #1055
2022-09-15 21:11:30 -07:00
Tim Stack
eaa6e50a52 [log_format] perform more validations on log formats 2022-09-12 07:18:26 -07:00
Tim Stack
e047386441 [sql] extract() assumed too much about elements 2022-09-01 14:33:51 -07:00
Tim Stack
84d2f56189 [formats] add / to pattern in unifi 2022-08-31 21:31:44 -07:00
Tim Stack
87791ec94b [markdown] add support for going to an anchor 2022-08-28 18:55:32 -07:00
Tim Stack
7310f9dcec [formats] add description and level properties to tag definitions 2022-08-20 06:41:44 -07:00
Tim Stack
53c9c5cb51 [logfile] move bookmark_metadata to logfiles 2022-08-19 20:01:25 -07:00
Tim Stack
001f26d066 [loader] make sure values defined in formats have a corresponding capture in at least one pattern 2022-08-16 21:38:17 -07:00
Tim Stack
d22727242a [formats] pickup old macos syslog format 2022-08-01 15:16:00 -07:00
Tim Stack
be862e0eab [scn] more scnlib conversions 2022-07-29 21:58:08 -07:00
Timothy Stack
8ef581177c [line_buffer] add some performance counters for tracking SQL perf
Also, check for keyboard input during SQL execution
so we can cancel.

Fixes #894
2022-07-27 21:49:14 -07:00
Timothy Stack
b3ee092dc5 [cleanup] remove unused stuff and add a test 2022-07-22 15:31:08 -07:00
Timothy Stack
5ea55afd74 [vtab] indexing improvements 2022-07-19 22:08:07 -07:00
Timothy Stack
80bddbd2e7 [formats] some more fixes for vmw formats 2022-07-17 14:11:23 -07:00
Timothy Stack
0f9c519061 [vmw_log] update to work with hostd on esx 2022-07-17 07:47:53 -07:00
Timothy Stack
d1521496cc [docs] fill out search-table docs 2022-07-13 22:24:49 -07:00
Timothy Stack
6393990b91 [nits] miscellaneous issues 2022-07-11 23:17:42 -07:00
Timothy Stack
a3f5c3239e [vtab] some more indexing fixes 2022-07-11 00:09:08 -07:00
Timothy Stack
8b3b8a6e3c [perf] fix some text file loading issues 2022-07-07 22:13:18 -07:00
Timothy Stack
812fa08055 [search-table] some more enhancements to search-tables 2022-07-05 21:46:12 -07:00
Timothy Stack
72c1c48e23 [perf] fixing slow queries 2022-07-01 16:02:14 -07:00
Timothy Stack
f9f797fc9d [logfile_sub_source] add log message watch expressions
Fixes #539
2022-06-28 22:23:56 -07:00
Timothy Stack
bc467aacf2 [formats] skip closed file 2022-06-10 22:44:05 -07:00
Timothy Stack
1891ceb7b5 [perf] fix some performance issues with log vtabs
Fixes #995
2022-06-10 21:17:02 -07:00
Timothy Stack
6c52760cc9 [events] initial events work
Related to #811
2022-06-09 12:49:06 -07:00
Timothy Stack
9dbbec832c [formats] more vmw format updates 2022-06-06 21:23:33 -07:00
Timothy Stack
eeddc318ff [formats] fix some of the vmw formats 2022-06-04 20:35:47 -07:00
Timothy Stack
dfaeee7f44 [perf] fix some performance issues 2022-06-03 19:17:00 -07:00
Timothy Stack
f03f9e704f [views] add a breadcrumb view 2022-05-10 21:58:32 -07:00
Timothy Stack
a27198e8ca [regex101] add an integration with regex101
... and a pile of other changes
2022-04-30 13:06:01 -07:00
Pedro Pombeiro
880ae7fc57
unifi: Support iptables log file 2022-04-11 22:26:15 +02:00
Timothy Stack
81e63784e7 [modernize] some more cleanups 2022-03-31 08:59:33 -07:00
Pedro Pombeiro
ca3b4b6c8c
unifi: Add kernel-other-proto format 2022-03-07 23:24:15 +01:00
Pedro Pombeiro
5028f84b59
Add ID for 'dnsmasq-dhcp' and 'other' formats 2022-03-07 23:24:15 +01:00
Pedro Pombeiro
16f5886cb1
Improvements to unifi format 2022-03-07 23:24:14 +01:00
Timothy Stack
0e23dcf4b5 [release] bump release number 2022-03-05 11:02:35 -08:00
Pedro Pombeiro
894c36dac4
Add format for UniFi gateway 2022-03-04 00:35:13 +01:00
Timothy Stack
8bb034eeeb [pcap] initial pcap support
Fixes #12
2021-11-05 15:13:16 -07:00
Timothy Stack
3d31b2b723 [build] fix lib link order 2021-10-03 13:54:09 -07:00
Timothy Stack
19fd336e9a [formats] add logfmt 2021-10-02 23:17:33 -07:00
Timothy Stack
b77367a3d3 [logs] some minor fixes
hide files on remote like with archives
fix vmw_log pattern
fix an NPE
2021-06-16 11:19:11 -07:00
Timothy Stack
516d13d772 [log_format] use DOTALL for format patterns 2021-06-03 15:59:01 -07:00
Timothy Stack
27bc9cf117 [vmw_log] format fix 2021-06-03 10:42:03 -07:00
Timothy Stack
326fbae163 [vmw_log] some pattern fixes 2021-05-27 23:01:07 -07:00
Timothy Stack
5607b1b08e [formats] handle some more vmw logs 2021-05-21 16:03:40 -07:00
Timothy Stack
b64342ca47 [log_format] display log_body for the body field instead of the format name and add :mark-expr command 2021-05-13 22:00:26 -07:00
Nicolas Bock
125c872849
Add format for OpenStack Keystone log files
Keystone logs are formatted differently than the other OpenStack
service logs.

Signed-off-by: Nicolas Bock <nicolasbock@gmail.com>
2021-04-29 10:17:06 -06:00
Timothy Stack
f5e88b7158 [docs] add ARCHITECTURE.md and various other things 2021-02-13 12:41:48 -08:00
Timothy Stack
fd40b55e0a [docs] some more README.md files 2021-02-07 21:30:02 -08:00
Timothy Stack
cac1175973 [services] initial pass at injecting services and a bunch of other stuff 2021-01-23 13:00:51 -08:00
Timothy Stack
2996a90afa [format] use the module level for a message 2020-12-31 13:55:53 -08:00
Timothy Stack
1d17ac7f29 [build] compress data files embedded in the binary to save some space
Fixes #763
2020-12-30 13:49:29 -08:00
Timothy Stack
4ff2b710d5 [log_format] change w3c_log to put extra columns into a JSON column 2020-12-18 22:35:23 -08:00
Timothy Stack
32f112b8de [formats] add w3c extended log format impl
Fiexes #798
2020-12-05 21:51:46 -08:00
Timothy Stack
65c991919b [loader] fix format loader and add $schema refs to formats 2020-09-24 13:12:43 -07:00
Suresh Sundriyal
9a49035ce6 [Format] Designate non-capturing group 2020-09-11 21:07:03 -07:00
Suresh Sundriyal
7494f5cef5 Optimize the vum-log4cpp expression 2020-09-11 19:52:24 -07:00
Suresh Sundriyal
a24aa5e414 [Format] Make the levels regex case-insensitive. 2020-09-11 13:00:19 -07:00
Suresh Sundriyal
83a3e69118 [Format] Fix up the greedy match 2020-09-11 12:53:12 -07:00
Suresh Sundriyal
2d30bfd322 [Format] Add updatemgr's log4cpp format to vmw_log format. 2020-09-11 12:18:52 -07:00
Timothy Stack
defb00303f [docs] some changes 2020-05-13 09:38:41 -07:00
Timothy Stack
8e9ef5765f [formats] break up default-log-formats.json into separate files for each file format
Defect Number:
    Reviewed By:
   Testing Done:
2020-05-08 22:04:39 -07:00