Commit Graph

1055 Commits (master)

Author SHA1 Message Date
Tim Stack 1c8c7089cb [log_format] try to do a better job matching JSON formats to logs
Try all formats and find the one with the highest quality
match.  For JSON logs, this means the format that matched
the most fields in the line-format.

Related to #1136
1 year ago
Tim Stack 4cb695fa68 [tests] remove use of sprintf() 1 year ago
Tim Stack 51841d40b8 [view] add selection column to lnav_views
related to #1149
1 year ago
Tim Stack f096824034 [build] general actions improvements 1 year ago
Tim Stack dd21bdfd82 [text_filter] scrub ansi when testing a filter
Related to #1163
1 year ago
Tim Stack a324bc8c1c [docs] add a note that level regexes are not anchored
Related to #1153
1 year ago
Tim Stack 822eaf5a1a [json_log] auto detect the required width for a column
Related to #1146
1 year ago
Tim Stack cd59577324
Merge pull request #1147 from FlorianMuenchbach/feature/cursor-mode-tests
Some test cases for listview behavior in cursor mode
1 year ago
Tim Stack f2a0c8f21c [logfile] include microseconds when converting timestamps
Mentioned in #1145

Also, fix the field hiding issue mentioned in #1146
1 year ago
Florian Münchbach 1b250cc124 Add test input files to Makefile 1 year ago
Florian Münchbach 4d7f929d9a Add test cases for cursor mode 1 year ago
Florian Münchbach ea5d59e7e2 Use set_selection instead set_top in listview driver 1 year ago
Florian Münchbach 6c642abad6 Prefix selected line in listview driver output with '+' 1 year ago
Florian Münchbach e7a4e388a2 Add command options for cursor mode and key 'press' input to listview driver 1 year ago
Tim Stack 44b564681b [format_loader] catch invalid format names
Fixes #1122
1 year ago
Tim Stack a2f076a967 [test_sql_str_func] disable url test that is dependent on the curl version 1 year ago
Tim Stack 3862ba8ac1 [tests] fix file path 1 year ago
Tim Stack 70dee8a747 [ci] try to fix some test failures 1 year ago
Tim Stack db1fc92fdd [ansi] missed resizing a buffer when scrubbing ansi
Fixes #1135
1 year ago
Tim Stack 5ad75f156a [build] try to fix CI for test that uses a syslog logfile 1 year ago
Tobias Gruetzmacher 7e320b591e
Add example bunyan logfile
Taken directly from a live renovate instance.
1 year ago
Tim Stack f34a5cf589 [docs] update docs for half page hotkeys 2 years ago
Tim Stack fe50ba8f9b change en_US.utf-8 to en_US.UTF-8
related to #1089
2 years ago
Tim Stack 12d70f9996 [config] add missing enum terminator
the terminator is needed in the enum_value_t array

(I should really make it a real container...)
2 years ago
Tim Stack 3990517fcb
Merge pull request #1090 from FlorianMuenchbach/feature/cursor-mode
Feature/cursor mode
2 years ago
Tim Stack 554918b96c [goto] fix error reporting issue
Fixes #1078
2 years ago
Florian Münchbach a75d5c7cf3 Add hotkey binding for toggling the cursor mode 2 years ago
Tim Stack 8391de3ad6 [data_scanner] fix DT_H1 detection
Fix a broken refactor
2 years ago
Tim Stack faeaf477ab [yajlpp] flesh things out a bit more 2 years ago
Tim Stack 9ff1daf032 [port] more endianness stuff 2 years ago
Tim Stack 9eb734ef7e [log_format] support for a separate sub-second field 2 years ago
Tim Stack bddc6011ff [ansi] fix perf bug in eraser
Related to #1057
2 years ago
Tim Stack 07c57dae08 [json-log] change how lines that do not start with a curly are reported 2 years ago
Tim Stack 094b45f7ca [nits] minor fixes 2 years ago
Tim Stack a31045a97b [build] fix dist listing in test 2 years ago
Tim Stack 0fd9845580 [tests] test_tailer tweaks 2 years ago
Tim Stack fd19759bf5 [tests] set TZ when doing touch 2 years ago
Tim Stack 93a53c4224 [fini] fix a destruction ordering issue 2 years ago
Tim Stack 59ec0b4794 [build] missed dist'ing test file 2 years ago
Tim Stack d940d9d5eb [logfile] plumb gzip header through file meta 2 years ago
Tim Stack 3f3e6dcbdc [highlight] turn off nesting for var highlight 2 years ago
Tim Stack a437d9fcc9 [pcre2pp] allocate match_data on the stack 2 years ago
Tim Stack 26bcf0865d [test] tests should not rely on the local syslog being readable 2 years ago
Tim Stack 20a06a2782 [test] missed input file 2 years ago
Tim Stack b7de0766c8 [highlighters] add some keywords 2 years ago
Tim Stack f1deeb5b74 [highlight] turn off nesting for some builtin highlighters 2 years ago
Tim Stack e0ecbdff10 [logfile] improve handling of ansi escapes
I think this covers the rest of the functionality
that needs to deal with ansi escapes.

Related to #1057
2 years ago
Tim Stack d79c1f9235 [regex101] accept pcre2 imports 2 years ago
Tim Stack 6016219d57 [tests] missed updating test output 2 years ago
Tim Stack c49e0787f3 [release] bump version and try to automate some stuff 2 years ago
Tim Stack 1effd99e5c [sql] add parse_url()/unparse_url() functions
Fixes #44
2 years ago
Tim Stack b536043050 [sql/json] json_group_array() returns {} instead of [] 2 years ago
Tim Stack eb0bd4ac9a [anon] add an anonymizer to help with support requests
Fixes #1055
2 years ago
Tim Stack 740b827901 [logfile] handle logs with ANSI escapes
This is a partial fix for handling ANSI escapes in
parts of log messages that would prevent regexes
from matching.  Still more work to do.

Related to #1057
2 years ago
Tim Stack eaa6e50a52 [log_format] perform more validations on log formats 2 years ago
Tim Stack af5213a98a [log_formats] change "no patterns have a capture" error to a warning 2 years ago
Tim Stack 5a63ece31d [pcre2] migrate from pcre to pcre2
Fixes #974
2 years ago
Tim Stack aee33d6929
Merge pull request #1041 from bowlofeggs/build-remote-when-needed
Only build ssh keys when needed
2 years ago
Tim Stack 6ca01cd934 [line_buffer] fix some long-line handling 2 years ago
Randy Barlow b16833392b
Only build ssh keys when needed
I believe the test/remote folder only needs to be setup for
test/test_remote.sh. Prior to this commit, it was being built during
make, rather than just during make check. This commit adjusts things so
that the test/remote folder is only generated during make check, and
only when test/test_remote.sh is being executed.

Fixes #1040

Signed-off-by: Randy Barlow <randy@electronsweatshop.com>
2 years ago
Tim Stack 7309352c97 [view_curses] add a unit type to line_range
Fixes #1033
2 years ago
Tim Stack a813482a54 [log_formats] JSON number time to local time zone
Fixes #1038
2 years ago
Tim Stack 679e9f0771 [build] try to fix brew build error 2 years ago
Tim Stack ca51854e89 [build] turn on optimizations for snap build and fix dist 2 years ago
Tim Stack e047386441 [sql] extract() assumed too much about elements 2 years ago
Tim Stack c9ec288853 [regexp_vtab] hex floats were being passed through to json, which does not support hex floats
It looks like sscanf("%f") was accepting hex-floats. So, lnav
was passing that through to the JSON, which does not like hex
floats.

FYI, @trantor, this should fix the regexp_capture_into_json()
issue of hex numbers being passed through.
2 years ago
Tim Stack 72d171ae4b [tests] add a regexp_capture() test 2 years ago
Tim Stack b5cb38d454 [user_notifications] treat message as markdown 2 years ago
Timothy Stack 220317eb16 [demo] build/deploy stuff for ssh-based demo
fix structure name clash
2 years ago
Tim Stack 87791ec94b [markdown] add support for going to an anchor 2 years ago
Tim Stack d01db38d51 [init] fix handling of unknown TERM 2 years ago
Tim Stack 5751fe89c4 [markdown] recognize more code fence langs 2 years ago
Tim Stack a2c35140ba [data_scanner] hack to recognize some windows paths
Fixes #1018
2 years ago
Tim Stack 53c9c5cb51 [logfile] move bookmark_metadata to logfiles 2 years ago
Tim Stack 5abd483029 [ansi_scrubber] handle unicode in overstrike code 2 years ago
Tim Stack 9c8cc04a99 [cmds] :goto was not handling timestamps with spaces 2 years ago
Tim Stack af75f7bd80 [tests] updated expected output for readme change 2 years ago
Tim Stack 74c2237296 [loader] add some help text to the error for values without a corresponding capture 2 years ago
Tim Stack 001f26d066 [loader] make sure values defined in formats have a corresponding capture in at least one pattern 2 years ago
Tim Stack 072fad4173 [tests] coverage for json SQL funcs 2 years ago
Tim Stack 35a8e99c07 [tests] coverage for some state functions 2 years ago
Tim Stack 88d9002a5d [search-table] add test case 2 years ago
Tim Stack d020168860 [meta] highlight comments/tags in searches 2 years ago
Tim Stack 7ef5cf6ba3 [session] some more session docs 2 years ago
Tim Stack 0603b1e756 [session] support for :hide-file and some related fixes 2 years ago
Tim Stack ebe2e0d8e6 [docs] add config panel screenshots 2 years ago
Tim Stack 1fd274ce24 [docs] some more updates to docs
Also, add support for overstruck/backspace-underscore for
doing bold/underline.
2 years ago
Tim Stack 3df07139b3 [line_buffer] fix long line issue
Fixes #980
2 years ago
Tim Stack 4e74491e84 [blog] post about markdown support 2 years ago
Tim Stack deb0e21554 [tests] fix export session test 2 years ago
Tim Stack 4e0dab843a [session] try avoid using absolute file paths in session exports 2 years ago
Tim Stack a4fadb56f6 [build] missed new textfile 2 years ago
Tim Stack 7c3df44fc4 [pretty] handle ANSI escapes
Fixes #1020
2 years ago
Tim Stack 056754a926 [session] some improvements to session export 2 years ago
Tim Stack 5259da4f4f [highlights] reprioritize highlighters to prefer formats over themes
Fixes #992
2 years ago
Tim Stack 010198531b [tests] some coverage for blobs 2 years ago
Tim Stack 3cafcf3c77 [attr_line] tweak shifting of attributes
Fixes #1017
2 years ago
Tim Stack 1ae1600f7b [line_buffer] cache compressed files 2 years ago
Tim Stack c17046b2fa [formats] fix error message if pattern does not fully match sample 2 years ago
Tim Stack e2e491ec41 [search-table] improve preview highlighting 2 years ago
Tim Stack 3b9bc57ab0 [sql] consolidate the encoders to a single function 2 years ago
Tim Stack 94aab91d38 [sql] add base64_encode()/base64_decode() functions 2 years ago
Tim Stack 1f8e2bd46c [sql] add uri_encode()/uri_decode() functions
Fixes #1014
2 years ago
Tim Stack be862e0eab [scn] more scnlib conversions 2 years ago
Tim Stack f234b37fe0 [build] some more scnlib stuff 2 years ago
Tim Stack 9c03938ff3 use scnlib instead of sscanf/strtod 2 years ago
Tim Stack 390bc132e2 [build] updates for arm64 2 years ago
Timothy Stack 8ef581177c [line_buffer] add some performance counters for tracking SQL perf
Also, check for keyboard input during SQL execution
so we can cancel.

Fixes #894
2 years ago
Timothy Stack a459370bd8 [tests] coverage for markdown breadcrumbs 2 years ago
Timothy Stack 16d39f3fd9 [db] move the shared_buffer_ref out of logline_value 2 years ago
Timothy Stack 66853a70ca [db] use arena allocator for db results
... and continue to tweak cylon
2 years ago
Timothy Stack ff44e37f7e [ui] make the cylon status mode actually cylon-like 2 years ago
Timothy Stack a5a02d6243 [tests] text file handling and make sure the progress status bar is updated during SQL processing 2 years ago
Timothy Stack f8aac1d52e [build] remove leftover file 2 years ago
Timothy Stack b3ee092dc5 [cleanup] remove unused stuff and add a test 2 years ago
Timothy Stack 41754a8ec1 [session] add time_offset of files to session exports 2 years ago
Timothy Stack a04dc2a327 [session] improvements to :export-session-to 2 years ago
Timothy Stack 773cc3e049 [tests] add some more tests for the views vtabs 2 years ago
Timothy Stack 6712a33163 [cmds] add :export-session command 2 years ago
Timothy Stack 1abc77e129 [secure] start to update secure-mode 2 years ago
Timothy Stack 5ea55afd74 [vtab] indexing improvements 2 years ago
Timothy Stack 0f9c519061 [vmw_log] update to work with hostd on esx 2 years ago
Timothy Stack 0b99c0b9a4 [tests] update json sql test for sqlite bugfix
Related to #1009
2 years ago
Timothy Stack 45270505e3 [status] some more user notification tweaks 2 years ago
Timothy Stack f5cc4b298f [ui] add back top status bar 2 years ago
Timothy Stack d1521496cc [docs] fill out search-table docs 2 years ago
Timothy Stack 4c20b0039c [sql] some more error improvements 2 years ago
Timothy Stack dde6d88430 [exec] fix reporting of errors in scripts 2 years ago
Timothy Stack 3b9235b6e6 [tests] don't use syslog files since their timestamps are unreliable 2 years ago
Timothy Stack 6393990b91 [nits] miscellaneous issues 2 years ago
Timothy Stack a3f5c3239e [vtab] some more indexing fixes 2 years ago
Timothy Stack 880fe6a68a [tests] handle older sqlite 2 years ago
Timothy Stack f3934c742d [error] leverage sqlite3_error_offset 2 years ago
Timothy Stack 8b3b8a6e3c [perf] fix some text file loading issues 2 years ago
Timothy Stack 7db3c7d3cf [tests] fix index test 2 years ago
Timothy Stack 36e9433891 [perf] try to overlap line buffer i/o 2 years ago
Timothy Stack 7fe91d6186 [tests] fix sql_anno test 2 years ago
Timothy Stack d6c9b0036a [spectro] improve error messages and fix some issues with invalidation 2 years ago
Timothy Stack 812fa08055 [search-table] some more enhancements to search-tables 2 years ago
Timothy Stack 52fe2db376 [spectro] add a summary overlay to the selected position and show log messages in a panel 2 years ago
Timothy Stack 2351438e4c [tests] missed some expected output 2 years ago
Timothy Stack 72c1c48e23 [perf] fixing slow queries 2 years ago
Timothy Stack d5b06fca5f [mark-expr] expression marks should count when showing elapsed time 2 years ago
Timothy Stack 09ee65e917 [tests] force locale 2 years ago
Timothy Stack 5fc9917a4b [tests] missed adding expected output 2 years ago
Timothy Stack ce7f974598 [tests] fix spectro test 2 years ago
Timothy Stack c666a669fe [spectro] fix key colors 2 years ago
Timothy Stack f9f797fc9d [logfile_sub_source] add log message watch expressions
Fixes #539
2 years ago
Timothy Stack 906494ebfa [errors] try to improve some errors 2 years ago
Timothy Stack 464cda8b82 [tests] update expected output 2 years ago
Timothy Stack c24be236a3 [:goto] raise an error if the input is not fully parsed
Related to #999
2 years ago
Timothy Stack 64e7b78c6b [attr_line] fixes for empty attributes 2 years ago
Timothy Stack e03d216b8b [overlay] remove log view summary line 2 years ago
Timothy Stack bcc7436f66 [console] syntax highlight some snippets 2 years ago
Timothy Stack 64bee48fb0 [view] preserve top time when filtering 2 years ago
Timothy Stack 1891ceb7b5 [perf] fix some performance issues with log vtabs
Fixes #995
2 years ago
Timothy Stack 6c52760cc9 [events] initial events work
Related to #811
2 years ago
Timothy Stack 1ea385ea3b [document.sections] fix sections 2 years ago
Timothy Stack 60251dda84 [w3c_log] handle an invalid log correctly
Fixes #988
2 years ago
Timothy Stack ef8c641e59 [date_time_scanner] fix an overflow
Fixes #989
2 years ago
Timothy Stack 4dccb7424c [distcheck] missed removing a generated file 2 years ago
Timothy Stack 2e20195b99 [afl] some more fixes for fuzzer bugs
Fixes #987
Fixes #986
Fixes #985
Fixes #984
Fixes #982
2 years ago
Timothy Stack 2bc258e621 [afl] fix bugs detected by a fuzzer
Fixes #981 #983
2 years ago
Timothy Stack 31a670ce27 [md4c] initial markdown support 2 years ago
Timothy Stack f03f9e704f [views] add a breadcrumb view 2 years ago
Timothy Stack d161f5cdac [tests] disable test for now 2 years ago
Timothy Stack ea362a5866 [build] skip regex101 test for now 2 years ago
Timothy Stack c17f40f7ab [test] comment out test for now 2 years ago
Timothy Stack 6f8cafaf84 [build] regen expected files 2 years ago
Timothy Stack 182da31213 [tests] fix some test issues 2 years ago
Timothy Stack a27198e8ca [regex101] add an integration with regex101
... and a pile of other changes
2 years ago
Timothy Stack 6251aa066c [build] set locale to fix glob() sorting 2 years ago
Timothy Stack c43367491c [build] add new files to dist 2 years ago
Timothy Stack 0785a432fa [console] colorize console output 2 years ago
Timothy Stack c125211a7e [lss] use adjusted time
Related to #967
2 years ago
Timothy Stack 1019714409 [rescan] automatically pop the text view when the last text file is promoted 2 years ago
Timothy Stack d82140de52 [date-time-scanner] fix generating with a user-defined format
Fixes #967
2 years ago
Timothy Stack 531c35158c [tidy] some more tidying 2 years ago
Timothy Stack 99c1688c2e [attr_line] use variant instead of a union for attribute values 2 years ago
Timothy Stack 81e63784e7 [modernize] some more cleanups 2 years ago
Timothy Stack b856cd9657 [build] silence some warnings 2 years ago
Timothy Stack 6fff9d60f5 [build] some clang-tidy fixes 2 years ago
Timothy Stack eb42ef6e77 [build] try cmake build again 2 years ago
Timothy Stack 66ef5fdae1 [clang-format] init 2 years ago
Timothy Stack d0ba84d9be [build] run cmake-init and switch from hunter to conan for packages 2 years ago
Timothy Stack 4564e162d0 [build] try to optimize compile time 2 years ago
Timothy Stack 87beb6dd78 [tests] set TZ for pcap test 2 years ago
Cristian Chiru e2fe64e536 Fix for building on msys2; Closes #795 2 years ago
Timothy Stack 8bb034eeeb [pcap] initial pcap support
Fixes #12
3 years ago
Timothy Stack f74214b9b6 [sql] add a gunzip() SQL function 3 years ago
Timothy Stack b8945232f7 [test] update expected help output 3 years ago
Timothy Stack 19fd336e9a [formats] add logfmt 3 years ago
Timothy Stack 6e6487935a [test] fix broken path 3 years ago
Timothy Stack dc0b7ff631 [cmake] run cmake-format 3 years ago
Timothy Stack b884f732f2 [json-ext] json_contains() should accept null
Related to #447
3 years ago
Timothy Stack 954e368974 [build] rejigger doctest inclusion a bit 3 years ago
Timothy Stack 68d7d64948 [rebuild] some more cleanup 3 years ago
Timothy Stack 458b959a13 [headless] fix an issue with headless rebuilds 3 years ago
Timothy Stack f6e245c04a [sql] jget() is not returning values with the right sqlite type 3 years ago
Timothy Stack b6b0578027 [file_collection] check for file closure in same_file
Fixes #908
3 years ago
Timothy Stack 86e84e1dab [distclean] more files to remove 3 years ago
Timothy Stack 1e1abcc97e [distclean] remove some extra files 3 years ago
Timothy Stack db7173caec [views] fix some issues with empty views
Related to #908
3 years ago
Tim Stack 869b10c3fc
Update test_remote.sh 3 years ago
Tim Stack fbdcca97e1
Update test_remote.sh 3 years ago
Timothy Stack 2df39916f9 [tests] debug remote test 3 years ago
Timothy Stack 42d2aa063a [tests] add missing test logfile to dist 3 years ago
Timothy Stack c462830be1 [tests] try to fix sql test 3 years ago
Timothy Stack aa9947fbb0 [tests] try to fix ci test failures 3 years ago
Timothy Stack 2000513135 [tests] set XDG_CONFIG_HOME too 3 years ago
Tim Stack 0fcda9adec
Update test_meta.sh 3 years ago
Timothy Stack 67557c829a [tests] debugging 3 years ago
Timothy Stack a7edb40cf7 [tests] fix expected output 3 years ago
Timothy Stack c13e1f3a00 [build] missed distributing some test files 3 years ago
Timothy Stack ce8397b5cf [view_curses] only write OSC;send-input in the test env
Fixes #895
3 years ago
Timothy Stack 65a7bd7bd6 [time-fmt] add a time format 3 years ago
Timothy Stack b184272edb [file_collection] fix recursion
Fixes #877
3 years ago
Timothy Stack dbcfdda363 [reltime] some more relative time fixes 3 years ago
Timothy Stack aa7ac37cdc [log_source] try to report sql filter errors 3 years ago
Timothy Stack a760a4240f [file_collection] handle dirs with colons
Fixes #863
3 years ago
Timothy Stack b2d296b5d3 [open] handle file names with colons
Fixes #863
3 years ago
Timothy Stack 408a2ea38e [tests] fix for busybox 3 years ago
Timothy Stack d5d44e63b3 [build] fix cmake build 3 years ago
Timothy Stack d3d527d290 [tests] adding some more coverage 3 years ago
Timothy Stack b5406f2cee [tests] some more coverage 3 years ago
Timothy Stack 75a01d0f50 [test] tweak test_remote.sh config 3 years ago
Timothy Stack 9c417afb2d [logfile] remove error exception and some optimizations 3 years ago
Timothy Stack 0dca44f487 [rebuild] add a deadline to make the UI more responsive 3 years ago
Timothy Stack b80e322162 [test] fix test_logfile.sh 3 years ago
Timothy Stack 1737964df6 [remote] add some tailer tests 3 years ago
Timothy Stack edfd835866 [remote] use the APE version of the tailer 3 years ago
Timothy Stack b78c914d6f [remote] a path is synced on an error 3 years ago
Timothy Stack 9a91cdffbb [test] scrub error message 3 years ago
Timothy Stack 12cf00f4dc [tests] set config to use for remote test 3 years ago
Timothy Stack 6ebd9f16a2 [remote] add a test 3 years ago
Timothy Stack c3dc668b69 [remote] add some config options and remove the copied tailer binary
Also fix time offset issue
3 years ago
Timothy Stack be51a4e3de [arc/remote] use a single work directory for archive/remote files 3 years ago
Timothy Stack e13816a8e3 [cmds] change :write-raw-to to copy the original log content and add :write-view-to command
Also added log_raw_text column to the log tables.

Fixes #859
3 years ago
Timothy Stack b64342ca47 [log_format] display log_body for the body field instead of the format name and add :mark-expr command 3 years ago
Timothy Stack d2b5690e0c [readline] improve filename completion 3 years ago
Timothy Stack cc1e79d1cc [init] fix order of init for views so they can be manipulated by SQL files in format dirs
Fixes #853
3 years ago
Timothy Stack 3741985ee3 [format] allow leading slash in field names
Fixes #852
3 years ago
Timothy Stack 70c07da5c5 [sql] fix help for sparkline() 3 years ago
Timothy Stack b7817d4bb9 [build] fix musl test build 3 years ago
Timothy Stack d31aa845f5 [base] refactor duration2str 3 years ago
Timothy Stack 0658b9ef57 [tests] move some test code around 3 years ago
Timothy Stack e593bde875 [build] fix some issues on xenial32 3 years ago
Timothy Stack 2e4106b80a [build] more test/dist fixes 3 years ago
Timothy Stack bfa1877f4e [tests] try to fix test build 3 years ago
Timothy Stack def50ee6cf [build] try fix 3 years ago