Commit Graph

1385 Commits (master)

Author SHA1 Message Date
Simon 2826ca4a43
move ES_SNAPSHOT_DIR to EnvironmentSettings 7 months ago
Simon 64ffc18da7
add debug methods for EnvironmentSettings 7 months ago
Simon 21fde5e068
remove old migrations 7 months ago
Simon ea9ed6c238
fix linter 7 months ago
Simon 8eaed07cff
remove unused renamer 7 months ago
Clark 4d111aff82
Move the startup application settings to a new class (#571)
* Move the startup application settings to a new class

* Replace settings methods with static fields

* Move Redis and ES configuration to the settings class

* Fix environment python imports

* Update envcheck to use the new settings
7 months ago
Simon 5165c3e34a
bump requirements 8 months ago
Simon 572b23169c
finetune limited permission user 8 months ago
Steve Ovens e1fce06f97
View only user (#539)
* Remove repo docs in favor of hosted docs (#537)

* updated base, channel, video htmls to hide elements based on if user is staff or in the group 'admin'

* added the load auth_extras

* updated auth_extras

* updated views.py to block api calls from deleting files from unprivileged users; The Templates needed to be updated to support the various group checks related to removing buttons an unprivileged user should not see

* bumped the channel templates to remove conflict

* fix linting issues

* more linting

---------

Co-authored-by: Merlin <4706504+MerlinScheurer@users.noreply.github.com>
8 months ago
Omar Laham 1b0be84972
Remove /media/ prefix from Download File URL in video.html (#567) 8 months ago
Simon 4184736bee
update version 8 months ago
Simon 4a4a274259
bump requirements 8 months ago
Simon 0776cea7bc
fix backup for empty index 8 months ago
Simon 57d8b060d2
fix spelling 8 months ago
Simon 88f230c3f4
build yt-dlp from commit 8 months ago
Simon e9eddf06fb
error handling for playlist sub 8 months ago
Simon 8af7a3caf4
better playlist extract error message 8 months ago
Simon 8e79cba7d5
fix continue watching progress matching 8 months ago
Simon 87e457401d
fix duplicated startup migration 8 months ago
Simon bb271e276c
validate backup before creating blank index 8 months ago
Simon 3b7e4c9266
skip id_sb_id migration 8 months ago
Simon 88f5c58b8e
add unstable tag 8 months ago
Igor Rzegocki 6a83756fb4
support for auth forwarding proxy 8 months ago
Simon 515b724047
split json backup files, #406 8 months ago
Simon 77fef5de57
fix standard duration str agg 8 months ago
Simon 9d09d27fba
bump requirements 8 months ago
Simon 0e767e2f84
Merge pull request #551 from ajgon/fix/elasticsearch-ha
Support elasticsearch clusters
8 months ago
Simon 7801ed0d60
fix find_results through SearchProcess 8 months ago
Igor Rzegocki 6abec9401b
Mute urlib3 ssl warnings when SSL verification is disabled 8 months ago
Simon 1cdb9e1ad5
refactor find_results use ElasticWrap directly 8 months ago
Simon 7afeb41469
use SearchProcess for single_lookup 8 months ago
Simon bae11fe1f1
fix appconfig init 8 months ago
Simon 0cacaee213
merge testing 8 months ago
Simon 892e81c185
refactor ElasticWrap dynamic kwargs 8 months ago
Igor Rzegocki f423ddc53a
add healthcheck endpoint (#553) 8 months ago
Igor Rzegocki b2bb7ea28e
Support wider spectrum of ElasticSearch configurations 8 months ago
Simon 38b3815a33
catch disabled old settings 8 months ago
Simon 92975a5c95
disable ta_config indexing 8 months ago
Joseph Liu a5b61bfaf6
Add "Mark Unwatched" to channels and playlists (#547) 8 months ago
Clark 85b56300b3
Move user configuration from Redis to ES (#533)
* ES Client must bootstrap itself to be the source of config

If this is not done a cyclic loop is created between the config loader and the ES client.
This lays the ground work for ES being the source of all app config.

* auto_download is not used anymore

* Add UserConfig class that encapsulates user config storage

This class will allow the rest of the code to 'not care' about how user properties are stored.
This requires the addition of a ta_users index in ES.

* Create migration task for user config transfer

* Replace getters and setters for each property

Strongly type the user configuration
Migrate missed sponsorblock ID

* Other DB settings will be another PR
8 months ago
Simon a7fc7902f0
refactor single video page to use SearchProcess 9 months ago
Simon 879f5ab52f
refactor match_progress to use SearchProcess 9 months ago
Simon c6458c6ec1
add score to full text search 9 months ago
Simon 47c433e7c1
refactor search form to use new SearchProcess 9 months ago
Simon dc41e5062d
refactor duration class into separate helper functions 9 months ago
Merlin 317942b7e1
Refac biggest channels to be 3 seperate tables with ordering and right align (#536)
* Add right align to numbers on biggest channels in dashboard

* Refac biggest channels to be 3 seperate tables with ordering

* Fix aggs linting
9 months ago
Merlin 65d768bf02
Fix url to settings documentation (#535) 9 months ago
Simon a807d53ff8
update TA_VERSION 9 months ago
Simon fa45cf08ba
fix mobile table layout 9 months ago
Simon 5cf5b4edb7
clean log 9 months ago
Simon 0c9c88fc0b
buildStats async 9 months ago
Simon 725bba0963
add randint sleep before version check 9 months ago
Simon 76981635dc
reset autostart on queue stop, #520 9 months ago
Simon 8dba2e240e
handle empty download hist stat 9 months ago
Simon 4016e81f9a
add download history stats 9 months ago
Simon 5ee37eb0cb
add biggest chanel aggs 9 months ago
Simon 4650963cc7
add watch progress tiles 9 months ago
Simon 5acc1ea718
add all duration aggs 9 months ago
Simon 505f5b73c5
add primary aggs 9 months ago
Simon d491b0b347
[API] better primary stats 9 months ago
Simon 52d6c59f3f
fix incomplete messages outside of sendprogress task method 9 months ago
Simon 4afb605736
show all messages on settings pages 9 months ago
Clark fcc1c2a648
Split the settings page (#528)
* Split the settings page

* Add a dashboard page for future use

Create a settings base to keep all the settings pages consistent

* Correct Python formatting

* Fix snapshots not showing in new view
9 months ago
Simon 4ded8988c3
add channel aggregation 9 months ago
Simon 988c2b8af7
add download video histogram stats 9 months ago
Simon 58ef8f753f
fix date epoch sec format 9 months ago
Simon 3e9f1a392a
[API] add index count and video view progress stats views 9 months ago
Simon fb089dd3de
add unstable footer 9 months ago
dmynerd78 983612f460
Add fullscreen hotkey to video player (#524)
* Add fullscreen hotkey

* Run prettier formatting
9 months ago
Simon d42bd612d0
handle 404 video sponsorblock, #526 9 months ago
Simon 41f6a03751
fix typing 9 months ago
Simon f1e25c9a20
[API] add channel search endpoint 9 months ago
Simon 68928f5cb1
ignore eaDir folder, use ignore_filelist for clear_dl_cache, #523 9 months ago
Simon a514dda1ff
[API] implement delete playlist endpoint 9 months ago
Simon 2bccb698e6
remove legacy process subscribe methods 9 months ago
Simon 076452c612
move subscribe buttons to API calls 9 months ago
Simon b005b7bcfe
[API] validate sub type, add sub/unsub channel and playlist 9 months ago
Simon a2eb42ebb9
validate subscribe url type, #299 9 months ago
Simon 33ff586af4
bump requirements 9 months ago
Simon 3803537739
trigger bgsave on importent redis set_message 9 months ago
Simon 58818bb91c
better thumbnail final fall back handling 9 months ago
Simon 8411889db7
add type hints to filesystem scanner 10 months ago
Simon 313bbe8b49
fix wrong resolve doc string 10 months ago
Simon 2238565a94
bump TA_VERSION 10 months ago
Simon fa43753614
better error handling in comment extraction 10 months ago
Simon 02be39b6ed
hide/reveal apprise links 10 months ago
Simon 375e1a2100
set initial comment toggle icon 10 months ago
Simon c1ea77434e Merge branch 'master' into testing 10 months ago
crocs 0e1e544fee
update imagery (#507)
* Update script.js

* Update README.md

updated banner photo

* Add files via upload

* Delete tube-archivist-banner.jpg

* Delete tube-archivist-banner.jpg.jpg

* Add files via upload

* Delete tube-archivist-banner.jpg

* Add files via upload

* Delete tube-archivist-banner.jpg

* Add files via upload

* Update README.md

* Delete tube-archivist-screenshot-channels.png

* Delete tube-archivist-screenshot-download.png

* Delete tube-archivist-screenshot-home.png

* Delete tube-archivist-screenshot-single-channel.png

* Delete tube-archivist-screenshot-video.png

* Add files via upload

* Update SHOWCASE.MD

* Delete tube-archivist-screenshot-channels.png

* Delete tube-archivist-screenshot-download.png

* Delete tube-archivist-screenshot-single-channel.png

* Delete tube-archivist-screenshot-video.png

* Add files via upload

* Update SHOWCASE.MD

* Add files via upload

* Update SHOWCASE.MD

* Add files via upload

* Delete tube-archivist-search.png

* Add files via upload

* Update SHOWCASE.MD

* Update SHOWCASE.MD
10 months ago
Simon a13cd2f7ba
catch timeout in es connection check, part 2 10 months ago
Simon befdc64772
catch timeout in es connection check 10 months ago
Simon c395a949cc
add localhost and tubearchivist to default trusted 10 months ago
Simon 4473e9c5b2
add apprise notifications 10 months ago
Simon 75a63c4828
paginate channel migration index update 10 months ago
Simon aea403a874
additional thumb dl error handling 10 months ago
Simon ab8fed14bb
handle edge cases in migration clean up 10 months ago
Simon 6f915a5733
fix channel tv art extraction 10 months ago
Simon f970ec867e
clarify subtitle language codes on settings page, #505 10 months ago
Simon ef0d490890
[API] change dates to ISO format 10 months ago
lamusmaser 865089d46d
Resolve #502 by making the extension lowercase before comparison. (#504)
* Resolve #502 with making the extension lowercase.
Add note to `EXT_MAP` reference.

* Fixed comment for linting, added more details.
10 months ago
Simon d500fa5eeb
add unstable footer 10 months ago
Simon 4c681d813d
fix lint 10 months ago
Simon 434aa97a86
static cache file path building, #498 10 months ago
Simon efde4b1142
skip subtitle if not processed yet, #496 10 months ago
Simon 6022bdd3cd
fix doc string 10 months ago
Simon 99baf64b11
update requirements 10 months ago
Simon 61b04ba5cf
channel migration take 2 10 months ago
Simon 2a60360f4a
handle empty channel migration cleanup 11 months ago
Simon 8a7cb8bc6f
bump redis 11 months ago
lamusmaser 1be80b24c2
Implement #490 - Add version API and add local_version function. (#491)
* Add version API and add local_version function.

* Minor adjustments for linting.

* Add missing newlines for linter.

* Add missing comma to `urls.py`.

* Remove `version/` endpoint.

* Remove the `VersionView`.

* Prepare `PingView` for removal of the `is_static` response.

* Remove the `is_unstable` response from `ReleaseVersion`.

* Readd missing class instantiation for first call of `ReleaseVersion`.
11 months ago
Simon 061c653bce
retry get config better startup error handling, #485 12 months ago
Simon 72a98b0473
handle missing channel_tvart_url in thumb validator, #479 12 months ago
Simon 88e199ef9c
reset reindex counter on new added to queue, #478 12 months ago
Simon 879497d25a
bump libs 12 months ago
Simon 103409770d
temporary fix for is_favorited extraction error 12 months ago
Simon 094ccf4186
bump libs 12 months ago
Simon 247808563a
download error recovering 12 months ago
simon 5927ced485
bump libs 1 year ago
simon 6fb788b259
add delete button for unavailable video 1 year ago
simon 5e92d06f21
fix dl error retry logic, store and return error, #477 1 year ago
simon 7082718c14
add days to seconds string converter 1 year ago
simon 7e2cd6acd3
fix linter, take 2 1 year ago
simon 904d0de6aa
fix linter 1 year ago
simon c4e2332b83
fix startup race condition cluster health 1 year ago
simon 139d20560f
remove unused channel folder refresh 1 year ago
simon 66a14cf389
remove unused clean_string 1 year ago
simon 9b30c7df6e
refacter filesystem scanner 1 year ago
simon 5334d79d0d
default query 1 year ago
simon 64984bc1b3
fix chown for mig new folder 1 year ago
simon 8ef59f5bff
delete channel path building 1 year ago
simon 9d6ab6b7b3
implement new media_url 1 year ago
simon d62b0d3f8d
implement simplified path migration 1 year ago
simon 918a04c502
allow empty data for paginate 1 year ago
simon 60f1809ed8
fix rescan without task 1 year ago
simon f848e73251
HOTFIX: default bitrate, #415 1 year ago
simon c65fbb0b60
add filesystem rescan message 1 year ago
simon 95f114d817
remove leftover print statement 1 year ago
simon 05eac1a8ca
hotfix: skip filesystem rescan 1 year ago
simon ea42f0f1e3
bump TA_VERSION v0.3.6 1 year ago
simon a9b5713629
add channel tags to searching 1 year ago
simon dbaa13bfb0
apply auto_start sort to dl queue 1 year ago
simon 5d0d050149
fix channel reindex flow 1 year ago
simon c327e94726
add filesystem rescan to video migration 1 year ago
simon 774780d520
fix filesystem rescan without task 1 year ago
simon 5e1167743f
fix migration notification logic 1 year ago
simon 4376b826c4
add auto tag to video in queue 1 year ago
simon 206921baf0
add unstable footer 1 year ago
simon 0d2d3353a9
add extractor lang, #316 1 year ago
simon b47687535a
undo faulty channel sync to videos 1 year ago
simon e092a29b13
bump libs 1 year ago
simon 170839362e
fix ignoring progress message when not initiated with task 1 year ago
simon b95a659396
fix empty channel_subs parsing 1 year ago
simon 2b66786728
switch channel index to yt-dlp, index tags 1 year ago
simon b7bfeaf215
add channel tags to mapping 1 year ago
simon 5cc642098d
remove old migration 1 year ago
simon 7c01ad88b2
fix startup MediaStreamExtractor error handling 1 year ago
simon e866bb3be5
bump libs 1 year ago
simon 63021bd313
add autostart subs to config form 1 year ago
simon cbcb7484a7 Merge branch 'feature/queue-autorun' into testing 1 year ago
Dominik Sander 1c0b407f3f
Allow to configure yt-dlp `--format-sort` argument (#471)
* Allow to configure yt-dlp `--format-sort` argument

This exposes the [`--format-sort`][1] yt-dlp option to the user.

Implements parts of #316

[1]: https://github.com/yt-dlp/yt-dlp#sorting-formats

* Trim split values of format_sort, obey black

* Add `format_sort` to default configuration

* Add note about codec compatibility to settings page
1 year ago
simon 280c773441
add download now to form 1 year ago
simon efca460e9d
download now task handling 1 year ago
simon 8f3b832069
[API] add dl autostart query param 1 year ago
simon 9b3d1fa1fd Merge branch 'testing' into feature/queue-autorun 1 year ago
Matthew Glinski 9a38aff03d
Accept members-only/paid-content playlist IDs/URLs (#469)
This adds a new check to the playlist url_id check to allow playlist urls from subscription only content on youtube channels.

The channel I tested on had an ID length of 26 (https://www.youtube.com/playlist?list=UUMOvk0KB4Ue0vfPqvDzjIAwiQ), I am not sure if other lengths are valid here also.

I have tested this on my local install and it is downloading the members only playlist correctly as long as I have valid youtube cookies.
1 year ago
simon 06bbe2e400
fix playlist sub parser 1 year ago
simon 77900f89e3
remove legacy limit_count config 1 year ago
simon bc39561606
consolidate dl queue notification to method 1 year ago
simon 76535c6304
move add to queue to api call 1 year ago
simon 790ba3d20e
fix linter 1 year ago
simon 89779ec13b
consolidate update status priority 1 year ago
simon 1b6b219e02
modify _get_next to for auto_only attr 1 year ago
simon 5cd845e55d
fix type compatibility 1 year ago
simon 3a091ac287
implement auto_start indexing 1 year ago
simon e385331f6c
add typing 1 year ago
simon 4067b6c182
add channel aggs 1 year ago
simon 3063236634
add media stream index startup migration 1 year ago
simon a17f05ef21
index streams and file size 1 year ago
simon a4d42573ef
move DurationConverter to separate module 1 year ago
simon 5723ff1d20
bump TA_VERSION 1 year ago
simon 82d873a70f
add members link to rescan task 1 year ago
simon 7e4f564f45
fix title overwrite in notification 1 year ago
simon 3f7b38713f
add more progress notification for zip backup 1 year ago
simon 0b33edcb4c
tweak thumb resync paginate size 1 year ago
simon 06c7968070
fix silly host_clean and direct access TA_PASSWORD 1 year ago
simon a98a30cc85
elaborate TA_HOST parsed, #441 1 year ago
simon a924d648d6
add video id to processing message 1 year ago
simon 0750547236
bump bs4 1 year ago
simon 1aa4401e6c
move API documentation to docs 1 year ago
simon 5d524e5110
fix reindex notification filter 1 year ago
simon 1e96c3211f
remove unused functions 1 year ago
simon d2649c29c3
add recent videos to reindex queue task 1 year ago
simon ff89432d86
fix off by one task notification error 1 year ago
simon fb77ab44ee
fix manual import media file permission, add missing comment check trigger 1 year ago
simon e43840da31
fix manual index folder permission 1 year ago
simon 3fa5ed725e
fix missing progress script for channel notification 1 year ago
simon 841f5ab67f
fix missing tvart fallback key 1 year ago
simon 4038a837cf
fix chown for subtitles 1 year ago
simon 5b2d7db102
fix chown for channel folder creation 1 year ago
simon c8dd391fd3
fix channel tv art validator callback 1 year ago