Commit Graph

1385 Commits (master)

Author SHA1 Message Date
Simon 0c9c88fc0b
buildStats async 9 months ago
Simon 725bba0963
add randint sleep before version check 9 months ago
Simon 76981635dc
reset autostart on queue stop, #520 9 months ago
Simon 8dba2e240e
handle empty download hist stat 9 months ago
Simon 4016e81f9a
add download history stats 9 months ago
Simon 5ee37eb0cb
add biggest chanel aggs 9 months ago
Simon 4650963cc7
add watch progress tiles 9 months ago
Simon 5acc1ea718
add all duration aggs 9 months ago
Simon 505f5b73c5
add primary aggs 9 months ago
Simon d491b0b347
[API] better primary stats 9 months ago
Simon 52d6c59f3f
fix incomplete messages outside of sendprogress task method 9 months ago
Simon 4afb605736
show all messages on settings pages 9 months ago
Clark fcc1c2a648
Split the settings page (#528)
* Split the settings page

* Add a dashboard page for future use

Create a settings base to keep all the settings pages consistent

* Correct Python formatting

* Fix snapshots not showing in new view
9 months ago
Simon 4ded8988c3
add channel aggregation 10 months ago
Simon 988c2b8af7
add download video histogram stats 10 months ago
Simon 58ef8f753f
fix date epoch sec format 10 months ago
Simon 3e9f1a392a
[API] add index count and video view progress stats views 10 months ago
Simon fb089dd3de
add unstable footer 10 months ago
dmynerd78 983612f460
Add fullscreen hotkey to video player (#524)
* Add fullscreen hotkey

* Run prettier formatting
10 months ago
Simon d42bd612d0
handle 404 video sponsorblock, #526 10 months ago
Simon 41f6a03751
fix typing 10 months ago
Simon f1e25c9a20
[API] add channel search endpoint 10 months ago
Simon 68928f5cb1
ignore eaDir folder, use ignore_filelist for clear_dl_cache, #523 10 months ago
Simon a514dda1ff
[API] implement delete playlist endpoint 10 months ago
Simon 2bccb698e6
remove legacy process subscribe methods 10 months ago
Simon 076452c612
move subscribe buttons to API calls 10 months ago
Simon b005b7bcfe
[API] validate sub type, add sub/unsub channel and playlist 10 months ago
Simon a2eb42ebb9
validate subscribe url type, #299 10 months ago
Simon 33ff586af4
bump requirements 10 months ago
Simon 3803537739
trigger bgsave on importent redis set_message 10 months ago
Simon 58818bb91c
better thumbnail final fall back handling 10 months ago
Simon 8411889db7
add type hints to filesystem scanner 10 months ago
Simon 313bbe8b49
fix wrong resolve doc string 10 months ago
Simon 2238565a94
bump TA_VERSION 10 months ago
Simon fa43753614
better error handling in comment extraction 10 months ago
Simon 02be39b6ed
hide/reveal apprise links 10 months ago
Simon 375e1a2100
set initial comment toggle icon 10 months ago
Simon c1ea77434e Merge branch 'master' into testing 10 months ago
crocs 0e1e544fee
update imagery (#507)
* Update script.js

* Update README.md

updated banner photo

* Add files via upload

* Delete tube-archivist-banner.jpg

* Delete tube-archivist-banner.jpg.jpg

* Add files via upload

* Delete tube-archivist-banner.jpg

* Add files via upload

* Delete tube-archivist-banner.jpg

* Add files via upload

* Update README.md

* Delete tube-archivist-screenshot-channels.png

* Delete tube-archivist-screenshot-download.png

* Delete tube-archivist-screenshot-home.png

* Delete tube-archivist-screenshot-single-channel.png

* Delete tube-archivist-screenshot-video.png

* Add files via upload

* Update SHOWCASE.MD

* Delete tube-archivist-screenshot-channels.png

* Delete tube-archivist-screenshot-download.png

* Delete tube-archivist-screenshot-single-channel.png

* Delete tube-archivist-screenshot-video.png

* Add files via upload

* Update SHOWCASE.MD

* Add files via upload

* Update SHOWCASE.MD

* Add files via upload

* Delete tube-archivist-search.png

* Add files via upload

* Update SHOWCASE.MD

* Update SHOWCASE.MD
10 months ago
Simon a13cd2f7ba
catch timeout in es connection check, part 2 11 months ago
Simon befdc64772
catch timeout in es connection check 11 months ago
Simon c395a949cc
add localhost and tubearchivist to default trusted 11 months ago
Simon 4473e9c5b2
add apprise notifications 11 months ago
Simon 75a63c4828
paginate channel migration index update 11 months ago
Simon aea403a874
additional thumb dl error handling 11 months ago
Simon ab8fed14bb
handle edge cases in migration clean up 11 months ago
Simon 6f915a5733
fix channel tv art extraction 11 months ago
Simon f970ec867e
clarify subtitle language codes on settings page, #505 11 months ago
Simon ef0d490890
[API] change dates to ISO format 11 months ago
lamusmaser 865089d46d
Resolve #502 by making the extension lowercase before comparison. (#504)
* Resolve #502 with making the extension lowercase.
Add note to `EXT_MAP` reference.

* Fixed comment for linting, added more details.
11 months ago
Simon d500fa5eeb
add unstable footer 11 months ago
Simon 4c681d813d
fix lint 11 months ago
Simon 434aa97a86
static cache file path building, #498 11 months ago
Simon efde4b1142
skip subtitle if not processed yet, #496 11 months ago
Simon 6022bdd3cd
fix doc string 11 months ago
Simon 99baf64b11
update requirements 11 months ago
Simon 61b04ba5cf
channel migration take 2 11 months ago
Simon 2a60360f4a
handle empty channel migration cleanup 12 months ago
Simon 8a7cb8bc6f
bump redis 12 months ago
lamusmaser 1be80b24c2
Implement #490 - Add version API and add local_version function. (#491)
* Add version API and add local_version function.

* Minor adjustments for linting.

* Add missing newlines for linter.

* Add missing comma to `urls.py`.

* Remove `version/` endpoint.

* Remove the `VersionView`.

* Prepare `PingView` for removal of the `is_static` response.

* Remove the `is_unstable` response from `ReleaseVersion`.

* Readd missing class instantiation for first call of `ReleaseVersion`.
12 months ago
Simon 061c653bce
retry get config better startup error handling, #485 12 months ago
Simon 72a98b0473
handle missing channel_tvart_url in thumb validator, #479 12 months ago
Simon 88e199ef9c
reset reindex counter on new added to queue, #478 12 months ago
Simon 879497d25a
bump libs 12 months ago
Simon 103409770d
temporary fix for is_favorited extraction error 12 months ago
Simon 094ccf4186
bump libs 1 year ago
Simon 247808563a
download error recovering 1 year ago
simon 5927ced485
bump libs 1 year ago
simon 6fb788b259
add delete button for unavailable video 1 year ago
simon 5e92d06f21
fix dl error retry logic, store and return error, #477 1 year ago
simon 7082718c14
add days to seconds string converter 1 year ago
simon 7e2cd6acd3
fix linter, take 2 1 year ago
simon 904d0de6aa
fix linter 1 year ago
simon c4e2332b83
fix startup race condition cluster health 1 year ago
simon 139d20560f
remove unused channel folder refresh 1 year ago
simon 66a14cf389
remove unused clean_string 1 year ago
simon 9b30c7df6e
refacter filesystem scanner 1 year ago
simon 5334d79d0d
default query 1 year ago
simon 64984bc1b3
fix chown for mig new folder 1 year ago
simon 8ef59f5bff
delete channel path building 1 year ago
simon 9d6ab6b7b3
implement new media_url 1 year ago
simon d62b0d3f8d
implement simplified path migration 1 year ago
simon 918a04c502
allow empty data for paginate 1 year ago
simon 60f1809ed8
fix rescan without task 1 year ago
simon f848e73251
HOTFIX: default bitrate, #415 1 year ago
simon c65fbb0b60
add filesystem rescan message 1 year ago
simon 95f114d817
remove leftover print statement 1 year ago
simon 05eac1a8ca
hotfix: skip filesystem rescan 1 year ago
simon ea42f0f1e3
bump TA_VERSION v0.3.6 1 year ago
simon a9b5713629
add channel tags to searching 1 year ago
simon dbaa13bfb0
apply auto_start sort to dl queue 1 year ago
simon 5d0d050149
fix channel reindex flow 1 year ago
simon c327e94726
add filesystem rescan to video migration 1 year ago
simon 774780d520
fix filesystem rescan without task 1 year ago
simon 5e1167743f
fix migration notification logic 1 year ago
simon 4376b826c4
add auto tag to video in queue 1 year ago
simon 206921baf0
add unstable footer 1 year ago
simon 0d2d3353a9
add extractor lang, #316 1 year ago
simon b47687535a
undo faulty channel sync to videos 1 year ago
simon e092a29b13
bump libs 1 year ago
simon 170839362e
fix ignoring progress message when not initiated with task 1 year ago
simon b95a659396
fix empty channel_subs parsing 1 year ago
simon 2b66786728
switch channel index to yt-dlp, index tags 1 year ago
simon b7bfeaf215
add channel tags to mapping 1 year ago
simon 5cc642098d
remove old migration 1 year ago
simon 7c01ad88b2
fix startup MediaStreamExtractor error handling 1 year ago
simon e866bb3be5
bump libs 1 year ago
simon 63021bd313
add autostart subs to config form 1 year ago
simon cbcb7484a7 Merge branch 'feature/queue-autorun' into testing 1 year ago
Dominik Sander 1c0b407f3f
Allow to configure yt-dlp `--format-sort` argument (#471)
* Allow to configure yt-dlp `--format-sort` argument

This exposes the [`--format-sort`][1] yt-dlp option to the user.

Implements parts of #316

[1]: https://github.com/yt-dlp/yt-dlp#sorting-formats

* Trim split values of format_sort, obey black

* Add `format_sort` to default configuration

* Add note about codec compatibility to settings page
1 year ago
simon 280c773441
add download now to form 1 year ago
simon efca460e9d
download now task handling 1 year ago
simon 8f3b832069
[API] add dl autostart query param 1 year ago
simon 9b3d1fa1fd Merge branch 'testing' into feature/queue-autorun 1 year ago
Matthew Glinski 9a38aff03d
Accept members-only/paid-content playlist IDs/URLs (#469)
This adds a new check to the playlist url_id check to allow playlist urls from subscription only content on youtube channels.

The channel I tested on had an ID length of 26 (https://www.youtube.com/playlist?list=UUMOvk0KB4Ue0vfPqvDzjIAwiQ), I am not sure if other lengths are valid here also.

I have tested this on my local install and it is downloading the members only playlist correctly as long as I have valid youtube cookies.
1 year ago
simon 06bbe2e400
fix playlist sub parser 1 year ago
simon 77900f89e3
remove legacy limit_count config 1 year ago
simon bc39561606
consolidate dl queue notification to method 1 year ago
simon 76535c6304
move add to queue to api call 1 year ago
simon 790ba3d20e
fix linter 1 year ago
simon 89779ec13b
consolidate update status priority 1 year ago
simon 1b6b219e02
modify _get_next to for auto_only attr 1 year ago
simon 5cd845e55d
fix type compatibility 1 year ago
simon 3a091ac287
implement auto_start indexing 1 year ago
simon e385331f6c
add typing 1 year ago
simon 4067b6c182
add channel aggs 1 year ago
simon 3063236634
add media stream index startup migration 1 year ago
simon a17f05ef21
index streams and file size 1 year ago
simon a4d42573ef
move DurationConverter to separate module 1 year ago
simon 5723ff1d20
bump TA_VERSION 1 year ago
simon 82d873a70f
add members link to rescan task 1 year ago
simon 7e4f564f45
fix title overwrite in notification 1 year ago
simon 3f7b38713f
add more progress notification for zip backup 1 year ago
simon 0b33edcb4c
tweak thumb resync paginate size 1 year ago
simon 06c7968070
fix silly host_clean and direct access TA_PASSWORD 1 year ago
simon a98a30cc85
elaborate TA_HOST parsed, #441 1 year ago
simon a924d648d6
add video id to processing message 1 year ago
simon 0750547236
bump bs4 1 year ago
simon 1aa4401e6c
move API documentation to docs 1 year ago
simon 5d524e5110
fix reindex notification filter 1 year ago
simon 1e96c3211f
remove unused functions 1 year ago
simon d2649c29c3
add recent videos to reindex queue task 1 year ago
simon ff89432d86
fix off by one task notification error 1 year ago
simon fb77ab44ee
fix manual import media file permission, add missing comment check trigger 1 year ago
simon e43840da31
fix manual index folder permission 1 year ago
simon 3fa5ed725e
fix missing progress script for channel notification 1 year ago
simon 841f5ab67f
fix missing tvart fallback key 1 year ago
simon 4038a837cf
fix chown for subtitles 1 year ago
simon 5b2d7db102
fix chown for channel folder creation 1 year ago
simon c8dd391fd3
fix channel tv art validator callback 1 year ago
simon 780115adb6
download and index channel tv art 1 year ago
simon 8eec866b31
bump libs 1 year ago
simon 0b300e7e12
replace all old wiki links to new docs 1 year ago
simon 20a39895f9 New task backend, #build
Changed:
- major refactor of how tasks are handled in the backend
- major refactor on how notifications are returned to UI
- [API] remov old task endpoints
- [API] add endpoints for task-name and task-id
- [API] add token delete endpoint
1 year ago
Kevin Gibbons efdffb365a
prevent keyboard events from reaching player (#459) 1 year ago
simon ee4dbf99b3
add type hints 1 year ago
simon 981a4cb8b3
clear queue on stop 1 year ago
simon 2a0a04ac65
cleanup notifications 1 year ago
simon db0ade203a
return task commands to notification backend 1 year ago
simon f0becb750a
add unstable footer 1 year ago
simon 8fc9afbad9
restructure progress update notification content 1 year ago
simon 2b8012b5d4
return command to task 1 year ago
simon 81701df1c7
speed up comments and channel extraction by disabling format test 1 year ago
simon df9a52a8f2
speed up add to queue by disabling format check 1 year ago
simon d082d3deba
bump libs 1 year ago
simon 19c853f07b
fix message trunct 1 year ago
simon c63249b778
faster check on restart only, sleep before CommandError 1 year ago
simon 8cf41a4043
merge redis backend branch into testing 1 year ago
simon 0e726af2de
switch task creation to api posts 1 year ago
simon f304c2eb02
remove legacy kill_dl task 1 year ago
simon 2bc92c9095
handle on_failure task callback 1 year ago
simon 33b9a012d4
implement api-stop for download_pending 1 year ago
simon 860213c427
fix empty reply 1 year ago
simon 272972429b
handle hard task reset at startup 1 year ago
simon 3e2b2f2be1
fix linter 1 year ago
simon db0e362b7d
make update_subscribed stoppable 1 year ago
simon 5ffc2046d4
add task stop and kill to frontend 1 year ago
simon 3bd6075a9b
[API] remove old task endpoint add task-name and task-id 1 year ago
simon 11a61a06a6
simplify view import 1 year ago
simon 3f96b37b51
fix notification data attr 1 year ago
simon 4f89a0696b
remove legacy progress view 1 year ago
simon 16862df71e
update progress frontend to use api 1 year ago
simon 3f4d0c0c76
change message groups 1 year ago
simon 73c82a91c0
use task notification for already running 1 year ago
simon f194259ab3
refactor subscribe task backend 1 year ago
simon 3b9d083f5e
notify only if task attr is set 1 year ago
simon b2fa92a8c3
refactor channel playlist index task backend 1 year ago
simon d533c7acfe
refactor re_sync_thumbs task 1 year ago
simon e6da63ff09
clean up notification 1 year ago
simon 461c2c4600
refactor thumbnail check task 1 year ago
simon 0ab41f74dc
refactor filesystem class task 1 year ago
simon 1ab7127ed3
split filesystem and manual import classes 1 year ago
simon 6b2bd06393
refactor backup-restore tasks 1 year ago
simon 04a559e471
refactor manual import task 1 year ago
simon 6b7354b14f
refactor reindex task 1 year ago
simon 2c719ae1ae
refactor download_pending task 1 year ago
simon 488711ee8f
refactor extract dl task 1 year ago
simon 78f04a2ffc
refactor subs rescan to new task manager 1 year ago
simon 58530563ce
fix empty is_pending 1 year ago
simon 259008df50
add notification api endpoint 1 year ago
simon 20f8a5a501
implement BaseTask with callbacks 1 year ago
Gavin Palmer 9afd81b372
reset token api refactor (#446)
* move reset-token from home to api

* cleanup

* cleanup markdown

* more dev readme cleanup

* remove dev files

* format

* make robot happier

---------

Co-authored-by: Gavin Palmer <gavin@herolfg.com>
1 year ago
simon 2d2431364d
handle get single not found 1 year ago
simon 16440a4170
add generic task command handler 1 year ago
simon 1f08ea9eea
handle empty tasks return 1 year ago
simon 2850988bfe Merge branch 'testing' into feat-redis-result 1 year ago
simon 9280159531
bump TA_VERSION 1 year ago
simon 8d13b947e2
fix linter 1 year ago
simon 22ef33c6ca
fix startup migration fail with unavailable shards 1 year ago
simon ee568534f6
improve comment notify timeouts 1 year ago
simon c204c6ca7f
finetune timeouts and notifications 1 year ago
simon 87cfd9e154
move up notification for faster feedback 1 year ago
simon 72e5d7ccf8
disable expire for queue setup message 1 year ago
simon a459661fa2
fallback to estimate size for progress hook 1 year ago
simon a56de2818d
consolidate yt-dlp obs 1 year ago
simon 3397418cab Merge branch 'master' into testing 1 year ago
p0358 7e9fed3d26
Add search usage summary on the search page and improve the search docs (#426)
* add search usage summary on the search page

* fix JS linter and switch multi-search-results elements from class to id

* changes according to feedback

* finetune colors

---------

Co-authored-by: simon <simobilleter@gmail.com>
1 year ago
simon 7dc67d6b6f
bump yt-dlp 1 year ago
simon 4fb5744cb3
clarify API docs add link to readme 1 year ago
simon 5617d1c7ae
sort by date and delete task results 1 year ago
simon 666074ed49
refactor download task, consolidate tasks 1 year ago
simon 4c0de78fb4
refactor subscribe from form task 1 year ago
simon dcb0cf6a6d
refactor filesystem rescan and thumb tasks 1 year ago
simon e7fd9c0aec
refactor reindex, manual import, zip backup tasks 1 year ago
simon ea002ad45d
refactor rescan and add to pending 1 year ago
simon 6328e316f4
add task manager integration 1 year ago
simon b49e87c468
name all tasks 1 year ago
simon c4b175b2db
reindex simplify video meta unpack 1 year ago
simon b52aa4daba
fix media_url change in reindex, #424 1 year ago
simon 8d76961e77
bump deps 1 year ago
Clark e276700b6d
Fix #436 Include listen directive in replacement (#437) 1 year ago
simon 4a64748da8
bump TA_VERSION 1 year ago
simon 4dfc9cef52
better TA_HOST error handling 1 year ago
simon 571c2ce3a4
ensure load_new_defaults for all manage.py commands, #434 1 year ago
simon 229555d97d
fix raise commanderror when migration failed 1 year ago
simon c7a05a9ba3
a warning about zip file backups, use snapshots instead 1 year ago
simon 72924fab66
bump yt-dlp, #433 1 year ago
simon 72f091b85e
fix download filter for ignored videos, #401 1 year ago
simon a34c9479f2
use channel from queue for download query filtering, #431 1 year ago
simon 162c05628c
rename PendingInteract youtube_id kwargs 1 year ago
simon 1125c0c4bf
handle malformed thumbnail download, #430 1 year ago
simon 0e5421a558
bump django 1 year ago
simon 5ec0636807
[API] add filter subscribed to channel list 1 year ago
simon 6641db3e7e
skip empty comment, #429 1 year ago
simon 77c26134d1
add print for thumbnail fallback, #425 1 year ago
simon ef685ecb42
handle PIL error empty thumbnail image, #425 1 year ago
simon df1018e70c
bump redis 1 year ago
simon 0658424b94 Merge branch 'master' into testing 1 year ago
p0358 d1b5644c63
refresh /progress more often (3000 ms => 500 ms) (#427) 1 year ago
lamusmaser 4936f2fdf2
412 fix `vid_type` with downloads (single and bulk) (#413)
* update TA_VERSION v0.3.2

* Update `single_download` task to request proper `vid_type`.

* Modify `single_download` to match bulk download.

* pr 413: undo TA_VERSION update

---------

Co-authored-by: simon <simobilleter@gmail.com>
1 year ago