yt-dlp

mirror of https://github.com/yt-dlp/yt-dlp.git synced 2024-11-01 15:40:15 +00:00

Author	SHA1	Message	Date
pukkandan	7e798d725e	[extractor] Fix format sorting of `channels`	2022-08-11 07:23:46 +05:30
coletdjnz	c7dcf0b31e	[extractor/youtube] Add `androidSdkVersion` parameter to Android Innertube clients Required to prevent YouTube returning a bad player response in some cases. See: https://github.com/yt-dlp/yt-dlp/pull/4593, https://github.com/TeamNewPipe/NewPipe/issues/8713, https://github.com/iv-org/invidious/issues/3230, https://github.com/Tyrrrz/YoutubeExplode/issues/647 Authored by: coletdjnz	2022-08-08 12:03:10 +12:00
pukkandan	a416623436	[extractor/youtube] Extract more format info	2022-08-08 01:47:07 +05:30
coletdjnz	a3e9642116	[extractor/youtube] Prevent redirect to unwanted videos (#4593 ) Example: https://www.youtube.com/watch?v=aQvGIIdgFDM Authored by: coletdjnz	2022-08-07 19:13:20 +05:30
coletdjnz	a0c830f488	[extractor/youtube] Bump Innertube client versions YouTube may be requiring new versions soon. See https://github.com/iv-org/invidious/issues/3230, https://github.com/TeamNewPipe/NewPipe/issues/8713 Authored by: coletdjnz	2022-08-02 19:02:05 +12:00
pukkandan	be5c1ae862	Standardize retry mechanism (#1649 ) * [utils] Create `RetryManager` * Migrate all retries to use the manager * [extractor] Add wrapper methods for convenience * Standardize console messages for retries * Add `--retry-sleep` for extractors	2022-08-02 01:43:18 +05:30
pukkandan	bfd973ece3	[extractors] Use new framework for existing embeds (#4307 ) `Brightcove` is difficult to migrate because it's subclasses may depend on the signature of the current functions. So it is left as-is for now Note: Tests have not been migrated	2022-08-02 01:08:16 +05:30
pukkandan	f2e8dbcc00	[extractor, test] Basic framework for embed tests (#4307 ) and split download tests so they can be more easily run in CI Authored by: coletdjnz	2022-08-02 01:08:16 +05:30
lazypete365	e325a21a1f	[extractor/youtube] Add `live_status=post_live` (#4495 ) Related: https://github.com/yt-dlp/yt-dlp/issues/1564 Authored by: lazypete365	2022-08-01 01:42:04 +05:30
pukkandan	31b532a1f2	[cleanup] Misc	2022-07-31 03:35:16 +05:30
pukkandan	c646d76f67	[webvtt, extractor/youtube] Extract auto-subs from livestream VODs Closes #4130 Authored by: pukkandan, fstirlitz	2022-07-31 02:20:11 +05:30
pukkandan	07b47084ba	[extractor/youtube] Parse translated subtitles only when requested Closes #4274	2022-07-31 02:20:11 +05:30
pukkandan	693f060040	[youtube,twitch] Allow waiting for channels to become live Closes #2597	2022-07-26 09:33:19 +05:30
ftk	45e8a04e48	[extractor/youtube] More metadata for storyboards (#4334 ) Authored by: ftk	2022-07-12 20:46:45 +05:30
pukkandan	a3fb1ca5ab	[extractor/youtube] Fix duration check for post-live manifestless mode	2022-07-10 09:59:32 +05:30
Andrew	12a1b2254d	[extractor/youtube, cleanup] Fix tests (#4293 ) Authored by: sheerluck	2022-07-08 02:50:02 +05:30
pukkandan	a3976e0760	Improve chapter sanitization	2022-07-07 11:28:56 +05:30
pukkandan	ae61d108dd	[cleanup] Misc cleanup	2022-06-29 06:43:27 +05:30
crazymoose77756	962ffcf89c	[cleanup] Fix some typos (#4194 ) Authored by: crazymoose77756	2022-06-26 17:50:06 -07:00
pukkandan	14f25df2b6	[compat] Remove deprecated functions from core code	2022-06-25 00:14:12 +05:30
pukkandan	ac66811112	[compat] Remove more functions Removing any more will require changes to a large number of extractors	2022-06-25 00:08:55 +05:30
Brett824	06cc8f103b	[extractor/youtube] Mark videos as fully watched (#4146 ) * Also fixes videos appearing as shorts in watch history Closes #2555 Authored by: Brett824	2022-06-23 16:30:17 -07:00
pukkandan	9809740ba5	[extractor, cleanup] Reduce direct use of `_downloader`	2022-06-23 09:57:26 +05:30
pukkandan	471d0367c7	[youtube:clips] Support downloading clips Closes #2543	2022-06-22 02:50:55 +05:30
pukkandan	a70635b8a1	[cleanup, utils] Don't use kwargs for `format_field`	2022-06-18 08:13:22 +05:30
pukkandan	0df111a371	[youtube] Extract `comment_count` from webpage Closes #4091	2022-06-17 12:00:55 +05:30
coletdjnz	4ce05f5759	[extractor/youtube] Fix live chat for videos with content warning Fixes #4051 Authored by: coletdjnz	2022-06-12 17:56:50 +12:00
pukkandan	56ba69e4c9	[cleanup] Misc fixes Closes #4027	2022-06-11 05:00:12 +05:30
coletdev	2ae778b8fc	[extractor/youtube] Add `innertube_host` and `innertube_key` extractor args (#3916 ) Allows user to override Innertube API host or key for all requests Authored by: coletdjnz	2022-06-08 22:18:01 +00:00
MMM	36195c4461	[dash] Show fragment count with `--live-from-start` (#3493 ) Authored by: flashdagger	2022-06-07 05:44:08 -07:00
coletdjnz	65141660ab	[extractor/youtube] Fix bug in `b7c47b7438` Closes #3997 Authored by: coletdjnz	2022-06-07 12:26:36 +12:00
pukkandan	b7c47b7438	[extractor] Add `_search_json` All fetching of JSON objects should eventually be done with this function but only `youtube` is being refactored for now	2022-06-06 19:46:45 +05:30
pukkandan	1890fc6389	[cleanup] Misc fixes Cherry-picks from: #3498, #3947 Related: #3949, https://github.com/yt-dlp/yt-dlp/issues/1839#issuecomment-1140313836 Authored by: pukkandan, flashdagger, gamer191	2022-06-03 21:45:35 +05:30
coletdev	c7a7baaa13	[extractor/youtube] Fix `:ytnotifications` extractor (#3775 ) Still some issues, see https://github.com/yt-dlp/yt-dlp/pull/3775 Authored by: coletdjnz	2022-06-03 07:04:39 +00:00
pukkandan	6b0b0a289a	[extractor/youtube:tab] Detect `videoRenderer` in `_post_thread_continuation_entries`	2022-06-01 02:03:24 +05:30
coletdjnz	ee27297f82	[extractor/youtube] Fix initial player response extraction Authored by: pukkandan, coletdjnz	2022-05-29 19:54:22 +12:00
pukkandan	0fe51254cb	[extractor/youtube] Bring back `_extract_chapters_from_description` Closes #3886	2022-05-29 01:00:41 +05:30
pukkandan	52023f1291	[extractor/youtube] Make signature extraction non-fatal and reduce verbosity of it's warning Closes #3882	2022-05-29 00:00:24 +05:30
pukkandan	829bbd1d05	[youtube] Add warning for PostLiveDvr Closes #3746, Related #1564	2022-05-27 05:07:00 +05:30
pukkandan	2762dbb17e	[compat] Add `functools.cached_property`	2022-05-20 21:06:37 +05:30
pukkandan	2414649192	[cleanup] Misc cleanup	2022-05-17 00:07:43 +05:30
Jordan Weatherby	d1c4f6d4da	[youtube] Added piped instance urls (#3714 ) Closes #3661 Authored by: JordanWeatherby	2022-05-12 13:52:13 -07:00
pukkandan	82d020804d	[extractor] Use classmethod/property where possible and refactor lazy extractors accordingly. This reduces the need to create extractor instances	2022-05-13 00:23:26 +05:30
pukkandan	0f06bcd759	[cleanup] Minor fixes (See desc) * [youtube] Fix `--youtube-skip-dash-manifest` * [build] Use `$()` in `Makefile`. Closes #3684 * Fix bug in `385ffb467b` * Fix bug in `43d7f5a5d0` * [cleanup] Remove unnecessary `utf-8` from `str.encode`/`bytes.decode` * [utils] LazyList: Expose unnecessarily "protected" attributes and other minor cleanup	2022-05-09 17:59:26 +05:30
pukkandan	91e5e839d3	[youtube] Deprioritize format 22 Reduces chance of encountering #3372	2022-05-07 08:05:32 +05:30
coletdev	6e634cbe42	[youtube] Add YoutubeStoriesIE (#3362 ) Get channel stories with `ytstories:<channel UCID>` Authored-by: coletdjnz	2022-05-01 06:46:28 +00:00
pukkandan	bfec31bec8	[youtube] De-prioritize auto-generated thumbnails Closes #3112	2022-04-29 07:41:39 +05:30
pukkandan	1d485a1a79	[cleanup] Misc fixes Closes #3565, https://github.com/yt-dlp/yt-dlp/issues/3514#issuecomment-1105944364	2022-04-29 07:39:33 +05:30
pukkandan	0a41f331cc	[doc] Minor improvements Closes #3518, Closes #3560	2022-04-29 06:53:36 +05:30
pukkandan	19a0394044	[cleanup] Misc cleanup and refactor (#2173 )	2022-04-18 02:28:28 +05:30
coletdjnz	affc4fefea	[youtube] Fix episode metadata extraction	2022-04-15 16:22:03 +12:00
pukkandan	f82711587c	[cleanup] Sort imports Using https://github.com/PyCQA/isort isort -m VERTICAL_HANGING_INDENT --py 36 -l 80 --rr -n --tc .	2022-04-12 05:32:52 +05:30
pukkandan	86e5f3ed2e	[cleanup] Upgrade syntax Using https://github.com/asottile/pyupgrade 1. `__future__` imports and `coding: utf-8` were removed 2. Files were rewritten with `pyupgrade --py36-plus --keep-percent-format` 3. f-strings were cherry-picked from `pyupgrade --py36-plus` Extractors are left untouched (except removing header) to avoid unnecessary merge conflicts	2022-04-12 05:32:51 +05:30
krichbanana	ca5300c7ed	[youtube] Add `:ytnotifications` extractor (#3347 ) Authored by: krichbanana	2022-04-09 12:55:24 -07:00
pukkandan	a25bca9f89	[youtube, cleanup] Minor refactoring Authored by: coletdjnz, pukkandan	2022-04-10 01:21:34 +05:30
coletdev	61d3665d9d	[youtube] Fix uploader for collaborative playlists (#3332 ) Authored by: coletdjnz	2022-04-07 01:11:16 -07:00
pukkandan	a44ca5a470	[cleanup] Misc fixes Closes https://github.com/yt-dlp/yt-dlp/pull/3213, Closes https://github.com/yt-dlp/yt-dlp/pull/3117 Related: https://github.com/yt-dlp/yt-dlp/issues/3146#issuecomment-1077323114, https://github.com/yt-dlp/yt-dlp/pull/3277#discussion_r841019671, `a825ffbffa (commitcomment-68538986)`, https://github.com/yt-dlp/yt-dlp/issues/2360, `5fa3c9a88f (r70393519)`, `5fa3c9a88f (r70393254)`	2022-04-05 18:12:18 +05:30
pukkandan	a17526e427	[youtube:tab] Minor improvements (See desc) * Support shorts on channel homepage * Extract thumbnail of OLAK playlists	2022-04-03 19:01:03 +05:30
coletdev	ad210f4fd4	[youtube:search] Support hashtag entries (#3265 ) Authored-by: coletdjnz	2022-04-02 06:11:14 +00:00
David	e7870111e8	[YouTube] Add new age-gate bypass (#3233 ) Closes #3182 Authored by: zerodytrash, pukkandan	2022-03-29 03:05:31 -07:00
coletdev	1c1b2f96ae	[youtube:tab] Fix duration extraction for shorts (#3171 ) Related: https://github.com/TeamNewPipe/NewPipe/issues/8034 Authored-by: coletdjnz	2022-03-28 00:49:42 +00:00
pukkandan	1235d333ab	[youtube] Fix auto-translated automatic captions `d49669acad` only covered ASR Closes #2956	2022-03-27 14:06:26 +05:30
pukkandan	18e4940825	[youtube] Add extractor-arg to skip auto-translated subs	2022-03-27 14:04:20 +05:30
shirt	727029c508	[youtube] Detect DRM better Authored by: shirt-dev	2022-03-27 11:27:27 +05:30
coletdev	fd2ad7cb24	[youtube:tab] Return shorts url if video is a short (#3168 ) Allows filtering out shorts from feeds with `--match-filter` Closes #3165 Authored-by: coletdjnz	2022-03-27 05:20:25 +00:00
pukkandan	ae72962643	[youtube] Try embedded client variants before agegate agegate variants appears to be broken, but don't remove them for the time-being	2022-03-25 05:00:41 +05:30
pukkandan	52efa4b312	[extractor] Add `_perform_login` function (#2943 ) * Adds new functions `_initialize_pre_login` and `_perform_login` as part of the extractor API * Adds `ie.supports_login` to the public API	2022-03-18 13:53:33 -07:00
pukkandan	e4b98809cf	[youtube] Fix pagination of `membership` tab	2022-03-18 05:23:51 +05:30
pukkandan	a1b2d84360	[youtube] Avoid false positives when detecting damaged formats Closes #3083	2022-03-16 19:46:29 +05:30
coletdjnz	5dbc77df26	[youtube:api] Prefer minified JSON response Authored-by: coletdjnz	2022-03-16 09:29:15 +13:00
coletdev	b3edc8068e	[downloader/mhtml] Fix fragments with absolute urls (#3044 ) Authored-by: coletdjnz	2022-03-13 22:03:40 +00:00
coletdev	17322130a9	[youtube] Improve video upload date handling (#3029 ) * Don't prefer UTC upload date for past live streams/premieres * Improve regex (fixes a regression) Authored-by: coletdjnz	2022-03-13 22:02:44 +00:00
pukkandan	ff91cf7483	[utils] Add `get_first`	2022-03-09 02:26:52 +05:30
pukkandan	a405b38f20	[youtube] Further de-prioritize 3gp format	2022-03-08 23:02:38 +05:30
pukkandan	08d30158ec	[cleanup, docs] Misc cleanup Closes #2828, closes #2734, closes #2802, closes #2937	2022-03-08 22:38:06 +05:30
coletdev	992f9a730b	[youtube] Prefer UTC upload date for videos (#2223 ) Except for live/scheduled streams/premieres. Closes #1881 Related: #2402 Authored-by: coletdjnz	2022-03-08 12:58:19 +05:30
pukkandan	d49669acad	[youtube] Fix automatic captions Closes #2956	2022-03-05 09:42:12 +05:30
pukkandan	e48b3875ec	Revert `2e4cacd038` Closes #2923	2022-03-04 20:18:14 +05:30
coletdev	7c219ea601	[youtube:tab] Follow redirect to regional channel (#2884 ) Closes #2694 Authored by: coletdjnz	2022-02-28 21:08:19 -08:00
Lesmiscore (Naoya Ozaki)	a539f06570	[downloader/fragment] Improve `--live-from-start` for YouTube livestreams (#2870 )	2022-02-25 02:00:46 +09:00
pukkandan	1108613f02	[youtube:tab] Reject webpage data if redirected to home page Closes #2660	2022-02-23 04:25:55 +05:30
pukkandan	a30a6ed3e4	[youtube:tab] Add `approximate_date` extractor-arg	2022-02-23 04:25:55 +05:30
Lesmiscore	a7d4acc018	[youtube] Escape possible `$` in `_extract_n_function_name` regex	2022-02-20 17:33:58 +09:00
pukkandan	0ad92dfb18	[youtube] De-prioritize potentially damaged formats Closes #2823	2022-02-18 19:41:37 +05:30
pukkandan	2e4cacd038	[youtube] Fix intermittent failure of embed-based age-gate bypass	2022-02-18 18:03:13 +05:30
MinePlayersPE	c571b3a6ab	[youtube] Fix n-sig extraction for phone player JS (#2816 ) Authored by: MinePlayersPE	2022-02-18 00:12:20 -08:00
coletdev	60f393e48b	[youtube] Ensure subtitle urls are absolute (#2765 ) Closes #2755 Authored by: coletdjnz	2022-02-13 13:36:01 -08:00
pukkandan	ab6df717d1	[youtube] Differentiate descriptive audio by language code Related: #2677	2022-02-12 02:13:17 +05:30
pukkandan	0c8d9e5fec	[youtube] Label original auto-subs Closes #2655	2022-02-12 01:50:49 +05:30
pukkandan	84bbc54599	[youtube:search] Add tests	2022-02-04 12:02:01 +05:30
coletdjnz	af5c1c553e	[youtube] Fix search extractor Regression introduced in `16aa9ea41d`. Closes #2628 Authored-by: coletdjnz	2022-02-04 10:32:56 +13:00
pukkandan	455a15e2dc	[cleanup,docs] Minor fixes Closes #2541, #2484	2022-02-03 21:00:39 +05:30
pukkandan	182bda88e8	[youtube, cleanup] Misc fixes and cleanup	2022-02-02 02:15:53 +05:30
pukkandan	16aa9ea41d	[youtube] Add extractor `YoutubeMusicSearchURLIE` Closes #2568	2022-02-02 00:11:38 +05:30
pukkandan	48416bc4a8	[youtube] Fix n-sig for player e06dea74	2022-02-01 08:10:41 +05:30
coletdjnz	87e8e8a7d0	[youtube:api] Do not use seek when reading HTTPError response Authored-by: coletdjnz	2022-01-23 19:11:32 +13:00
pukkandan	6970b6005e	[cleanup] Minor fixes Closes #2334	2022-01-21 13:27:44 +05:30
pukkandan	e0ddbd02bd	[cleanup] Use format_field where applicable	2022-01-21 13:27:40 +05:30
coletdjnz	6c73052c0a	[youtube] Extract channel subscriber count (#2399 ) Closes #2350 * Adds `channel_follower_count` field Authored-by: coletdjnz	2022-01-21 06:04:36 +00:00
coletdjnz	396a76f7bf	[youtube] Enforce UTC (#2402 ) and [utils] use `utcnow` in `datetime_from_str` Related: #2223 Authored by: coletdjnz	2022-01-20 20:32:01 +05:30

1 2 3 4 5 ...

335 Commits