Commit Graph

1400 Commits (d37707bda466282b66ce381cbfd734f899f9e06e)

Author SHA1 Message Date
pukkandan fdeab99eab
[zee5] Add geo-bypass 3 years ago
pukkandan 9e907ebddf
[cleanup] Misc cleanup 3 years ago
pukkandan 21df2117e4
[vk] Capture `clip` URLs 3 years ago
pukkandan 06e57990f7
Allow multiple and nested configuration files 3 years ago
pukkandan b62fa6d75f
Fix `-s --ignore-no-formats --force-write-archive`
Bug in a13e684813
3 years ago
pukkandan be72c62480
Fix recursion error in f46e2f9d92
Closes #2216
3 years ago
pukkandan 61e9d9268c
Fix bug in 8896899216
Closes #2215
3 years ago
pukkandan a13e684813
Write `download_archive` only after all formats are downloaded
Closes #1470
3 years ago
pukkandan f46e2f9d92
Add key `requested_downloads` in the root `info_dict` 3 years ago
pukkandan 9c906919ae
Add field `video_autonumber`
Closes #662
3 years ago
pukkandan 6020e05d23
Raise error if subtitle download fails
Closes #2212
3 years ago
pukkandan ebed8b3732
Add more post-processing stages
playlist = After entire playlist
after_video = After downloading all formats of a video
3 years ago
pukkandan 1e43a6f733
Allow `--exec` to be run at any post-processing stage
Deprecates `--exec-before-download`
3 years ago
pukkandan ca30f449a1
Add `--print playlist:` to print fields per playlist 3 years ago
k3ns1n af3cbd8782
[vk] Improve _VALID_URL (#2207)
Authored by: k3ns1n
3 years ago
zenerdi0de 7141ced57d
[Dropbox] Support password protected files and more formats (#2201)
Authored by: zenerdi0de
3 years ago
coletdjnz 18c7683d27
[youtube:api] Update Innertube clients (#2163)
* Updated iOS clients to support 60fps formats (see: https://github.com/TeamNewPipe/NewPipeExtractor/issues/680#issuecomment-1002724558)
* General update of versions and keys of other clients
 Authored-by: coletdjnz
3 years ago
chris f5c2c2c9b0
[zdf] Add chapter extraction (#2198)
Authored by: iw0nderhow
3 years ago
pukkandan 8896899216
[FfmpegMetadata] Allow setting metadata of individual streams
Closes #877
3 years ago
pukkandan 1797b073ed
[utils] Use key `None` in `traverse_obj` to return as-is 3 years ago
pukkandan 4c922dd3fc
Fix live title for multiple formats 3 years ago
pukkandan b8e976a445
[facebook] Parse dash manifests 3 years ago
Ashish Gupta a9f5f5d6eb
[RedBullTV] Parse subtitles from manifest (#2200)
Closes #2151
Authored by: Ashish0804
3 years ago
chris f522573787
[extractor] Extract chapters from JSON-LD (#2031)
Authored by: iw0nderhow, pukkandan
3 years ago
nixxo 7592749cbe
[extractor] Extract thumbnails from JSON-LD (#2195)
Authored by: nixxo
3 years ago
MinePlayersPE 8efffafa53
[XVideos] Check HLS formats (#2193)
Closes #1823
Authored by; MinePlayersPE
3 years ago
Ashish Gupta 26f2aa3db9
[hotstar] Add extractor args to ignore tags (#2116)
Authored by: Ashish0804
3 years ago
pgaig 3464a2727b
[VrtNU] Handle empty title (#2147)
Closes #2146
Authored by: pgaig
3 years ago
Ashish Gupta 497d77e1aa
[KelbyOne] Add extractor (#2181)
Closes #2170
Authored by: Ashish0804
3 years ago
LE 9040e2d6e3
[mixcloud] Detect restrictions (#2169)
Authored by; llacb47
3 years ago
MinePlayersPE 6134fbeb65
[TikTok] Pass cookies to formats (#2171)
Closes #2166
Authored by: MinePlayersPE
3 years ago
MinePlayersPE cfcf60ea99
[BiliIntl] Add login (#2172)
and misc improvements

Authored by: MinePlayersPE
3 years ago
Felix S 4afa3ec4b6
[extractor] Detect more subtitle codecs in MPD manifests (#2174)
Authored by: fstirlitz
3 years ago
MinePlayersPE 11aa91a12f
[TikTok] Fix extraction for sigi-based webpages (#2164)
Fixes: #2133
Authored by: MinePlayersPE
3 years ago
pukkandan abbeeebc4c
[outtmpl] Alternate form for `D` and fix suffix's case
Fixes: https://github.com/yt-dlp/yt-dlp/issues/2085#issuecomment-1002247689, https://github.com/yt-dlp/yt-dlp/pull/2132/files#r775729811
3 years ago
pukkandan 2c539d493a
[cookies] Fix bug when keyring is unspecified
Closes #2167
3 years ago
pukkandan 042931a507
Allow escaped `,` in `--extractor-args`
Closes #2152
3 years ago
MinePlayersPE 96f13f01a6
[TikTok] Change app version (#2161)
Closes #2133, #2135
Authored by: MinePlayersPE, llacb47
3 years ago
u-spec-png 4b9353239e
[Drooble] Add extractor (#1547)
Closes #1527
Authored by: u-spec-png
3 years ago
u-spec-png dd5e60b15d
[Instagram] Add story/highlight extractor (#2006)
Fixes https://github.com/ytdl-org/youtube-dl/issues/25575
Authored by: u-spec-png
3 years ago
MinePlayersPE e540c56f39
[TikTok] Fallback to feed API endpoint (#2142)
Authored by: MinePlayersPE
Workaround for #2133
3 years ago
pukkandan 45d86abeb4
Allow unicode characters in `info.json`
Closes #2139
3 years ago
Pierre Mdawar f02d24d8d2
[utils] Fix `format_bytes` output for Bytes (#2132)
Authored by: pukkandan, mdawar
3 years ago
pukkandan ceb98323f2
Don't treat empty containers as `None` in `sanitize_info` 3 years ago
pukkandan 7537e35b64
[gfycat] Fix `uploader` 3 years ago
github-actions 1e5c83b26b [version] update
Created by: pukkandan

:ci skip all
3 years ago
pukkandan 6a34813a0d
[docs] Add examples for using `TYPES:` in `-P`/`-o` 3 years ago
Matt Broadway f59f5ef8b6
[cookies] Support other keyrings (#2032)
Authored by: mbway
3 years ago
pukkandan f44afb54ef
[aria2c] Don't show progress when `--no-progress` 3 years ago
pukkandan 77cee0f188
[EmbedThumbnail] Prefer AtomicParsley over ffmpeg if available 3 years ago
pukkandan 6a17677577
[ThumbnailsConvertor] Fix for when there are no thumbnails
Closes #2125
3 years ago
Ashish Gupta ee7b9bdf5d [Zee5] Fix VALID_URL for tv-shows 3 years ago
pukkandan 185bf31070
[youtube] End `live-from-start` properly when stream ends with 403
Closes #2089
3 years ago
pukkandan 0b77924a38
[tiktok] Fix `extractor_key` used in archive 3 years ago
MinePlayersPE 8126298c1b
[TikTok] Add music, sticker and tag IEs (#2119)
Closes #1752
Authored by: MinePlayersPE
3 years ago
pukkandan 6da22e7d4f
Avoid recursion error when re-extracting info 3 years ago
MinePlayersPE c62ecf0d90
[BiliIntl] Fix extractor (#2077)
Closes #1744
Authored by: MinePlayersPE
3 years ago
The Hatsune Daishi 3774f4f427
[PixivSketch] Add extractors (#2104)
Authored by: nao20010128nao
3 years ago
git-anony-mouse 9980d3d213
[generic] Fix HTTP KVS Player (#2111)
Authored by: git-anony-mouse
3 years ago
pukkandan 8eb4b1bb8e
[ffmpeg] Fix position of `--ppa`
Bug in ca5db158ae
Closes #2112
3 years ago
pukkandan 332da56f52
[CBC] Fix URL regex
Closes #2110
3 years ago
github-actions 459aea84c3 [version] update
Created by: pukkandan

:ci skip all
3 years ago
pukkandan 0f86a1cd59
[dplay] Temporary fix for `discoveryplus.com/it`
Closes #2073
3 years ago
pukkandan 352d5da812
[utils] Improve `parse_count` 3 years ago
MinePlayersPE d43de6821c
[GameJolt] Add extractors (#2036)
Authored by: MinePlayersPE
3 years ago
u-spec-png 070f6a85ea
[Steam] Fix extractor (#2029)
Closes #1992
Authored by: u-spec-png
3 years ago
Benedikt Wildenhain 4b4b7f746c
[OpenCast] Add extractors (#1905)
Original PR: https://github.com/ytdl-org/youtube-dl/pull/26934
Authored by: bwildenhain, C0D3D3V
3 years ago
Sonic e9efb99f66
[dropout] Add extractor (#2045)
Authored-by: TwoThousandHedgehogs, pukkandan
3 years ago
coletdjnz a709d87335
[youtube:tab] Extract video thumbnails from playlist (#2096)
closes #1184
Co-Authored-by: coletdjnz, pukkandan
3 years ago
siddharth 774a46c53d
[npr] Make SMIL extraction non-fatal (#2099)
Closes #1934
Authored by: r5d
3 years ago
MinePlayersPE c8b80b9643
[RCTIPlusSeries] Lazy extraction and video type selection (#2050)
Authored by: MinePlayersPE
3 years ago
MinePlayersPE 4e260d1a56
[Instagram] Try bypassing login wall with embed page (#2095)
Authored by: MinePlayersPE
3 years ago
Luc Ritchie 4f3fa23e5a
[utils] Fix parsing `YYYYMMDD` dates in Nov/Dec (#2094)
The date format `%Y%m%d%H%M` will successfully match against
one-digit month, day, hour, and minute strings, even though %m et al.
are documented as being zero-padded. So dates without time in
Nov/Dec may be wrongly parsed as dates in January with time.

This commit adds a format string of `%Y%m%d` to our supported date
format strings directly below (higher priority) its problematic relatives.

Closes #2076
Authored by: wlritchi
3 years ago
pukkandan b28bac93ab
Fix bug in 1cefca9e44
Fixes https://github.com/ytdl-patched/ytdl-patched/issues/11
3 years ago
pukkandan 37893bb0c9
[outtmpl] Change filename sanitization type to `S`
`F` is already used for float!
Bug in e0fd95737d
3 years ago
Ashish Gupta c25de59cf7
[LBRY] Support livestreams (#2062)
Closes #2054 
Authored by: Ashish0804, pukkandan
3 years ago
Emanuel Hoogeveen 205a0654c0
Add option `--file-access-retries` (#2066)
Closes #517
Authored by: ehoogeveen-medweb
3 years ago
aarubui 663949f825
[NJPWWorld] Extract formats from m3u8 (#2075)
Authored by: aarubui
3 years ago
pukkandan b69fd25c25
[cleanup] Misc cleanup
Closes #1942 #1976 #2020 #2058 #1984
3 years ago
pukkandan e0fd95737d
[outtmpl] Add alternate forms `F`, `D`
and improve `id` detection

F = sanitize as filename (# = restricted)
D = add Decimal suffixes

Closes #2085, 2081
3 years ago
pukkandan 4ac5b94807
[dash] Fix `--test`
Bug in adbc4ec4bb
3 years ago
pukkandan 4273cc776d
[dash] Fix aria2c dash downloads
Bug in adbc4ec4bb
3 years ago
pukkandan fa9f30b802
Add interactive format selection with `-f -`
Closes #2065
3 years ago
pukkandan 1cefca9e44
Add warning when using `-f best` 3 years ago
kebianizao 5edb8dfec2
[rtve] Add `RTVEAudioIE` (#1657)
Original PR: https://github.com/ytdl-org/youtube-dl/pull/29023
Authored by: kebianizao
3 years ago
The Hatsune Daishi adbc4ec4bb
[dash,youtube] Download live from start to end (#888)
* Add option `--live-from-start` to enable downloading live videos from start
* Add key `is_from_start` in formats to identify formats (of live videos) that downloads from start
* [dash] Create protocol `http_dash_segments_generator` that allows a function to be passed instead of fragments
* [fragment] Allow multiple live dash formats to download simultaneously
* [youtube] Implement fragment re-fetching for the live dash formats
* [youtube] Re-extract dash manifest every 5 hours (manifest expires in 6hrs)
* [postprocessor/ffmpeg] Add `FFmpegFixupDuplicateMoovPP` to fixup duplicated moov atoms

Known issue: Ctrl+C doesn't work on Windows when downloading multiple formats

Closes #1521
Authored by: nao20010128nao, pukkandan
3 years ago
Julien Hadley Jack c031b0414c
[ondemandkorea] Update `jw_config` regex (#2056)
Authored by: julien-hadleyjack
3 years ago
coletdjnz f3aa3c3f98
[youtube:tab] Extract more metadata from feeds/channels/playlists (#1018)
Parse relative time text, extract live, upcoming status, availability and channel id from feeds/channels/playlists (where applicable). 
Closes #1883
Authored-by: coletdjnz
3 years ago
cypheron ae43a4b986
[hse] Add extractors (#1906)
Original PR: https://github.com/ytdl-org/youtube-dl/pull/27060
Authored by: cypheron, pukkandan
3 years ago
pukkandan ca5db158ae
[postprocessor/ffmpeg] Always add `faststart`
Closes #1491
3 years ago
pukkandan 5f549d4959
[Facebook] Handle redirect URLs
Closes #1035
3 years ago
Paul Wise 6839d02cb6
[ABC:iview] Add show extractor (#1630)
Authored by: pabs3
3 years ago
Abdullah Ibn Fulan 2aae2c91ff
[audiomack] Update album and song VALID_URL (#1203)
Original PR: https://github.com/ytdl-org/youtube-dl/pull/29810
Closes #1352, https://github.com/ytdl-org/youtube-dl/issues/29800
Authored by: abdullah-if, dirkf
3 years ago
Lapinot c2dedf12e8
[soundcloud] Add related tracks extractor (#1000)
Authored by: Lapin0t
3 years ago
Unit 193 e75bb0d6c3
[cleanup] Fix some typos (#2033)
Authored by: unit193
3 years ago
pukkandan dd0228ce1f
Remove known invalid thumbnails from `info_dict`
Related: https://github.com/yt-dlp/yt-dlp/issues/980#issuecomment-997396821
3 years ago
pukkandan 37e57a9fd4
[youtube:tab] Ignore query when redirecting channel to playlist
and cleanup of related code
Closes #2046
3 years ago
pukkandan 940a67a3e2
[docs] Change all examples to use double quotes
to be platform-agnostic
3 years ago
pukkandan e6ae51c123
[generic] Extract m3u8 formats from JSON-LD 3 years ago
pukkandan aab41cdd33
[PlutoTV] Expand `_VALID_URL`
Closes #2007
3 years ago
pukkandan b3a5115ff1
[zee5] Support /episodes in URL
Closes #2016
3 years ago
Felix S d76d15a669
[utils] Update `std_headers` (#2023)
* Update our chrome versions used for `User-Agent`s
* Drop the `Accept-Charset` header that no browser emits any more

Authored by: kikuyan, fstirlitz
3 years ago
PilzAdam e978789f0f
[outtmpl] Add operator `&` for replacement text (#2012)
Authored by: PilzAdam
3 years ago
Sematre 375d9360bf
[gronkh] Support new URL pattern (#2019)
Authored by: Sematre
3 years ago
Zenon Mousmoulas d5c3254889
[extractor] Support default implicit graph in JSON-LD (#1983)
Original PR: https://github.com/ytdl-org/youtube-dl/pull/30229

Per W3C JSON-LD v1.1 §4.9 (non-normative ref):

    When a JSON-LD document's top-level structure is a map that contains
    no other keys than @graph and optionally @context (properties that
    are not mapped to an IRI or a keyword are ignored), @graph is
    considered to express the otherwise implicit default graph.

Authored by: zmousm
3 years ago
std-move fe69f52e5c
[NovaEmbed] update player regex (#2008)
Authored by: std-move
3 years ago
pukkandan 3116be32b4
[brightcove] Fix 487c5b3389 3 years ago
pukkandan a8549f19e7
[tiktok] Fix 53dad39e30 3 years ago
pukkandan 39ca3b5c7f
[extractor] Standardize `_live_title` 3 years ago
coletdjnz 46383212b3
[youtube:comments] Add more options for limiting number of comments extracted (#1626)
Extends `max_comments` extractor arg to support `max-parents,max-replies,max-replies-per-thread`.
Authored-by: coletdjnz
3 years ago
pukkandan 0bb322b9c0
Add field `webpage_url_domain`
Closes #1311
3 years ago
pukkandan ff9f925b63
[test/download] Add more fields 3 years ago
pukkandan 5bfc8bee5a
Fix PostProcessor hooks not registered for some PPs
Closes #1993
3 years ago
pukkandan 19188702ef
[FormatSort] Prevent incorrect deprecation warning
Closes #1981
3 years ago
The Hatsune Daishi d984a98def
[ok.ru] add mobile fallback (#1972)
Authored by: nao20010128nao
3 years ago
u-spec-png 069c6ccf02
[olympics] Add uploader and cleanup (#1990)
Authored by: u-spec-png
3 years ago
MinePlayersPE 53dad39e30
[TikTok] Pass cookies to mobile API (#1994)
Authored by: MinePlayersPE
3 years ago
Ashish Gupta db77c49c84
[SonyLiv] Add OTP login support (#1959)
Closes #1945
Authored by: Ashish0804
3 years ago
Ashish Gupta abc07b554c
[NateTV] Add NateIE and NateProgramIE (#1950)
Authored by: Ashish0804, Hyeeji
3 years ago
Ashish Gupta 86f3d52f8c [DiscoveryPlusShowBaseIE] yield actual video id 3 years ago
u-spec-png 8b688881ba
[instagram] Expand valid URL (#1977)
Closes #1925

Authored by: u-spec-png
3 years ago
Ashish Gupta 13debc86e7
[Rutube] Add RutubeChannelIE (#1970)
Closes #1966 
Authored by: Ashish0804
3 years ago
nyuszika7h b5f94e4fa1
[toggo] Add extractor (#1961)
Authored by: nyuszika7h
3 years ago
YuenSzeHong 61882afdc5
[fujitv] Extract 1080p from `tv_android` m3u8 (#1928)
Authored by: YuenSzeHong
3 years ago
coletdjnz aa4b054512
[web.archive:youtube] Improve metadata extraction (#1785)
Authored-by: coletdjnz
3 years ago
YuenSzeHong 487c5b3389
[TVer] Extract better thumbnails (#1929)
Authored by: YuenSzeHong
3 years ago
Nil Admirari 8157a09d22
[SponsorBlock] Add Filler and Highlight categories (#1664)
Authored by: nihil-admirari, pukkandan
3 years ago
Jertzukka b1aaf1c07f
[gofile] Add extractor (#1850)
Closes #1831 
Authored by: Jertzukka, Ashish0804
3 years ago
chris 5f9aaac8c2
[zdf] Support videos with different ptmd location (#1893)
Authored by: iw0nderhow
3 years ago
David Skrundz 54c2521ca6
[CBC Gem] Extract 1080p formats (#1913)
Authored by: DavidSkrundz
3 years ago
The Hatsune Daishi 2814f12ba4
[skeb] Add extractor (#1916)
Fixes: https://github.com/ytdl-org/youtube-dl/issues/30287
Authored by: nao20010128nao
3 years ago
raleeper 1619836cb7
[crackle] Look for non-DRM formats (#1938)
Authored by: raleeper
3 years ago
pukkandan e3c7d49571
[compat] Suppress errors in enabling VT mode
Closes #1932
3 years ago
The Hatsune Daishi ddd24c9949
[ntvcojp] Extract NUXT data (#1915)
Fixes: https://github.com/ytdl-org/youtube-dl/issues/30309
Authored by: nao20010128nao
3 years ago
Michal Kubeček 443b21dc4e
[ceskatelevize] Fetch iframe from nextJS data (#1904)
Closes #1899
Authored by: mkubecek
3 years ago
The Hatsune Daishi 66f4c04e50
[extractor] Add `_search_nuxt_data` (#1921)
Authored by: nao20010128nao
3 years ago
nixxo 93864403ea
[redtube] Handle formats delivered inside a JSON (#1877)
Closes #1663
Authored by: dirkf, nixxo
3 years ago
pukkandan b5475f1145
Pre-process when using `--flat-playlist` 3 years ago
pukkandan 38d79fd16c
Use `parse_duration` for `--wait-for-video`
and some minor fix
3 years ago
pukkandan acc0d6a411
Allow `--no-write-thumbnail` to override `--write-all-thumbnail`
Closes #1900
3 years ago
pukkandan 146cc4114a
bugfix for 63ccf4ff1a 3 years ago
pukkandan 818faa3a86
[vimeo] Extract chapters
Closes #1892
3 years ago
MinePlayersPE aa5ecf082c
[TrueID] Add extractor (#1847)
Authored by: MinePlayersPE
3 years ago
pukkandan d2b2fca53f
[extractor] Ignore errors in comment extraction when `-i` is given
Closes #1787
3 years ago
pukkandan 63ccf4ff1a
[lazy_extractors] Fix bug in 2c4aaaddc9
SearchIEs must not inherit from extractors that have a _VALID_URL defined
3 years ago
pukkandan 43b2290658
Fix `--throttled-rate` 3 years ago
nixxo 99148c6a33
[RaiNews] Fix extractor (#1864)
Closes #1862
Authored by: nixxo
3 years ago
pukkandan 9bdd99cf39
[EmbedSubtitle] Disable duration check temporarily
Closes #1870, #1385
3 years ago
pukkandan 2c4aaaddc9
[lazy_extractors] Fix for search IEs
Closes #1851
3 years ago
pukkandan 5f7cb91ae9
[youtube] Fix `ytsearchdate`
Related: #1851
3 years ago