coletdjnz
db7b054a61
[networking] Add request handler preference framework ( #7603 )
...
Preference functions that take a request and a request handler instance can be registered to prioritize different request handlers per request.
Authored by: coletdjnz
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
1 year ago
Franklin Lee
db97438940
[ie/PicartoVod] Fix extractor ( #7727 )
...
Closes #2926
Authored by: Frankgoji
1 year ago
ifan-t
b9de629d78
[ie/S4C] Add extractor ( #7730 )
...
Authored by: ifan-t
1 year ago
ringus1
a854fbec56
[ie/facebook] Add dash manifest URL ( #7743 )
...
Fixes #7742
Authored by: ringus1
1 year ago
ischmidt20
30b29f3715
[ie/fox] Support foxsports.com ( #7724 )
...
Authored by: ischmidt20
1 year ago
Steve
6d6081dda1
[extractor/pbs] Add extractor `PBSKidsIE` ( #7602 )
...
Authored by: snixon
Fixes #2440
1 year ago
bashonly
6014355c61
[ie/twitter] Add fallback, improve error handling ( #7621 )
...
Closes #7579 , Closes #7625
Authored by: bashonly
1 year ago
pukkandan
f73c118035
`FFmpegFixupM3u8PP` may need to run with ffmpeg
...
Bug in 62b5c94cad
Closes #7725
1 year ago
coletdjnz
546b2c28a1
[ie/youtube] Fix `player_params` arg being converted to lowercase
...
Fix bug in ba06d77a31
Authored by: coletdjnz
1 year ago
pukkandan
6148833f5c
[cleanup] Misc
1 year ago
pukkandan
8cb7fc44db
Fix `--check-formats`
...
Bug in bc344cd456
1 year ago
pukkandan
3f7965105d
[utils] HTTPHeaderDict: Handle byte values
1 year ago
bashonly
b09bd0c196
[ie/tiktok] Fix audio-only format extraction ( #7712 )
...
Closes #6608
Authored by: bashonly
1 year ago
bashonly
127a224606
[ie/LBRY] Fix original format extraction ( #7711 )
...
Authored by: bashonly
1 year ago
bashonly
86eeb044c2
[ie/hotstar] Support `/clips/` URLs ( #7710 )
...
Closes #7699
Authored by: bashonly
1 year ago
bashonly
9a04113dfb
[ie/Reddit] Fix thumbnail extraction
...
Authored by: bashonly
1 year ago
coletdjnz
ba06d77a31
[ie/youtube] Add `player_params` extractor arg ( #7719 )
...
Authored by: coletdjnz
1 year ago
coletdjnz
4bf912282a
[networking] Remove dot segments during URL normalization ( #7662 )
...
This implements RFC3986 5.2.4 remove_dot_segments during the URL normalization process.
Closes #3355 , #6526
Authored by: coletdjnz
1 year ago
nnoboa
a15fcd299e
[ie/Wimbledon] Add extractor ( #7551 )
...
Closes #7462
Authored by: nnoboa
1 year ago
Amirreza Aflakparast
c03a58ec99
[ie/MotorTrendOnDemand] Update `_VALID_URL` ( #7683 )
...
Closes #7680
Authored by: AmirAflak
1 year ago
coletdjnz
bbeacff7fc
[networking] Ignore invalid proxies in env ( #7704 )
...
Authored by: coletdjnz
1 year ago
bashonly
dae349da97
[ie/WrestleUniversePPV] Fix HLS AES key extraction
...
Fix bug in ef8fb7f029
Closes #7708
Authored by: bashonly
1 year ago
bashonly
550e65410a
[ie] Extract subtitles from SMIL manifests ( #7667 )
...
Authored by: bashonly, pukkandan
1 year ago
bashonly
39837ae319
[ie/triller] Fix unlisted video extraction ( #7670 )
...
Authored by: bashonly
1 year ago
coletdjnz
86aea0d3a2
[networking] Add strict Request extension checking ( #7604 )
...
Authored by: coletdjnz
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
1 year ago
bashonly
11de6fec9c
[ie/PatreonCampaign] Fix extraction ( #7664 )
...
Authored by: bashonly
1 year ago
pukkandan
a250b24733
[compat] Ensure submodules are imported correctly
...
Closes #7663
1 year ago
pukkandan
25b6e8f946
Fix e0c4db04dc
for pypy
1 year ago
pukkandan
e705738338
[ie/unsupported] List more sites with DRM
...
Closes #7323 , #3072 , #5740 , #5767 , #6125
1 year ago
pukkandan
62b5c94cad
[cleanup] Misc fixes
...
Closes #7528
1 year ago
pukkandan
e0c4db04dc
[compat] Add `types.NoneType`
1 year ago
pukkandan
81b4712bca
[extractor] Fix `--load-pages`
1 year ago
pukkandan
994f7ef8e6
[ie/generic] Fix generic title for embeds
...
Closes #7067
1 year ago
pukkandan
a264433c9f
[outtmpl] Fix replacement for `playlist_index`
1 year ago
pukkandan
9f66247289
[ie/abematv] Temporary fix for protocol handler
...
Closes #7622
1 year ago
bashonly
e57eb98222
[fd/external] Fix ffmpeg input from stdin ( #7655 )
...
Bugfix for 1ceb657bdd
Authored by: bashonly
1 year ago
Simon Sawicki
9b16762f48
[ie/crunchyroll] Remove initial state extraction ( #7632 )
...
Authored by: Grub4K
1 year ago
bashonly
65cfa2b057
[ie/MuseAI] Add extractor ( #7614 )
...
Closes #7543
Authored by: bashonly
1 year ago
bashonly
f4ea501551
[ie/MagellanTV] Add extractor ( #7616 )
...
Closes #7529
Authored by: bashonly
1 year ago
bashonly
af86873218
[utils] Improve `parse_duration`
...
Authored by: bashonly
1 year ago
bashonly
75dc8e673b
[networking] Fix `--legacy-server-connect` ( #7645 )
...
Bugfix for 227bf1a33b
Authored by: bashonly
1 year ago
bashonly
71baa490eb
[networking] Fix POST requests with zero-length payloads ( #7648 )
...
Bugfix for 227bf1a33b
Authored by: bashonly
1 year ago
bashonly
613dbce177
[ie/twitter:spaces] Fix format protocol ( #7550 )
...
Closes #7536
Authored by: bashonly
1 year ago
Văn Anh
bb5d84c9d2
[ie/facebook:reel] Fix extraction ( #7564 )
...
Closes #7469
Authored by: demon071, bashonly
1 year ago
zhong-yiyu
1d3d579c21
[ie/pornhub] Update access cookies for UK ( #7591 )
...
Closes #7590
Authored by: zhong-yiyu
1 year ago
bashonly
42ded0a429
[fd/external] Fixes to cookie handling
...
- Fix bug in `axel` Cookie header arg
- Pass cookies to `curl` as strings
- Write session cookies for `aria2c` and `wget`
Closes #7539
Authored by: bashonly
1 year ago
bashonly
6c5211cebe
[core] Fix HTTP headers and cookie handling
...
- Remove `Cookie` header from `http_headers` immediately after loading into cookiejar
- Restore compat for `--load-info-json` cookies
- Add more tests
- Fix improper passing of Cookie header by `MailRu` extractor
Closes #7558
Authored by: bashonly, pukkandan
1 year ago
Aaruni Kaushik
2b029ca0a9
[cleanup] Add color to `download-archive` message ( #5138 )
...
Authored by: aaruni96, Grub4K, pukkandan
Closes #4913
1 year ago
pukkandan
131d132da5
[build] Make sure deprecated modules are added
1 year ago
coletdjnz
3d2623a898
[compat, networking] Deprecate old functions ( #2861 )
...
Authored by: coletdjnz, pukkandan
1 year ago
coletdjnz
227bf1a33b
[networking] Rewrite architecture ( #2861 )
...
New networking interface consists of a `RequestDirector` that directs
each `Request` to appropriate `RequestHandler` and returns the
`Response` or raises `RequestError`. The handlers define adapters to
transform its internal Request/Response/Errors to our interfaces.
User-facing changes:
- Fix issues with per request proxies on redirects for urllib
- Support for `ALL_PROXY` environment variable for proxy setting
- Support for `socks5h` proxy
- Closes https://github.com/yt-dlp/yt-dlp/issues/6325 , https://github.com/ytdl-org/youtube-dl/issues/22618 , https://github.com/ytdl-org/youtube-dl/pull/28093
- Raise error when using `https` proxy instead of silently converting it to `http`
Authored by: coletdjnz
1 year ago
pukkandan
c365dba843
[networking] Add module ( #2861 )
...
No actual changes - code is only moved around
1 year ago
pukkandan
1b392f905d
[utils] Add temporary shim for logging
...
Related: #5680 , #7517
1 year ago
coletdjnz
1ba6fe9db5
[ie/youtube:tab] Detect looping feeds ( #6621 )
...
Closes https://github.com/yt-dlp/yt-dlp/issues/5555
Note: the first page may still be repeated, however this is better than nothing.
Authored by: coletdjnz
1 year ago
Finn R. Gärtner
1bcb9fe871
[ie/piapro] Support `/content` URL ( #7592 )
...
Authored by: FinnRG
1 year ago
Neurognostic
8a4cd12c8f
[pp/EmbedThumbnail] Support `m4v` ( #7583 )
...
Authored by: Neurognostic
1 year ago
Aleri Kaisattera
2cfe221fbb
[ie/streamanity] Remove ( #7571 )
...
Service is dead
Authored by: alerikaisattera
1 year ago
Mahmoud Abdel-Fattah
2af4eeb772
[utils] `clean_podcast_url`: Handle more trackers ( #7556 )
...
Authored by: mabdelfattah, bashonly
Closes #7544
1 year ago
Zprokkel
325191d0c9
[ie/vrt] Update token signing key ( #7519 )
...
Authored by: Zprokkel
1 year ago
GD-Slime
bdd0b75e3f
[ie/BiliBiliBangumi] Fix extractors ( #7337 )
...
- Overhaul BiliBiliBangumi extractor for the site's new API
- Add BiliBiliBangumiSeason extractor
- Refactor BiliBiliBangumiMedia extractor
Closes #6701 , Closes #7400
Authored by: GD-Slime
1 year ago
bashonly
92315c0377
[extractor/twitter] Fix GraphQL and legacy API ( #7516 )
...
Authored by: bashonly
1 year ago
pukkandan
b03fa78345
Revert 49296437a8
1 year ago
github-actions
cc0619f62d
Release 2023.07.06
...
Created by: pukkandan
:ci skip all :ci run dl
1 year ago
Simon Sawicki
3121512228
[core] Change how `Cookie` headers are handled
...
Cookies are now saved and loaded under `cookies` key in the info dict
instead of `http_headers.Cookie`. Cookies passed in headers are
auto-scoped to the input URLs with a warning.
Ref: https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-v8mc-9377-rwjj
Authored by: Grub4K
1 year ago
coletdjnz
f8b4bcc0a7
[core] Prevent `Cookie` leaks on HTTP redirect
...
Ref: https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-v8mc-9377-rwjj
Authored by: coletdjnz
1 year ago
bashonly
1ceb657bdd
[fd/external] Scope cookies
...
- ffmpeg: Calculate cookies from cookiejar and pass with `-cookies` arg instead of `-headers`
- aria2c, curl, wget: Write cookiejar to file and use external FD built-in cookiejar support
- httpie: Calculate cookies from cookiejar instead of `http_headers`
- axel: Calculate cookies from cookiejar and disable http redirection if cookies are passed
- May break redirects, but axel simply don't have proper cookie support
Ref: https://github.com/yt-dlp/yt-dlp/security/advisories/GHSA-v8mc-9377-rwjj
Authored by: bashonly, coletdjnz
1 year ago
pukkandan
ad8902f616
[ie/vidlii] Handle relative URLs
...
Closes #7480
1 year ago
pukkandan
94ed638a43
[ie/youtube] Avoid false DRM detection ( #7396 )
...
Some master manifests contain a mix of DRM and non-DRM formats
1 year ago
pukkandan
bc344cd456
[core] Allow extractors to mark formats as potentially DRM ( #7396 )
...
This is useful for HLS where detecting whether the format is
actually DRM requires the child manifest to be downloaded.
Makes the error message when using `--test` inconsistent,
but doesn't really matter.
1 year ago
pukkandan
906c0bdcd8
[formats] Fix best fallback for storyboards
...
Partial fix for #7478
1 year ago
pukkandan
337734d4a8
[cleanup] Misc
1 year ago
pukkandan
47bcd43724
[outtmpl] Pad `playlist_index` etc even when with internal formatting
...
Closes #7501
1 year ago
pukkandan
662ef1e910
[downloader/http] Avoid infinite loop when no data is received
...
Closes #7504
1 year ago
coletdjnz
90db9a3c00
[extractor/youtube:stories] Remove ( #7459 )
...
YouTube killed them
https://web.archive.org/web/20230630153050/https://support.google.com/youtube/thread/217640760
1 year ago
bashonly
49296437a8
[extractor/twitter] Fix unauthenticated extraction ( #7476 )
...
Closes #7473
Authored by: bashonly
1 year ago
bashonly
1cffd621cb
[extractor/twitter:spaces] Fix extraction ( #7512 )
...
Closes #7455
Authored by: bashonly
1 year ago
RfadnjdExt
3b7f5300c5
[extractor/googledrive] Fix source format extraction ( #7395 )
...
Closes #7344
Authored by: RfadnjdExt
1 year ago
coletdjnz
4dc4d8473c
[extractor/youtube] Ignore incomplete data for comment threads by default ( #7475 )
...
For both `--ignore-errors` and `--ignore-errors only_download`. Pass `--no-ignore-errors` to not ignore.
Closes https://github.com/yt-dlp/yt-dlp/issues/7474
Authored by: coletdjnz
1 year ago
c-basalt
8776349ef6
[extractor/vk] VKPlay, VKPlayLive: Add extractors ( #7358 )
...
Closes #7107
Authored by: c-basalt
1 year ago
urectanc
af1fd12f67
[extractor/stacommu] Add extractors ( #7432 )
...
Authored by: urectanc
1 year ago
coletdjnz
fcbc9ed760
[extractor/youtube:tab] Support shorts-only playlists ( #7425 )
...
Fixes https://github.com/yt-dlp/yt-dlp/issues/7424
Authored by: coletdjnz
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
1 year ago
bashonly
a2be9781fb
[extractor/Douyin] Fix extraction from webpage
...
Closes #7431
Authored by: bashonly
1 year ago
Xiao Han
8f05fbae2a
[extractor/abc] Fix extraction ( #7434 )
...
Closes #6433
Authored by: meliber
1 year ago
Aman Salwan
5b4b92769a
[extractor/crunchyroll:music] Fix `_VALID_URL` ( #7439 )
...
Closes #7419
Authored by: AmanSal1, rdamas
Co-authored-by: Robert Damas <robert.damas@byom.de>
1 year ago
pukkandan
91302ed349
[utils] clean_podcast_url: Handle protocol in redirect URL
...
Closes #7430
1 year ago
pukkandan
f393bbe724
[extractor/sbs] Python 3.7 compat
...
Closes #7410
1 year ago
pukkandan
8a8af356e3
[downloader/aria2c] Add `--no-conf`
...
Closes #7404
1 year ago
pukkandan
d949c10c45
[extractor/youtube] Process `post_live` over 2 hours
1 year ago
bashonly
ef8509c300
[extractor/kick] Fix `_VALID_URL`
...
Closes #7384
Authored by: bashonly
1 year ago
nnoboa
5e16cf92eb
[extractor/AdultSwim] Extract subtitles from m3u8 ( #7421 )
...
Authored by: nnoboa
Closes #6191
1 year ago
bashonly
f0a1ff1181
[extractor/qdance] Add extractor ( #7420 )
...
Closes #7385
Authored by: bashonly
1 year ago
pukkandan
58786a10f2
[extractor/youtube] Add extractor-arg `formats`
...
Closes #7417
1 year ago
pukkandan
e59e20744e
Bugfix for b4e0d75848
1 year ago
Simon
89bed01374
[extractor/youtube] Fix comments' `is_favorited` ( #7390 )
...
Authored by: bbilly1
Closes #7389
1 year ago
github-actions
de4cf77ec1
Release 2023.06.22
...
Created by: pukkandan
:ci skip all :ci run dl
1 year ago
pukkandan
812cdfa06c
[cleanup] Misc
1 year ago
pukkandan
cd810afe2a
[extractor/youtube] Improve nsig function name extraction
1 year ago
pukkandan
b4e0d75848
Improve `--download-sections`
...
* Support negative time-ranges
* Add `*from-url` to obey time-ranges in URL
Closes #7248
1 year ago
Berkan Teber
71dc18fa29
[extractor/youtube] Improve description parsing performance ( #7315 )
...
* The parsing is skipped when not needed
* The regex is improved by simulating atomic groups with lookaheads
Authored by: pukkandan, berkanteber
1 year ago
bashonly
98cb1eda7a
[extractor/rheinmaintv] Add extractor ( #7311 )
...
Authored by: barthelmannk
Co-authored-by: barthelmannk <81305638+barthelmannk@users.noreply.github.com>
1 year ago