6368e2e639
[cleanup] Misc
...
Closes #5541
2022-11-16 06:57:07 +05:30
a4894d3e25
[extractor/youtube] Consider language in format de-duplication
2022-11-15 05:23:46 +05:30
171a31dbe8
[extractor] Add a way to distinguish IEs that returns only videos
2022-11-13 10:56:04 +05:30
a8c754cc00
[extractor/youtube] Fix bug in handling of music URLs
...
Bug in bd7e919a75Closes #5502
2022-11-12 00:02:13 +05:30
08270da5c3
[extractor/youtube] Fix `ytuser:`
2022-11-11 16:29:52 +05:30
bd7e919a75
[extractor/youtube:tab] Improvements to tab handling ( #5487 )
...
* Better handling of direct channel URLs - See https://github.com/yt-dlp/yt-dlp/pull/5439#issuecomment-1309322019
* Prioritize tab id from URL slug - Closes #5486
* Add metadata for the wrapping playlist
* Simplify redirect for music playlists
2022-11-11 13:52:40 +05:30
e72e48c53f
[extractor/youtube] Ignore incomplete data error for comment replies ( #5490 )
...
When --ignore-errors is used.
Closes https://github.com/yt-dlp/yt-dlp/issues/4669
Authored by: coletdjnz
2022-11-10 06:35:22 +00:00
0cf643b234
[extractor/youtube] Differentiate between no and disabled comments ( #5491 )
...
`comments` and `comment_count` will be set to None, as opposed to
an empty list and 0, respectively.
Fixes https://github.com/yt-dlp/yt-dlp/issues/5068
Authored by: coletdjnz, pukkandan
2022-11-10 03:33:03 +00:00
4dc23a8051
[extractor/youtube:tab] Fix video metadata from tabs ( #5489 )
...
Closes #5488
Authored by: coletdjnz
2022-11-10 08:14:12 +05:30
86973308cd
[extractor/youtube:tab] Update tab handling for redesign ( #5439 )
...
Closes #5432 , #5430 , #5419
Authored by: coletdjnz, pukkandan
2022-11-09 14:28:44 +05:30
e14ea7fbd9
[extractor/youtube] Update piped instances ( #5441 )
...
Closes #5286
Authored by: Generator
2022-11-06 23:12:23 +05:30
6141346d18
[extractor/youtube] Update playlist metadata extraction for new layout ( #5376 )
...
Fixes https://github.com/yt-dlp/yt-dlp/issues/5373
Authored by: coletdjnz
2022-11-06 05:25:31 +00:00
2e30b46fe4
[extractor/youtube] Improve chapter parsing from description
...
Closes #5448
2022-11-05 15:34:53 +05:30
9da6612b0f
[extractor/youtube] Fix `duration` for premieres ( #5382 )
...
Closes #5378
Authored by: nosoop
2022-10-29 00:00:33 +05:30
e63faa101c
[extractor/youtube] Fix `live_status` extraction for playlist videos
...
Regression in 867c66ff97
2022-10-27 17:36:54 +13:00
5318156f1c
[extractor/youtube] Mark videos as fully watched
...
Closes #2555
Authored by: bsun0000
2022-10-19 00:07:47 +05:30
d5d1df8afd
[cleanup Misc
...
Closes #5162
2022-10-18 23:52:44 +05:30
6678a4f0b3
[extractor/youtube] Fix live_status
...
Bug in 4d37720a0c
2022-10-14 07:41:53 +05:30
5225df50cf
[extractor/youtube:tab] Let `approximate_date` return timestamp
2022-10-13 15:30:15 +05:30
0468a3b325
[jsinterp] Improve separating regex
...
Fixes https://github.com/yt-dlp/yt-dlp/issues/4635#issuecomment-1273974909
2022-10-11 08:02:26 +05:30
867c66ff97
[extractor/youtube] Extract concurrent view count for livestreams ( #5152 )
...
Adds new field `concurrent_view_count`
Closes https://github.com/yt-dlp/yt-dlp/issues/4843
Authored by: coletdjnz
2022-10-07 07:00:40 +00:00
4d37720a0c
[extractor/youtube] Download `post_live` videos from start ( #5091 )
...
* The fragments are generated as a `LazyList`. So only the required formats are expanded during download, but all fragment lists are printed/written in infojson.
* The m3u8 formats which cannot be downloaded from start are not extracted by default, but can be enabled with an extractor-arg. The extractor-arg `include_live_dash` is renamed to `include_incomplete_formats` to account for this new use-case.
Closes #1564
Authored by: Lesmiscore, pukkandan
2022-10-04 08:18:31 +05:30
a057779d5e
[cleanup] Minor fixes
...
Closes #5129 , Closes #4982
2022-10-04 01:48:14 +05:30
7a32c70d13
[cleanup] Fix flake8 and minor refactor
...
Issues from ab029d7e921fb53b946c
2022-09-27 08:32:57 +05:30
709ee21417
[extractor/youtube] Do not warn on duplicate chapters
...
Eg: vYbaM8w8yzw
2022-09-27 08:26:26 +05:30
1fb53b946c
[extractor/youtube:tab] Improve continuation items extraction
2022-09-27 04:44:54 +05:30
1dd18a8808
[extractor/YoutubeShortsAudioPivot] Support `source` URLs
...
`ytshortsap:` is no longer needed
2022-09-27 04:44:50 +05:30
0a5095fe8d
[extractor/youtube:tab] Support `reporthistory` page
...
Closes #4929
2022-09-27 04:44:50 +05:30
0ca0f88121
[extractor/heise] Fix extractor ( #5029 )
...
Fixes https://github.com/yt-dlp/yt-dlp/issues/1520
Authored by: coletdjnz
2022-09-26 00:58:06 +00:00
80eb0bd9b9
[extractor/youtube] Add support for Shorts audio pivot feed ( #4932 )
...
This feed shows Shorts using the audio of a given video.
ytshortsap: prefix can be used as a shortcut until YouTube
implements an official view.
Closes #4911
Authored by: coletdjnz
2022-09-22 05:39:02 +00:00
c26f9b991a
[extractor/youtube] Support changing extraction language ( #4470 )
...
Adds `--extractor-args youtube:lang=<supported lang code>` extractor arg to prefer translated fields (e.g. title and description) of that language, if available, for all YouTube extractors. See README or error message for list of supported language codes.
Closes https://github.com/yt-dlp/yt-dlp/issues/387
Authored by: coletdjnz
2022-09-09 05:16:46 +00:00
3ffb2f5bea
[extractor/youtube] Fix video like count extraction
...
Support new combined button layout
Authored by: coletdjnz
2022-09-09 12:34:39 +12:00
17ffed1842
[docs] Improvements
...
* Move detailed installation instructions to https://github.com/yt-dlp/yt-dlp/wiki/Installation
* Link to wiki where applicable
* Fix some mistakes. Closes #4853 , Closes #4855 , Closes #4852
* Improve some error messages
2022-09-07 17:38:05 +05:30
7c6eb424d3
[extractor/youtube] Detect `lazy-load-for-videos` embeds
...
Closes #4812
2022-09-02 02:01:57 +05:30
05deb747bb
[jsinterp] Fix escape in regex
2022-09-01 16:46:32 +05:30
b505e8517a
[extractor/youtube] Fallback regex for nsig code extraction
2022-09-01 16:46:32 +05:30
1ff88b7aec
[extractor/youtube] Add `no-youtube-prefer-utc-upload-date` compat option ( #4771 )
...
This option reverts 992f9a730b17322130a9
2022-09-01 10:02:28 +00:00
da4db748fa
[utils] Add `deprecation_warning`
...
See https://github.com/yt-dlp/yt-dlp/pull/2173#issuecomment-1097021515
2022-08-30 21:03:07 +05:30
d81ba7d491
[jsinterp, extractor/youtube] Minor fixes
2022-08-30 18:13:37 +05:30
c4b2df872d
[jsinterp] Fix `_separate`
...
Ref: https://github.com/yt-dlp/yt-dlp/issues/4635#issuecomment-1231126941
2022-08-30 16:06:40 +05:30
224b5a35f7
[extractor/youtube] Update iOS Innertube clients ( #4792 )
...
Authored by: SamantazFox
2022-08-29 03:36:55 +00:00
50ac0e5416
[extractor/youtube] Use device-specific user agent ( #4770 )
...
Thwart latest fingerprinting attempt (see https://github.com/iv-org/invidious/issues/3230#issuecomment-1226887639 )
Authored by: coletdjnz
2022-08-28 22:59:54 +00:00
5e01315aa1
[cache, extractor/youtube] Invalidate old cache
2022-08-27 07:25:14 +05:30
992dc6b486
[jsinterp] Implement timeout
...
Workaround for #4716
2022-08-22 06:19:06 +05:30
b25cac650f
[extractor/youtube] Fix bug in format sorting
2022-08-21 00:56:27 +05:30
90a1df305b
[test] Fix test_youtube_signature
2022-08-21 00:51:03 +05:30
a831c2ea90
[cleanup] Misc
2022-08-19 05:08:21 +05:30
25836db6be
[extractor/youtube] Add fallback to phantomjs
...
Related #4635
2022-08-18 21:35:18 +05:30
580ce00782
[youtube] Improve signature caching
...
and refactor related functions
2022-08-18 21:33:30 +05:30
f6ca640b12
[jsinterp] Fix for youtube player 1f7d5369
...
Closes #4635 again
2022-08-18 16:38:35 +05:30
3ce2933693
[youtube] Fix error reporting of "Incomplete data"
...
Related: #4669
2022-08-16 22:01:48 +05:30
5c6d2ef9d1
[youtube] Improve format sorting for IOS formats
...
When no itag/resolution is available for reference, use the closest resolution
2022-08-15 14:04:05 +05:30
62b58c0936
[docs] Consistent use of `e.g.` ( #4643 )
...
Authored by: Lesmiscore
2022-08-14 17:34:13 +05:30
8f53dc44a0
[jsinterp] Handle new youtube signature functions
...
Closes #4635
2022-08-14 05:12:32 +05:30
7e798d725e
[extractor] Fix format sorting of `channels`
2022-08-11 07:23:46 +05:30
c7dcf0b31e
[extractor/youtube] Add `androidSdkVersion` parameter to Android Innertube clients
...
Required to prevent YouTube returning a bad player response in some cases.
See: https://github.com/yt-dlp/yt-dlp/pull/4593 , https://github.com/TeamNewPipe/NewPipe/issues/8713 , https://github.com/iv-org/invidious/issues/3230 , https://github.com/Tyrrrz/YoutubeExplode/issues/647
Authored by: coletdjnz
2022-08-08 12:03:10 +12:00
a416623436
[extractor/youtube] Extract more format info
2022-08-08 01:47:07 +05:30
a3e9642116
[extractor/youtube] Prevent redirect to unwanted videos ( #4593 )
...
Example: https://www.youtube.com/watch?v=aQvGIIdgFDM
Authored by: coletdjnz
2022-08-07 19:13:20 +05:30
a0c830f488
[extractor/youtube] Bump Innertube client versions
...
YouTube may be requiring new versions soon. See https://github.com/iv-org/invidious/issues/3230 , https://github.com/TeamNewPipe/NewPipe/issues/8713
Authored by: coletdjnz
2022-08-02 19:02:05 +12:00
be5c1ae862
Standardize retry mechanism ( #1649 )
...
* [utils] Create `RetryManager`
* Migrate all retries to use the manager
* [extractor] Add wrapper methods for convenience
* Standardize console messages for retries
* Add `--retry-sleep` for extractors
2022-08-02 01:43:18 +05:30
bfd973ece3
[extractors] Use new framework for existing embeds ( #4307 )
...
`Brightcove` is difficult to migrate because it's subclasses may depend
on the signature of the current functions. So it is left as-is for now
Note: Tests have not been migrated
2022-08-02 01:08:16 +05:30
f2e8dbcc00
[extractor, test] Basic framework for embed tests ( #4307 )
...
and split download tests so they can be more easily run in CI
Authored by: coletdjnz
2022-08-02 01:08:16 +05:30
e325a21a1f
[extractor/youtube] Add `live_status=post_live` ( #4495 )
...
Related: https://github.com/yt-dlp/yt-dlp/issues/1564
Authored by: lazypete365
2022-08-01 01:42:04 +05:30
31b532a1f2
[cleanup] Misc
2022-07-31 03:35:16 +05:30
c646d76f67
[webvtt, extractor/youtube] Extract auto-subs from livestream VODs
...
Closes #4130
Authored by: pukkandan, fstirlitz
2022-07-31 02:20:11 +05:30
07b47084ba
[extractor/youtube] Parse translated subtitles only when requested
...
Closes #4274
2022-07-31 02:20:11 +05:30
693f060040
[youtube,twitch] Allow waiting for channels to become live
...
Closes #2597
2022-07-26 09:33:19 +05:30
45e8a04e48
[extractor/youtube] More metadata for storyboards ( #4334 )
...
Authored by: ftk
2022-07-12 20:46:45 +05:30
a3fb1ca5ab
[extractor/youtube] Fix duration check for post-live manifestless mode
2022-07-10 09:59:32 +05:30
12a1b2254d
[extractor/youtube, cleanup] Fix tests ( #4293 )
...
Authored by: sheerluck
2022-07-08 02:50:02 +05:30
a3976e0760
Improve chapter sanitization
2022-07-07 11:28:56 +05:30
ae61d108dd
[cleanup] Misc cleanup
2022-06-29 06:43:27 +05:30
962ffcf89c
[cleanup] Fix some typos ( #4194 )
...
Authored by: crazymoose77756
2022-06-26 17:50:06 -07:00
14f25df2b6
[compat] Remove deprecated functions from core code
2022-06-25 00:14:12 +05:30
ac66811112
[compat] Remove more functions
...
Removing any more will require changes to a large number of extractors
2022-06-25 00:08:55 +05:30
06cc8f103b
[extractor/youtube] Mark videos as fully watched ( #4146 )
...
* Also fixes videos appearing as shorts in watch history
Closes #2555
Authored by: Brett824
2022-06-23 16:30:17 -07:00
9809740ba5
[extractor, cleanup] Reduce direct use of `_downloader`
2022-06-23 09:57:26 +05:30
471d0367c7
[youtube:clips] Support downloading clips
...
Closes #2543
2022-06-22 02:50:55 +05:30
a70635b8a1
[cleanup, utils] Don't use kwargs for `format_field`
2022-06-18 08:13:22 +05:30
0df111a371
[youtube] Extract `comment_count` from webpage
...
Closes #4091
2022-06-17 12:00:55 +05:30
4ce05f5759
[extractor/youtube] Fix live chat for videos with content warning
...
Fixes #4051
Authored by: coletdjnz
2022-06-12 17:56:50 +12:00
56ba69e4c9
[cleanup] Misc fixes
...
Closes #4027
2022-06-11 05:00:12 +05:30
2ae778b8fc
[extractor/youtube] Add `innertube_host` and `innertube_key` extractor args ( #3916 )
...
Allows user to override Innertube API host or key for all requests
Authored by: coletdjnz
2022-06-08 22:18:01 +00:00
36195c4461
[dash] Show fragment count with `--live-from-start` ( #3493 )
...
Authored by: flashdagger
2022-06-07 05:44:08 -07:00
65141660ab
[extractor/youtube] Fix bug in b7c47b7438
...
Closes #3997
Authored by: coletdjnz
2022-06-07 12:26:36 +12:00
b7c47b7438
[extractor] Add `_search_json`
...
All fetching of JSON objects should eventually be done with this function
but only `youtube` is being refactored for now
2022-06-06 19:46:45 +05:30
1890fc6389
[cleanup] Misc fixes
...
Cherry-picks from: #3498 , #3947
Related: #3949 , https://github.com/yt-dlp/yt-dlp/issues/1839#issuecomment-1140313836
Authored by: pukkandan, flashdagger, gamer191
2022-06-03 21:45:35 +05:30
c7a7baaa13
[extractor/youtube] Fix `:ytnotifications` extractor ( #3775 )
...
Still some issues, see https://github.com/yt-dlp/yt-dlp/pull/3775
Authored by: coletdjnz
2022-06-03 07:04:39 +00:00
6b0b0a289a
[extractor/youtube:tab] Detect `videoRenderer` in `_post_thread_continuation_entries`
2022-06-01 02:03:24 +05:30
ee27297f82
[extractor/youtube] Fix initial player response extraction
...
Authored by: pukkandan, coletdjnz
2022-05-29 19:54:22 +12:00
0fe51254cb
[extractor/youtube] Bring back `_extract_chapters_from_description`
...
Closes #3886
2022-05-29 01:00:41 +05:30
52023f1291
[extractor/youtube] Make signature extraction non-fatal
...
and reduce verbosity of it's warning
Closes #3882
2022-05-29 00:00:24 +05:30
829bbd1d05
[youtube] Add warning for PostLiveDvr
...
Closes #3746 , Related #1564
2022-05-27 05:07:00 +05:30
2762dbb17e
[compat] Add `functools.cached_property`
2022-05-20 21:06:37 +05:30
2414649192
[cleanup] Misc cleanup
2022-05-17 00:07:43 +05:30
d1c4f6d4da
[youtube] Added piped instance urls ( #3714 )
...
Closes #3661
Authored by: JordanWeatherby
2022-05-12 13:52:13 -07:00
82d020804d
[extractor] Use classmethod/property where possible
...
and refactor lazy extractors accordingly.
This reduces the need to create extractor instances
2022-05-13 00:23:26 +05:30
0f06bcd759
[cleanup] Minor fixes (See desc)
...
* [youtube] Fix `--youtube-skip-dash-manifest`
* [build] Use `$()` in `Makefile`. Closes #3684
* Fix bug in 385ffb467b43d7f5a5d0
2022-05-09 17:59:26 +05:30
91e5e839d3
[youtube] Deprioritize format 22
...
Reduces chance of encountering #3372
2022-05-07 08:05:32 +05:30
6e634cbe42
[youtube] Add YoutubeStoriesIE ( #3362 )
...
Get channel stories with `ytstories:<channel UCID>`
Authored-by: coletdjnz
2022-05-01 06:46:28 +00:00
pukkandan
Matthew
Bruno Guerreiro
nosoop
bsun0000
Lesmiscore
Samantaz Fox
lazypete365
ftk
Andrew
crazymoose77756
Brett824
MMM
Jordan Weatherby