Commit Graph

13747 Commits

Author SHA1 Message Date
Sergey M․ cf7259bc93
[downloader/http] Fix 302 infinite loops by not reusing requests 2018-02-04 06:58:34 +07:00
Sergey M․ b54d4a5ce8
Document http_chunk_size 2018-02-04 02:53:50 +07:00
Sergey M․ db157d2a2a
release 2018.02.03 2018-02-03 23:36:03 +07:00
Sergey M․ ba515388b8
Introduce --http-chunk-size 2018-02-03 23:08:58 +07:00
Remita Amine e2e18694db [redbulltv] fix extraction(closes #15481) 2018-02-03 15:43:33 +01:00
Sergey M․ 1367c798e3
[redtube] Fix metadata extraction (closes #15472) 2018-02-02 22:32:53 +07:00
Sergey M․ 9a340af37e
[compat] Mute some F821 under python 3 2018-02-02 03:18:22 +07:00
Sergey M․ 3c3bceb41d
[pladform] Respect platform id and extract HLS formats (closes #15468) 2018-02-02 03:07:30 +07:00
Sergey M․ 64a12edb48
[rtlnl] Remove progressive formats (closes #15459) 2018-02-01 21:30:17 +07:00
Remita Amine 4bf18702e6 [6play] do no modify asset urls with a token(#15248) 2018-02-01 11:22:05 +01:00
Remita Amine ecc218ab14 [nationalgeographic] Relax _VALID_URL 2018-01-31 09:19:11 +01:00
Sergey M․ d6b152915c
[dplay] Relax _VALID_URL (closes #15458) 2018-01-31 01:29:00 +07:00
M.Yasoob Ullah Khalid ☺ 5fa2a6a561 [soundcloud] Remove unused _IPHONE_CLIENT_ID 2018-01-30 22:51:43 +07:00
Remita Amine d2a422f548 [cbsinteractive] fix data extraction(closes #15451) 2018-01-29 15:33:24 +01:00
Sergey M․ b9d52fb2ca
[seznamzpravy] Remove debug output 2018-01-29 04:40:07 +07:00
Remita Amine 466000fc6b [amcnetworks] add support for SundanceTV(closes #9260) 2018-01-28 11:30:20 +01:00
Sergey M․ 65220c3bd6
Add support for IronPython 2018-01-28 05:48:18 +07:00
Sergey M․ c989bdbef8
[downloader/ism] Fix Python 3.2 support 2018-01-28 05:20:21 +07:00
Sergey M․ eee1692ff3
release 2018.01.27 2018-01-27 23:44:28 +07:00
Sergey M․ 3c3a07ee0b
[seznamzpravy] Improve and simplify (closes #14616) 2018-01-27 23:36:44 +07:00
Petr Novák 27940ca09c [seznamzpravy] Add extractor (closes #14102) 2018-01-27 23:34:31 +07:00
Sergey M․ 3931b84597
[extractor/common] Improve _json_ld for articles 2018-01-27 23:24:38 +07:00
Sergey M․ a0ee342b50
[dplay] Bypass geo restriction 2018-01-26 23:56:31 +07:00
Sergey M․ 864a4576b7
[dplay] Add support for disco-api videos (closes #15396) 2018-01-26 23:49:47 +07:00
Yen Chi Hsuan bbb7c3f7e9 [youtube] Extract precise error messages (closes #15284) 2018-01-25 22:30:33 +08:00
Sergey M․ 9d6458a206
[teachertube] Capture and output error message 2018-01-24 22:46:04 +07:00
Sergey M․ 837b061710
[teachertube] Fix and relax thumbnail extraction (closes #15403) 2018-01-24 22:41:25 +07:00
Remita Amine 967ebbdb6c [prosiebensat1] add another clip ID regexp(fixes #15378) 2018-01-23 19:22:44 +01:00
Remita Amine dc400ed6a2 [tbs] update tokenizer url(fixes #15395) 2018-01-23 19:06:46 +01:00
Sergey M․ cf2820710d
Switch codebase to use compat_b64decode 2018-01-23 22:23:12 +07:00
Sergey M․ 5d7d805ca9
[mixcloud] Use compat_b64decode (closes #15394) 2018-01-23 21:53:45 +07:00
Sergey M․ f206126df0
[compat] Add compat_b64decode 2018-01-23 21:53:01 +07:00
Sergey M․ 021bd012bb
[thesixtyone] Remove extractor (closes #15341) 2018-01-22 22:30:28 +07:00
Sergey M․ 6e5eacb770
release 2018.01.21 2018-01-21 21:26:05 +07:00
Sergey M․ 721a0c3c7b
[prosiebensat1] Relax clip id 2018-01-21 21:22:38 +07:00
Sergey M․ e0ab56571e
[southparkdk] Add support for southparkstudios.nu 2018-01-21 18:42:34 +07:00
Sergey M․ 99d6e696fc
[southpark] Add tests for collections (closes #14803) 2018-01-21 18:41:46 +07:00
catlover999 6289e07883
[southpark] Add support for collections 2018-01-21 18:41:10 +07:00
helb b2a027fc6f [franceinter] Fix upload date extraction (closes #14996) 2018-01-21 17:50:53 +07:00
Sergey M․ 0d9c48de4f
[extractor/common] Improve DASH formats extraction for jwplayer (#9242, #15187) 2018-01-21 17:42:48 +07:00
Sergey M․ df58ecbeba
[rtvs] Add extractor (closes #9242, closes #15187) 2018-01-21 17:40:23 +07:00
Sergey M․ ac458e90a3
[restudy] Extend _VALID_URL (#15347) 2018-01-21 01:22:16 +07:00
Sergey M․ 7df18fcc65
[restudy] Fix extraction (closes #15347) 2018-01-20 23:19:02 +07:00
Mike Fährmann c384d537f8 [util] Improve scientific notation handling in js_to_json (closes #14789) 2018-01-20 22:54:21 +07:00
Sergey M․ e7f3529f68
[youtube:live] Improve live detection (closes #15365) 2018-01-20 17:57:20 +07:00
Sergey M․ 7d5406216a
[springboardplatform] Add extractor 2018-01-20 00:34:10 +07:00
Philipp Hagemeister 2a3683c378 prosiebensat1: add another clip ID regexp 2018-01-19 18:26:47 +01:00
Sergey M․ 154e4fdace
[ringtv] Remove extractor (closes #15345) 2018-01-19 22:49:58 +07:00
Sergey M․ e2fc6df169
release 2018.01.18 2018-01-18 23:41:44 +07:00
Varun 67408fe0e9 [soundcloud] Update client id (closes #15306) 2018-01-18 22:30:43 +07:00
Sergey M․ cad9caf76b
[kamcord] Remove extractor (closes #15322) 2018-01-18 22:26:43 +07:00
Sergey M․ 4471affc34
[spiegel] Add support for nexx videos (closes #15285) 2018-01-17 22:03:56 +07:00
Sergey M․ 1370dba59f
[twitch] Fix authentication and error capture (closes #14090, closes #15264) 2018-01-16 22:34:16 +07:00
Sergey M․ 1d1d60f6dd
[vk] Detect more errors due to copyright complaints (#15259) 2018-01-16 00:51:50 +07:00
Sergey M․ e11ccd76c6
release 2018.01.14 2018-01-14 00:13:56 +07:00
Sergey M․ 391dd6f094
[youtube] Fix live streams extraction (closes #15202) 2018-01-14 00:03:22 +07:00
Sergey M․ 0ce39bc542
[wdr] Fix test 2018-01-13 23:33:52 +07:00
Sergey M․ 1915662d4f
[wdr] Bypass geo restriction 2018-01-13 23:30:56 +07:00
Sergey M․ 54e8f62e01
[wdr] Rework extractors (closes #14598) 2018-01-13 23:30:25 +07:00
Sebastian Leske 2d8bb80c60
[wdr:elefant] Add extractor 2018-01-13 23:29:36 +07:00
Sergey M․ df16e645f6
[gamestar] Fix issues (closes #15179) 2018-01-13 19:38:58 +07:00
Hendrik v. Raven d4aedca3bd
[gamestar] Add support for gamepro.de (closes #3384) 2018-01-13 19:36:59 +07:00
Sergey M․ 47e2a9bc53
[viafree] Skip rtmp formats (closes #15232) 2018-01-13 18:47:47 +07:00
Sergey M․ 609850acfb
[pandoratv] Add support for mobile URLs (closes #12441) 2018-01-11 23:10:18 +07:00
Sergey M․ 64287560e4
[pandoratv] Add support for new URL format (closes #15131) 2018-01-11 23:06:56 +07:00
scil a90641fe87 [ximalaya_extractor] Add new extractor ximalaya (#14687)
* [ximalaya_extractor] Add new extractor

* format change according by flake8

* changes accoring to review by @yan12125 at github pull #14687

* change %d to %s in a temp str

* seond changes accoring to review by @yan12125 at github pull #1468

* improve TESTS about contains

* changes accoring to third review by @yan12125 at github pull #1468

* forth changes accoring to forth review by @yan12125 at github pull #1468
2018-01-11 20:35:09 +08:00
Sergey M․ 1b79daffd9
[digg] Improve extraction 2018-01-10 22:19:51 +07:00
Sergey M․ e654829b4c
[digg] Add extractor (closes #15214) 2018-01-10 21:24:22 +07:00
Sergey M․ 2b4e1ace4a
[limelight] Tolerate empty pc formats (closes #15150, closes #15151, closes #15207) 2018-01-10 05:39:57 +07:00
Sergey M․ 310ea4661d
[ndr:embed:base] Make separate formats extraction non fatal (closes #15203) 2018-01-09 22:04:50 +07:00
Yen Chi Hsuan 5eca00a2e3 [weibo] Misc improvements 2018-01-09 18:12:55 +08:00
Yen Chi Hsuan 1dd38dc0f4 Merge branch 'weibo' of https://github.com/sprhawk/youtube-dl into sprhawk-weibo 2018-01-09 17:31:52 +08:00
Sergey M․ 8005dc68cb
[ok] Add support for live streams 2018-01-08 21:53:03 +07:00
Remita Amine a39e15c516 [canalplus] fix extraction(closes #15072) 2018-01-07 22:15:44 +01:00
Luca Steeb 3a513f29ad fix bilibili extraction (closes #15171) 2018-01-08 01:30:04 +08:00
Sergey M․ 950b5f2969
release 2018.01.07 2018-01-07 23:52:16 +07:00
Sergey M․ b0ead0e09a
[jwplatform] Add support for multiple embeds (closes #15192) 2018-01-07 21:49:23 +07:00
Sergey M․ 0a5b1295b7
[motherless:group] Relax entry extraction and add a fallback scenario 2018-01-07 00:31:53 +07:00
Sergey M․ a133eb7764
[motherless:group] Capture leading slash of video path 2018-01-07 00:02:41 +07:00
Sergey M․ f12628f934
[mitele] Fix extraction (closes #15186) 2018-01-06 23:58:00 +07:00
Martin Weinelt 45283afdec [motherless] Add support for groups 2018-01-06 23:33:40 +07:00
Sergey M․ b7c74c0403
[lynda] Relax _VALID_URL (closes #15185) 2018-01-06 23:12:30 +07:00
Parmjit Virk 0b0870f9d0 [soundcloud] Fallback to avatar picture for thumbnail (closes #12878) 2018-01-05 08:25:42 +07:00
JianxinLi da35331c6c [youku] Fix list extraction.(close #15135) (#15137)
* [youku] Fix list extraction.(close #15135)

Change-Id: I2e9c920143f4f16012252625943a8f18b8ff40eb

* [youku] Remove KeyError try-except

Change-Id: Ic46327905cbef1356b7b12d5eb3db5d9746ca338
2018-01-04 22:25:28 +08:00
Yen Chi Hsuan de329f64ab [openload] Fix extraction (closes #15166) 2018-01-04 13:26:08 +08:00
Sergey M․ 75ba0efb52
[lynda] Skip invalid subtitles (closes #15159) 2018-01-03 16:41:28 +07:00
Luc Ritchie f0c6c2bce2 [twitch] Pass video id to url_result when extracting playlist 2018-01-03 16:22:55 +07:00
Jaime Marquínez Ferrándiz 9650c3e91d [rtve.es:alacarta] Fix extraction of some new URLs 2018-01-02 21:12:39 +01:00
Mattias Wadman b5e531f31a [acast] Fix extraction 2018-01-02 23:32:17 +07:00
Philipp Hagemeister d7cd9a9e84
[utils] Fix youtube-dl under PyPy3 on Windows 2018-01-01 22:48:27 +07:00
Sergey M․ b300cda476
[YoutubeDL] Output python implementation in debug header 2018-01-01 21:52:24 +07:00
sprhawk 6648fd8ad6 changed to use .get to get field from json object 2018-01-01 18:33:14 +08:00
Sergey M․ 04cf1a191a
release 2017.12.31 2017-12-31 04:30:49 +07:00
Ondřej Caletka 126f225bcf
[extractor/common] Add container meta field for formats extracted in _parse_mpd_formats 2017-12-31 04:04:09 +07:00
Windom 4f5cf31977 [slutload] Add support for mobile URLs 2017-12-31 01:41:07 +07:00
Sergey M․ 77341dae14
[abc:iview] Improve extraction and bypass geo restriction (closes #14782) 2017-12-31 01:27:28 +07:00
d2au 2e65e7db9e
[abc:iview] Fix extraction (closes #14711)
ABC dropped unmetering, so change to metered hls urls which
require auth.
2017-12-31 01:27:22 +07:00
Sergey M․ 538d4f8681
[downloader/hls] Use HTTP headers for key request 2017-12-31 01:15:35 +07:00
Yen Chi Hsuan 620ee8712e [openload] Fix extraction (closes #15118) 2017-12-30 15:03:13 +08:00
Sergey M․ 2ca7ed41fe
[mediasite] Improve extraction and code style, add support for DASH (closes #11185, closes #14343, refs #5428) 2017-12-30 08:04:43 +07:00
felix 8056c8542d
[mediasite] Add extractor, subsume sandia and collegerama extractors 2017-12-30 07:23:41 +07:00
felix 2501d41ef4
[common] use AACL as the default fourcc when AudioTag is 255 2017-12-30 07:22:07 +07:00
Remita Amine d97cb84b31 [ufctv] Add new extractor(closes #14520) 2017-12-30 00:30:41 +01:00
50csent 2c8e11b4af
[pluralsight] Fix missing first line of subtitles (closes #11118) 2017-12-30 05:56:47 +07:00
Sergey M․ d2c5b5a951
[openload] Fallback on f-page extraction (closes #14665, closes #14879) 2017-12-30 05:53:56 +07:00
Sergey M․ 580f3c79d5
[vimeo] Improve password protected videos extraction (closes #15114) 2017-12-30 03:54:14 +07:00
sprhawk 48058d82dc replace unused _download_webpage_handle with _download_webpage 2017-12-30 01:14:21 +08:00
sprhawk 6a41a12d29 replace split with strip_jsonp 2017-12-30 01:11:30 +08:00
sprhawk 5c97ec5ff5 replace urlencode.encode with urlencode_postdata 2017-12-30 01:08:56 +08:00
Sergey M․ 9d6ac71c27
[extractor/common] Fix extraction of DASH formats with the same representation id (closes #15111) 2017-12-29 23:14:56 +07:00
Remita Amine 84f085d4bd [aws] fix canonical/signed headers generation in python 2(closes #15102) 2017-12-29 00:13:40 +01:00
Sergey M․ a491fd0c6f
release 2017.12.28 2017-12-28 23:12:56 +07:00
Sergey M․ 640788f6f4
[internazionale] Improve extraction (closes #14973) 2017-12-27 23:27:48 +07:00
Leonardo Taccari 1ae0f0a21d
[internazionale] Add extractor 2017-12-27 23:27:43 +07:00
Ondřej Caletka 616bb95b28 [playtvak] Relax video regex and make description optional 2017-12-27 22:57:26 +07:00
Remita Amine be069839b4 [filmweb] improve extraction 2017-12-26 19:41:08 +01:00
sprhawk c33de004e1 Merge branch 'master' of github.com:rg3/youtube-dl into weibo 2017-12-26 22:27:26 +08:00
sprhawk 42a1012c77 fix according to "https://github.com/rg3/youtube-dl/pull/15079#discussion_r158688607" 2017-12-26 22:26:01 +08:00
Déstin Reed a14001a5a1 [Filmweb] Add extractor 2017-12-26 15:19:37 +01:00
Remita Amine db145ee54a [espn] Add new extractor for http://fivethirtyeight.com(closes #6864) 2017-12-26 14:20:21 +01:00
Remita Amine 45d20488f1 [umg:de] Add new extractor(closes #11582)(closes #11584) 2017-12-26 12:32:04 +01:00
sprhawk 2593651224 fix compat_urllib_request for python2.7 2017-12-26 16:46:01 +08:00
sprhawk 951043724f re-format code to pass flake8 2017-12-26 16:38:51 +08:00
sprhawk d2be5bb5af change to use compat urllib 2017-12-26 16:28:47 +08:00
sprhawk 447a5a710d added weibo mobile site support 2017-12-26 16:24:56 +08:00
Remita Amine 0f897e0929 [espn] add support for espnfc and extract more formats(closes #8053) 2017-12-25 23:29:09 +01:00
JianxinLi d3ca283235 [youku] Add test case.
Some playlist has no data-id value.

Change-Id: I97455f2907f08bda03b538cdc13ec827e2f8ce26
2017-12-25 22:02:47 +08:00
JianxinLi d99a1000c7 [youku] Fix list extraction.(close #15065)
Change-Id: I578fdc5b69509bdcd8d3191e3917afe47c234ff6
2017-12-25 22:02:47 +08:00
Yen Chi Hsuan a75419586b [openload] Remove a confusing exception
If phantomjs is not installed, there's an error besides the missing
phantomjs exception:

Exception ignored in: <bound method PhantomJSwrapper.__del__ of <youtube_dl.extractor.openload.PhantomJSwrapper object at 0x7f8ad5e78278>>
Traceback (most recent call last):
  File "/home/yen/Projects/youtube-dl/youtube_dl/extractor/openload.py", line 142, in __del__
    os.remove(self._TMP_FILES[name].name)
AttributeError: 'PhantomJSwrapper' object has no attribute '_TMP_FILES'
2017-12-24 20:47:42 +08:00
Sergey M․ 273c23d960
[openload] Add support for oload.stream (closes #15070) 2017-12-24 13:53:27 +07:00
JianxinLi 0e25a1a278 [youku] Update ccode
Change-Id: Id397e814e81ff560506d68563b7409eebbe5943d
2017-12-23 23:34:42 +08:00
Sergey M․ 307a7588b0
release 2017.12.23 2017-12-23 21:24:18 +07:00
Sergey M․ c2f2f8b120
[kaltura] Fix typo 2017-12-23 21:22:41 +07:00
Sergey M․ 69d69da98a
[kaltura] Add another embed pattern for entry_id
For cases when player configuration map is setup via indexing operator, e.g. kalturaPlayerConfiguration_1_lre6rg3i_10[entry_id] = 1_lre6rg3i (see https://www.heise.de/video/artikel/odcast-c-t-uplink-20-1-Apple-CarPlay-vs-Android-Auto-Galileo-3D-Sound-erklaert-3919694.html)
2017-12-23 21:17:53 +07:00
Sergey M․ 5c5e60cff8
[voot] Fix video identification 2017-12-23 21:17:53 +07:00
Sergey M․ 2132edaa03
[extractor/common] Move X-Forwarded-For setup code into _request_webpage 2017-12-23 21:17:53 +07:00
Remita Amine 4b7dd1705a [7plus] Add new extractor(closes #15043) 2017-12-23 13:22:20 +01:00
Sergey M․ d2d766bc6d
[animeondemand] Fix typo 2017-12-20 23:18:14 +07:00
Sergey M․ 17c3aced5d
[animeondemand] Relax login error regex 2017-12-19 22:53:04 +07:00
Remita Amine 78466fcab5 [shahid] add support for show pages(closes #7401) 2017-12-19 02:00:38 +01:00
Sergey M․ 3961c6cb9d
[YoutubeDL] Add support for playlist_uploader and playlist_uploader_id in output template (closes #11427, #15018) 2017-12-19 03:53:44 +07:00
Sergey M․ 07aeced68e
[youtube] Extract uploader, uploader_id and uploader_url for playlists (#11427, #15018) 2017-12-19 03:51:28 +07:00
Sergey M․ c10c93238e
[extractor/common] Introduce uploader, uploader_id and uploader_url meta fields for playlists (#11427, #15018) 2017-12-19 03:51:03 +07:00
Sergey M․ 4a109f81bc
[afreecatv] Improve format extraction (closes #15019) 2017-12-19 00:38:39 +07:00
Sergey M․ 99081da90c
[downloader/fragment] Encode filename of fragment being removed (closes #15020) 2017-12-18 03:31:53 +07:00
Remita Amine 7e81010987 [cspan] add support for audio only pages and catch page errors(closes #14995) 2017-12-17 19:15:59 +01:00
Sergey M․ 549bb416f5
[mailru] Fix issues and improve (closes #14904) 2017-12-17 18:38:27 +07:00
Hongjie Dong 25475dfab3
[mailru] Add support for embed URLs 2017-12-17 18:37:03 +07:00
Remita Amine 3dfa9ec213 [crunchyroll] Future-proof XML element checks(closes #15013) 2017-12-17 09:15:44 +01:00
Sergey M․ 06dbcd7be4
[cbslocal] Fix timestamp extraction (closes #14999, closes #15000) 2017-12-16 21:57:30 +07:00