04e24906be
[cspan] Initialize 'video_type' to avoid 'UnboundLocalError' exceptions ( #8032 )
2015-12-28 13:06:30 +01:00
974c1b2d42
Merge branch 'dcn' of github.com:remitamine/youtube-dl into remitamine-dcn
2015-12-28 10:38:31 +01:00
bca9bea1c1
[dcn] make m3u8 formats extraction non fatal
2015-12-28 10:27:17 +01:00
bd3f9ecabe
[tunein] add support for tunein topic,clip and program( fixes #7348 )
2015-12-28 00:36:57 +01:00
c047270c02
[utils] Remove Content-encoding from headers after decompression
...
With cn_verification_proxy, our http_response() is called twice, one from
PerRequestProxyHandler.proxy_open() and another from normal
YoutubeDL.urlopen(). As a result, for proxies honoring Accept-Encoding, the
following bug occurs:
$ youtube-dl -vs --cn-verification-proxy https://secure.uku.im:993 "test:letv"
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['-vs', '--cn-verification-proxy', 'https://secure.uku.im:993 ', 'test:letv']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2015.12.23
[debug] Git HEAD: 97f18fahttp://www.letv.com/ptv/vplay/22005890.html
[Letv] 22005890: Downloading webpage
[Letv] 22005890: Downloading playJson data
ERROR: Unable to download JSON metadata: Not a gzipped file (b'{"') (caused by OSError('Not a gzipped file (b\'{"\')',)); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see https://yt-dl.org/update on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
File "/home/yen/Executables/Multimedia/youtube-dl/youtube_dl/extractor/common.py", line 330, in _request_webpage
return self._downloader.urlopen(url_or_request)
File "/home/yen/Executables/Multimedia/youtube-dl/youtube_dl/YoutubeDL.py", line 1886, in urlopen
return self._opener.open(req, timeout=self._socket_timeout)
File "/usr/lib/python3.5/urllib/request.py", line 471, in open
response = meth(req, response)
File "/home/yen/Executables/Multimedia/youtube-dl/youtube_dl/utils.py", line 773, in http_response
raise original_ioerror
File "/home/yen/Executables/Multimedia/youtube-dl/youtube_dl/utils.py", line 761, in http_response
uncompressed = io.BytesIO(gz.read())
File "/usr/lib/python3.5/gzip.py", line 274, in read
return self._buffer.read(size)
File "/usr/lib/python3.5/gzip.py", line 461, in read
if not self._read_gzip_header():
File "/usr/lib/python3.5/gzip.py", line 409, in _read_gzip_header
raise OSError('Not a gzipped file (%r)' % magic)
2015-12-28 01:09:18 +08:00
97f18fac3a
[vgtv] fix f4m downloading( fixes #7843 )
2015-12-27 17:44:55 +01:00
c71d2e2087
[livestream] change test url
2015-12-27 17:27:20 +01:00
59185202c6
[iqiyi] Add tests for #7894
2015-12-28 00:19:36 +08:00
bee83e84f6
[iqiyi]fix valid url
...
eg:
http://yule.iqiyi.com/zbj.html
2015-12-28 00:16:34 +08:00
82e02ea5fc
Update iqiyi.py
...
Fix part of the address can not be resolved.
eg:http://www.iqiyi.com/w_19rt6o8t9p.html
2015-12-28 00:16:21 +08:00
a95c26a06a
[jwplatform] Carry long line
2015-12-27 21:43:14 +06:00
0b0a17ae9d
[viki] Fix typo
2015-12-27 21:42:26 +06:00
30f51acbc8
[rai] Fix typos
2015-12-27 21:42:12 +06:00
e0898585a1
[jwplatform] Fix typo
2015-12-27 21:41:55 +06:00
62bdc9fecc
[esri] Fix typo
2015-12-27 21:41:36 +06:00
e73277c7e8
[abc7news] Remove redundant formats sorting
2015-12-27 21:41:21 +06:00
8d29e47f54
[common] simplify the use of _extract_m3u8_formats and _extract_f4m_formats
2015-12-27 15:33:39 +01:00
2db772b9ea
Merge branch 'master' of github.com:rg3/youtube-dl
2015-12-27 15:03:13 +01:00
7b81316508
[livestream] skip m3u8 manifest in progressive_urls
2015-12-27 14:58:57 +01:00
05358deeca
Merge branch 'master' of github.com:rg3/youtube-dl
2015-12-27 14:34:51 +01:00
9f610f3a9e
[sportdeutschland] Do not abort if meta info is missing
...
This fixes http://sportdeutschland.tv/badminton/yonex-copenhagen-masters-2015 . No testcase though since the event will be over by 2016.
2015-12-27 13:11:55 +01:00
dbfd06730c
Merge pull request #7892 from remitamine/livestream
...
[livestream] improve extraction(fixes #2133 )(fixes #2838 )(fixes #4152 )(fixes #6988 )
2015-12-27 13:11:33 +01:00
5b025168c7
[livestream] improve extraction
...
- split long lines
- use m3u8 entry protocol for live streams
- extend _VALID_URL regex for livestream original
- extract livestream original live streams
2015-12-27 12:57:39 +01:00
46124a49b2
Merge pull request #7851 from remitamine/kaltura
...
[kaltura] extract more formats
2015-12-27 10:34:36 +01:00
608cc3b85c
[kaltura] add referrer to m3u8 url
2015-12-27 10:19:44 +01:00
6afe044b51
[dcn] improve extraction
2015-12-27 09:56:15 +01:00
15aad84dc5
[lrt] Extract counters
2015-12-27 12:26:48 +06:00
f7e1d82d40
[lrt] Improve
2015-12-27 12:16:55 +06:00
339b1944e7
[lrt] fix the rest of extractor
...
Closes #7690 .
2015-12-26 20:02:54 +01:00
85367c3a47
[lrt] fix duration parsing
2015-12-26 19:29:54 +01:00
607d65fbce
[ign] flake8
2015-12-26 03:17:56 +06:00
9f0ee2a388
Merge pull request #7045 from remitamine/ign
...
[ign] add support for pcmag and extract all formats and more metadata(fixes #5335 )(fixes #7006 )
2015-12-25 20:06:27 +01:00
1fc0b47fdf
[srmediathek] improve extraction
2015-12-25 17:37:50 +01:00
6418b2439b
[rutv] Fix extraction ( Closes #8004 )
2015-12-25 21:14:00 +06:00
06d5556dfa
[rai] improve extraction
2015-12-25 15:38:12 +01:00
fb8e402ad2
[hotstar] Add new extractor
2015-12-25 01:59:56 +01:00
c24044635b
[zdf:channel] Add more tests
2015-12-24 20:44:49 +06:00
67ba388efb
[zdf:channel] Relax _VALID_URL
2015-12-24 20:42:29 +06:00
e41604227c
[zdf] expand valid-url pattern for channels
...
The webpage also creates URLs which include additional text that defines
the sorting order on the page like "aktuellste" (most current) and
"meist-gesehen" (most seen), e.g.:
http://www.zdf.de/ZDFmediathek/kanaluebersicht/aktuellste/332
http://www.zdf.de/ZDFmediathek/kanaluebersicht/meist-gesehen/332
2015-12-24 20:39:37 +06:00
8a609c32fd
[chaturbate] Improve error extraction ( Closes #7989 )
2015-12-24 20:09:48 +06:00
96db61ffb8
[theintercept] improve extraction
2015-12-23 22:36:53 +01:00
c153bd8b2f
Merge branch 'theintercept' of https://github.com/bit/youtube-dl into bit-theintercept
2015-12-23 21:50:27 +01:00
2c566d02fe
[pbs] Extend PBS station regex ( Closes #7964 )
2015-12-23 23:22:47 +06:00
a8f1d167f6
[arte] Prefer json URLs that contain the video id from the 'vid' parameter in the URL ( fixes #7920 )
2015-12-23 18:00:46 +01:00
261b4c23c7
[appletrailers] skip clips with empty url
2015-12-23 17:48:37 +01:00
dcdc352371
[instagram:user] Improve _VALID_URL ( Closes #7955 )
2015-12-23 21:13:31 +06:00
be514c856c
[24video] Fix test
2015-12-23 20:49:52 +06:00
128eb31d90
[24video] Fix extraction on python 2.6
2015-12-23 20:49:41 +06:00
747b028412
[24video] Fix extraction ( Closes #7956 )
2015-12-23 20:42:36 +06:00
7fe37d8a05
[appletrailers] Improve regex for fixing '<img>' tags ( #7953 )
2015-12-23 14:48:40 +01:00
f10c27b8cb
release 2015.12.23
2015-12-23 14:05:06 +01:00
60427f63d1
[appletrailers] Add support for AppleTrailers Section
2015-12-23 10:40:45 +01:00
178b47e6af
[daum] Add test for #7949
2015-12-23 02:59:49 +06:00
3a70ed9ebe
[daum] Fix extraction ( Closes #7949 )
2015-12-23 02:54:32 +06:00
89abf7bf4d
[periscope] Fix token based extraction ( Closes #7943 )
2015-12-23 02:09:50 +06:00
cfe9e5aa6c
[comcarcoff] Extract duration
2015-12-23 01:18:14 +06:00
4c24ed9464
[comcarcoff] Improve json data regex and modernize
2015-12-23 01:16:14 +06:00
11208ebbf1
Merge pull request #7942 from ausbin/comcarcoff-json-fix
...
[comcarcoff] adjust for json updates
2015-12-23 01:05:54 +06:00
774ce35571
[imgur] Improve ( Closes #7928 )
2015-12-22 21:48:48 +06:00
dbee18b552
Improve extraction ( Closes #7918 )
...
remove outer parentheses in if
Conflicts:
youtube_dl/extractor/imgur.py
checked code with flake8
not returning list in case of single images.
using the fact that id with length 5 are albums and more are single videos.
Also for single videos ie ImgurIE both urls - http://imgur.com/gallery/oWeAMW2 and http://imgur.com/oWeAMW2 are equally fine. Change regex to allow thuis.
For albums urls - http://imgur.com/gallery/Q95ko and http://imgur.com/Q95ko are ok. Change regex to allow this also.
update description in ImgurIE Tests.
Also move single video test 'https://imgur.com/gallery/YcAQlkx ' from ImgurAlbumIE to ImgurIE.
2015-12-22 21:43:49 +06:00
31d9ea4a3e
Merge pull request #7322 from remitamine/vgtv
...
[vgtv] extract videos from FTV, Aftenposten, Aftonbladet using VGTVIE
2015-12-22 16:10:04 +01:00
3b68efdc6a
[vgtv] update tests and correct format sorting
2015-12-22 15:54:51 +01:00
2be689b7e2
[theintercept] Add new extractor
2015-12-22 13:08:16 +01:00
2db5806991
[franceinter] use _match_id
2015-12-22 11:30:35 +01:00
220bc3f0e3
[franceinter] fix title extraction
2015-12-22 11:27:18 +01:00
48a6c984b8
[bleacherreport] update test
2015-12-22 10:14:57 +01:00
dc016bf521
[viki] detect errors and fix formats extraction
2015-12-22 09:55:25 +01:00
ff43d2365f
[soompi] remove extractor
...
http://tv.soompi.com now redirect to viki.com because Viki has acquired
Soompi
http://www.soompi.com/2015/08/19/we-got-married-soompi-joins-viki/
2015-12-22 07:58:33 +01:00
ed63cbd6ee
[comcarcoff] adjust for json updates
2015-12-21 20:28:38 -05:00
c7224074d6
[audimedia] correct test case id
2015-12-21 23:02:55 +01:00
eed30fea75
[flickr] fix format sorting
2015-12-21 22:10:16 +01:00
5625bd0617
[br] add support for br-klassik.de and improve extraction
...
- extend _VALID_URL to match both br.de and br-klassik.de
- extract all formats(hls,hds and rtmp)
- use xpath_element and xpath_text for xml info extraction
2015-12-21 21:06:10 +01:00
5ef5d25b15
[audiomack] Fix typo ( Closes #7936 )
2015-12-21 22:51:58 +06:00
0f15ad7b9b
[adultswim] update test
2015-12-21 17:07:19 +01:00
61ebb401b7
[atresplayer] improve extraction
...
- select hashlib.md5 constructor as digestmod(in python 3.4+ MD5 as
implicit default digest for digestmod is deprecated.)
- extract hls formats
- update tests
- extract errors
2015-12-21 16:26:40 +01:00
5c5a3ecf1b
[abc] detect expired state and update tests
2015-12-21 13:07:52 +01:00
0197004f78
release 2015.12.21
2015-12-21 11:42:25 +01:00
2c28da8e05
Merge branch 'bleacherreport' of github.com:remitamine/youtube-dl into remitamine-bleacherreport
2015-12-21 11:18:32 +01:00
c7fa5fa42c
[bleacherreport] fix style issues and simplify
2015-12-21 11:12:58 +01:00
7ba71e30fb
Merge branch 'bliptv' of github.com:remitamine/youtube-dl into remitamine-bliptv
2015-12-21 04:31:17 +01:00
7cb0952474
[makertv] improve extraction
2015-12-21 04:24:58 +01:00
a8ae232fa9
Merge branch 'googledrive' of github.com:remitamine/youtube-dl into remitamine-googledrive
2015-12-21 03:15:19 +01:00
5b251628e9
[googledrive] Modernize
2015-12-21 03:05:34 +01:00
b9a324c0da
Merge branch 'flickr' of github.com:remitamine/youtube-dl into remitamine-flickr
2015-12-21 00:37:51 +01:00
5b95419ca5
[flickr] extract views_count and tags
2015-12-21 00:20:22 +01:00
ecbccea703
[faz] extract duration and bitrate and use xpath_element and xpath_text for extraction
2015-12-20 21:38:30 +01:00
c240ab6ecf
Merge pull request #6790 from remitamine/tele13
...
[canal13cl] fix info extraction
2015-12-20 16:11:07 +01:00
6882c0870e
[tele13] improve extraction
...
- improve jwplayer setup regex
- sort formats
- remove duplicate formats
- update youtube test
2015-12-20 15:48:19 +01:00
b0eeaf4f40
Merge pull request #6928 from remitamine/cnet
...
[cnet] fix extraction and extract more formats and metadata(closes #7003 )
2015-12-20 12:59:35 +01:00
c6ed6fadc2
[cnet] improve extraction
...
- relex data json regex
- extract the platform metadata once
- extract hds formats
- extract duration
- extract thumbnail
2015-12-20 12:43:00 +01:00
e462474e1d
[youtube] Generalize playlists extractor
2015-12-20 07:48:16 +06:00
9b9c5355e4
Rename error_to_str to error_to_compat_str
2015-12-20 07:00:39 +06:00
d890b4cc0a
[nbc:news] Remove unnecessary compat_str
2015-12-20 06:43:42 +06:00
2c74e6fa77
[YoutubeDL] Revert error_to_str for ExtractorError
2015-12-20 06:35:58 +06:00
c0384f221e
Use proper encoding on compat_str construction when necessary
2015-12-20 06:29:36 +06:00
8e60dc7526
[utils] Add encode_compat_str
2015-12-20 06:26:26 +06:00
8900ab4d9b
[YoutubeDL] More error_to_str
2015-12-20 06:22:01 +06:00
fb043a6e4e
[YoutubeDL] Use error_to_str
2015-12-20 06:16:19 +06:00
7f8b271465
Properly convert errors to strings
2015-12-20 05:27:38 +06:00
fdae235858
[utils] Add error_to_str
2015-12-20 05:26:47 +06:00
1deb710f26
[gputechconf] improve extraction
2015-12-19 23:59:00 +01:00
ec6504b39c
[gputechconf] Add new extractor( closes #5775 )
2015-12-19 23:28:54 +01:00
dd85e4d707
[extractor/common] Properly decode error string on python 2 ( Closes #1354 , closes #3957 , closes #4037 , closes #6449 )
2015-12-20 02:43:50 +06:00
fa64a84311
[faz] fix info extraction
2015-12-19 19:02:04 +01:00
e0f06eae43
[fktv] fix info extraction
2015-12-19 18:26:28 +01:00
0f206ee814
[toggle] Change IE_NAME
2015-12-19 23:11:23 +06:00
cc0f378d54
[toggle] Rename to toggle
2015-12-19 19:59:00 +06:00
e33c9cba7c
[toggle] Improve _VALID_URL
2015-12-19 19:58:18 +06:00
989e9f8ead
[toggle] Improve formats extraction robustness
2015-12-19 19:52:37 +06:00
8f097af4ec
[toggle] Extract counters
2015-12-19 19:23:28 +06:00
c40dbb19ab
[toggle] Extract thumbnails
2015-12-19 19:19:26 +06:00
ffaf6e66e3
[toggle] Improve
2015-12-19 19:16:49 +06:00
74c730174f
[toggle] Style
2015-12-19 19:06:05 +06:00
c82a8dd14c
[toggle] Remove unused imports
2015-12-19 19:04:38 +06:00
f8253af561
[toggle] Use sanitized_Request
2015-12-19 19:03:55 +06:00
ed370ff0e6
[togglesg] Fixes
2015-12-19 18:48:59 +06:00
ee0f0393cf
[togglesg] New extractor for toggle.sg
2015-12-19 18:48:46 +06:00
db2fe38b55
[utils] Support alternative timestamp format in TTML
...
Fixes #7608
2015-12-19 19:29:51 +08:00
d631d5f9f2
[utils] Fix TTML conversion
...
Tolerate invalid timestamps (closes #7909 )
2015-12-19 18:21:42 +08:00
4f29fa9906
[brightcove:new] Add test for ref: prefixed video id
2015-12-18 22:31:48 +06:00
5b72fda140
[brightcove:new] Clarify ref: prefix
2015-12-18 22:22:41 +06:00
f81ccbb3df
[brightcove:new] Fix typo
2015-12-18 22:20:44 +06:00
9fd0f67678
[brightcove:new] Add support for ref: preffixed video ids ( Closes #7794 )
2015-12-18 22:18:55 +06:00
15d50aca64
[nowness] Add support for brightcove:new videos ( Closes #7884 )
2015-12-18 22:05:56 +06:00
7234d1d9c7
[brightcove:new] Add _extract_url
2015-12-18 22:05:32 +06:00
9796a9b20c
[ndr] Fix description and upload date extraction ( Closes #7893 )
2015-12-18 21:34:17 +06:00
016dd82050
release 2015.12.18
2015-12-18 14:21:30 +01:00
b95779be21
[jsinterp] Extend function regex ( Closes #7900 , closes #7901 )
2015-12-18 18:57:49 +06:00
10171468d9
[iqiyi] Update key ( closes #7896 )
2015-12-18 18:20:41 +08:00
64ccbf18c0
[livestream] improve extraction, add support for live streams and extract more info and formats
2015-12-17 20:56:54 +01:00
9dc1d94a0c
[noco] Fix bitrates
2015-12-17 22:18:28 +06:00
7824e1f6a6
[noco] Modernize
2015-12-17 22:16:58 +06:00
2469a6aecb
[noco] Adjust timestamp according to server time ( Closes #7864 )
2015-12-17 22:16:22 +06:00
8f0afda028
[pbs] Extend _VALID_URL ( Closes #7889 )
2015-12-17 20:24:33 +06:00
35e22b6b32
[youku] check for the correct variable
2015-12-17 12:51:50 +01:00
323f82a7e0
[vimeo] add test for original format
2015-12-16 17:00:17 +01:00
8534bf1f00
[vimeo] prefer original format
2015-12-16 16:36:25 +01:00
eb4f27405b
[vimeo] extract source file( closes #1072 )
2015-12-16 09:43:53 +01:00
2d3b70271c
[rutube] Extend _VALID_URL
2015-12-16 04:44:17 +06:00
ad1b6017cd
[tf1] Fix tests
2015-12-15 21:36:59 +06:00
05467d5a52
[tf1] Relax _VALID_URL
2015-12-15 21:31:58 +06:00
ae5e94808e
[tf1] Fix extraction (2)
2015-12-15 21:11:52 +06:00
d7ffcfcf97
[tf1] Fix extraction ( Closes #7873 )
2015-12-15 21:09:14 +06:00
0cb58b0259
[youtube] Extract alt_title and creator for music videos ( Closes #7862 )
2015-12-14 21:31:53 +06:00
31b2051e21
[utils] Add remove_quotes
2015-12-14 21:30:58 +06:00
eb0bdc2c3e
[novamov] Fix again
2015-12-14 02:50:59 +08:00
6583c741cd
[novamov] Fix filekey extraction and reupload test video
2015-12-14 02:34:20 +08:00
2d9295643e
[footyroom] Skip test
2015-12-13 23:55:10 +06:00
ee86e2c6d7
[novamov] Add support for mobile URLs
2015-12-13 19:16:01 +06:00
02a63fadc3
[infoq] Refactor and support the Chinese version
...
Closes #7576
2015-12-13 19:16:58 +08:00
Jaime Marquínez Ferrándiz
remitamine
Yen Chi Hsuan
forDream
gam2046
Sergey M․
Philipp Hagemeister
Giedrius Statkevičius
Boris Wachtmeister
Abhishek Kedia
j
Austin Adams
ping