Commit Graph

10732 Commits (c047270c02bef6c8303c985d1e1b8da5be394235)
 

Author SHA1 Message Date
Yen Chi Hsuan c047270c02 [utils] Remove Content-encoding from headers after decompression
With cn_verification_proxy, our http_response() is called twice, one from
PerRequestProxyHandler.proxy_open() and another from normal
YoutubeDL.urlopen(). As a result, for proxies honoring Accept-Encoding, the
following bug occurs:

$ youtube-dl -vs --cn-verification-proxy https://secure.uku.im:993 "test:letv"
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['-vs', '--cn-verification-proxy', 'https://secure.uku.im:993', 'test:letv']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2015.12.23
[debug] Git HEAD: 97f18fa
[debug] Python version 3.5.1 - Linux-4.3.3-1-ARCH-x86_64-with-arch-Arch-Linux
[debug] exe versions: ffmpeg 2.8.4, ffprobe 2.8.4, rtmpdump 2.4
[debug] Proxy map: {}
[TestURL] Test URL: http://www.letv.com/ptv/vplay/22005890.html
[Letv] 22005890: Downloading webpage
[Letv] 22005890: Downloading playJson data
ERROR: Unable to download JSON metadata: Not a gzipped file (b'{"') (caused by OSError('Not a gzipped file (b\'{"\')',)); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
  File "/home/yen/Executables/Multimedia/youtube-dl/youtube_dl/extractor/common.py", line 330, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "/home/yen/Executables/Multimedia/youtube-dl/youtube_dl/YoutubeDL.py", line 1886, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File "/usr/lib/python3.5/urllib/request.py", line 471, in open
    response = meth(req, response)
  File "/home/yen/Executables/Multimedia/youtube-dl/youtube_dl/utils.py", line 773, in http_response
    raise original_ioerror
  File "/home/yen/Executables/Multimedia/youtube-dl/youtube_dl/utils.py", line 761, in http_response
    uncompressed = io.BytesIO(gz.read())
  File "/usr/lib/python3.5/gzip.py", line 274, in read
    return self._buffer.read(size)
  File "/usr/lib/python3.5/gzip.py", line 461, in read
    if not self._read_gzip_header():
  File "/usr/lib/python3.5/gzip.py", line 409, in _read_gzip_header
    raise OSError('Not a gzipped file (%r)' % magic)
9 years ago
remitamine 97f18fac3a [vgtv] fix f4m downloading(fixes #7843) 9 years ago
remitamine c71d2e2087 [livestream] change test url 9 years ago
Yen Chi Hsuan 59185202c6 [iqiyi] Add tests for #7894 9 years ago
forDream bee83e84f6 [iqiyi]fix valid url
eg:
http://yule.iqiyi.com/zbj.html
9 years ago
gam2046 82e02ea5fc Update iqiyi.py
Fix part of the address can not be resolved.
eg:http://www.iqiyi.com/w_19rt6o8t9p.html
9 years ago
Sergey M․ a95c26a06a [jwplatform] Carry long line 9 years ago
Sergey M․ 0b0a17ae9d [viki] Fix typo 9 years ago
Sergey M․ 30f51acbc8 [rai] Fix typos 9 years ago
Sergey M․ e0898585a1 [jwplatform] Fix typo 9 years ago
Sergey M․ 62bdc9fecc [esri] Fix typo 9 years ago
Sergey M․ e73277c7e8 [abc7news] Remove redundant formats sorting 9 years ago
remitamine 2db772b9ea Merge branch 'master' of github.com:rg3/youtube-dl 9 years ago
remitamine 7b81316508 [livestream] skip m3u8 manifest in progressive_urls 9 years ago
Philipp Hagemeister 05358deeca Merge branch 'master' of github.com:rg3/youtube-dl 9 years ago
Philipp Hagemeister 9f610f3a9e [sportdeutschland] Do not abort if meta info is missing
This fixes http://sportdeutschland.tv/badminton/yonex-copenhagen-masters-2015 . No testcase though since the event will be over by 2016.
9 years ago
remitamine dbfd06730c Merge pull request #7892 from remitamine/livestream
[livestream] improve extraction(fixes #2133)(fixes #2838)(fixes #4152)(fixes #6988)
9 years ago
remitamine 5b025168c7 [livestream] improve extraction
- split long lines
- use m3u8 entry protocol for live streams
- extend _VALID_URL regex for livestream original
- extract livestream original live streams
9 years ago
remitamine 46124a49b2 Merge pull request #7851 from remitamine/kaltura
[kaltura] extract more formats
9 years ago
remitamine 608cc3b85c [kaltura] add referrer to m3u8 url 9 years ago
Sergey M․ 15aad84dc5 [lrt] Extract counters 9 years ago
Sergey M․ f7e1d82d40 [lrt] Improve 9 years ago
Giedrius Statkevičius 339b1944e7 [lrt] fix the rest of extractor
Closes #7690.
9 years ago
Giedrius Statkevičius 85367c3a47 [lrt] fix duration parsing 9 years ago
Sergey M․ 607d65fbce [ign] flake8 9 years ago
remitamine 9f0ee2a388 Merge pull request #7045 from remitamine/ign
[ign] add support for pcmag and extract all formats and more metadata(fixes #5335)(fixes #7006)
9 years ago
remitamine 1fc0b47fdf [srmediathek] improve extraction 9 years ago
Sergey M․ 6418b2439b [rutv] Fix extraction (Closes #8004) 9 years ago
remitamine 06d5556dfa [rai] improve extraction 9 years ago
remitamine fb8e402ad2 [hotstar] Add new extractor 9 years ago
Sergey M․ c24044635b [zdf:channel] Add more tests 9 years ago
Sergey M․ 67ba388efb [zdf:channel] Relax _VALID_URL 9 years ago
Boris Wachtmeister e41604227c [zdf] expand valid-url pattern for channels
The webpage also creates URLs which include additional text that defines
the sorting order on the page like "aktuellste" (most current) and
"meist-gesehen" (most seen), e.g.:

http://www.zdf.de/ZDFmediathek/kanaluebersicht/aktuellste/332
http://www.zdf.de/ZDFmediathek/kanaluebersicht/meist-gesehen/332
9 years ago
Sergey M․ 8a609c32fd [chaturbate] Improve error extraction (Closes #7989) 9 years ago
remitamine 96db61ffb8 [theintercept] improve extraction 9 years ago
remitamine c153bd8b2f Merge branch 'theintercept' of https://github.com/bit/youtube-dl into bit-theintercept 9 years ago
Sergey M 383003653f Merge pull request #7969 from jwilk/spelling
Fix typos
9 years ago
Jakub Wilk fc383f199e Fix typos 9 years ago
Sergey M․ 2c566d02fe [pbs] Extend PBS station regex (Closes #7964) 9 years ago
Jaime Marquínez Ferrándiz a8f1d167f6 [arte] Prefer json URLs that contain the video id from the 'vid' parameter in the URL (fixes #7920) 9 years ago
remitamine 261b4c23c7 [appletrailers] skip clips with empty url 9 years ago
Sergey M․ dcdc352371 [instagram:user] Improve _VALID_URL (Closes #7955) 9 years ago
Sergey M․ be514c856c [24video] Fix test 9 years ago
Sergey M․ 128eb31d90 [24video] Fix extraction on python 2.6 9 years ago
Sergey M․ 747b028412 [24video] Fix extraction (Closes #7956) 9 years ago
Jaime Marquínez Ferrándiz 7fe37d8a05 [appletrailers] Improve regex for fixing '<img>' tags (#7953) 9 years ago
Philipp Hagemeister f10c27b8cb release 2015.12.23 9 years ago
remitamine 60427f63d1 [appletrailers] Add support for AppleTrailers Section 9 years ago
Sergey M․ 178b47e6af [daum] Add test for #7949 9 years ago
Sergey M․ 3a70ed9ebe [daum] Fix extraction (Closes #7949) 9 years ago