4240d50496
[YoutubeDL] improve error message for file:/// URLs
9 years ago
6240b0a278
[YoutubeDL] urlopen: use build_opener again
...
Otherwise we would need to manually add handlers like HTTPRedirectHandler, instead we add a customized FileHandler instance that raises an error.
9 years ago
e37afbe0b8
[YoutubeDL] urlopen: disable the 'file:' protocol ( #8227 )
...
If someone is running youtube-dl on a server to deliver files, the user could input 'file:///some/important/file' and youtube-dl would save that file as a video giving access to sensitive information to the user.
'file:' urls can be filtered, but the user can use an URL to a crafted m3u8 manifest like:
#EXTM3U
#EXT-X-MEDIA-SEQUENCE:0
#EXTINF:10.0
file:///etc/passwd
#EXT-X-ENDLIST
With this patch 'file:' URLs raise URLError like for unknown protocols.
9 years ago
40cf7fcbd2
[tudou] Add support for Albums and Playlists and extract more metadata
9 years ago
cc28492d31
[youtube] Fix acodec and vcodec order
...
In RFC6381, there's no rule stating that the first part of codecs should
be video and the second part should be audio, while it seems the case
for data reported by YouTube.
9 years ago
bc0550c262
[pluralsight] Fix new player ( Closes #8215 )
9 years ago
b83b782dc4
[downloader/fragment] Move helper data to context dict
9 years ago
16a348475c
[dailymotion] Prefer direct links ( Closes #8156 )
9 years ago
709185a264
[downloader/fragment] More smooth calculations
...
`downloaded_bytes` is now updated on each fragment progress hook invocation
9 years ago
9cb1a06b6c
[downloader/fragment] Remove unused code and fix zero division error
9 years ago
be27283ef6
[iprima] Mark broken
9 years ago
b924bfad68
[videott] Mark broken
9 years ago
192b9a571c
[videomega] Mark broken
9 years ago
6ec6cb4e95
Revert "fix typos"
...
This reverts commit 36a0e46c39
9 years ago
36a0e46c39
fix typos
9 years ago
dfb1b1468c
Fix typos
...
Closes #8200 .
9 years ago
3c91e41614
[downloader/fragment] Don't fail if the 'Content-Length' header is missing
...
In some dailymotion videos (like http://www.dailymotion.com/video/x3k0dtv from #8156 ) the segments URLs don't have the 'Content-Length' header and HttpFD sets the 'totat_bytes' field to None, so we also use '0' in that case (since we do different math operations with it).
9 years ago
7e8a800f29
[bigflix] Use correct indentation to make flake8 happy
9 years ago
2334762b03
[shahid] raise ExtractorError if the video is DRM protected
9 years ago
3fc088f8c7
[dcn] extract video ids in season entries
9 years ago
a9bbd26f1d
[bigflix] Improve formats extraction
9 years ago
6e99d5762a
[bigflix] Extract all formats
9 years ago
0a899a1448
[Bigflix] Add new extractor for bigflix.com
...
Add an IE to support bigflix.com. It uses some sort of silverlight
plugin whose video url is being populated using base64 encoded
flashvars. So it is quite straightforward to extract.
9 years ago
7a34302e95
[canalc2] Fix extraction ( Closes #8191 )
9 years ago
27783821af
[xhamster] Remove unused import
9 years ago
b374af6ebd
release 2016.01.09
9 years ago
16f1131a4d
[vimeo] Add test for #8187
9 years ago
d5f071afb5
[vimeo] Check source file URL ( Closes #8187 )
9 years ago
14b4f038c0
[xhamster] Update tests
9 years ago
bcac2a0710
[xhamster] Fix uploader extraction
9 years ago
1a6d92847f
[xhamster] Change title regex precedence
9 years ago
6a16fd4a1a
[xhamster] Fix view count extraction
9 years ago
44731e308c
[xhamster] Fix duration extraction
9 years ago
4763b624a6
[xhamster] Fix upload date extraction
9 years ago
6609b3ce37
[xhamster] Improve title extraction
9 years ago
5777f5d386
Extract xHamster title fix
9 years ago
5dbe81a1d3
[vimeo] Automatically pickup full movie when rented ( Closes #8171 )
9 years ago
4cf096a4a9
[ivideon] Add support for map bound URLs
9 years ago
18e6c97c48
[adultswim] Skip georestricted hls ( Closes #8168 )
9 years ago
97afd99a18
[soundcloud:likes] Adapt to API changes ( Closes #8166 )
9 years ago
23f13e9754
[youtube] Support expanding alternative format of links in description ( Closes #8164 )
9 years ago
2e02ecbccc
[ivideon] Add extractor
9 years ago
e4f49a8753
check video_play_path and use xpath_text
...
"This check should take place earlier and should be more general if not video_url:. Same should be done for video_play_path. Also these fields better extracted with xpath_text."
Suggestions by @dstftw
9 years ago
51d3045de2
[npr] Fix extractor ( Closes #7218 )
9 years ago
76048b23e8
[npr] Add extractor
...
removed md5 from _TEST
moved from xml data to json
test
changed _TEST url to one that will not expire, so tests would not be failing
9 years ago
f20756fb10
[udemy] Fix non free course message
9 years ago
17b2d7ca77
[udemy] Detect non free courses ( Closes #8138 )
9 years ago
2f546d0a3c
[vrt] Prefix format ids
9 years ago
18c782ab26
[vrt] Extend _VALUD_URL
9 years ago
33cee6c7f6
[dramafever] Add test for custom episode title
9 years ago
a2e51e7b49
[dramafever] Fix episode fallback
9 years ago
bd19aa0ed3
[dramafever] Extract episode
9 years ago
8f4c56f334
[dramafever] Extract episode number
9 years ago
1dcc38b233
[dramafever] Improve subtitles extraction ( Closes #8136 )
9 years ago
fff79f1867
[amp] Add missing subtitles to info dict
9 years ago
3f17c357d9
[downloader/hls] Don't let ffmpeg read from stdin ( #8139 )
...
If you run 'while read aurl ; do youtube-dl "${aurl}"; done < path_to_batch_file' (batch_file contains one url per line that uses the hls downloader) each call to youtube-dl consumed some characters and 'read' would assing to 'aurl' a non valid url
(This is the same problem that was fixed for the ffmpeg postprocessors in cffcbc02de
9 years ago
9938a17f92
[rte:radio] Extract timestamp
9 years ago
9746f4314a
[rte:radio] Simplify
9 years ago
0238451fc0
[rte] PEP 8
9 years ago
2098aee7d6
Merge pull request #8063 from bpfoley/rteradio
...
[rte:radio] Add support for RTE radio player
9 years ago
896c7a23cd
[extractor/rte.py] Add support for RTE radio player
...
While here, stop RteIE changing filename extensions to .mp4. The files
saved are .flv containers with h264 video.
9 years ago
1463c5b9ac
[ivi] Extract season info
9 years ago
c6270b2ed5
[ivi:compilation] Fix extraction
9 years ago
ab3176af34
[ivi] Fix extraction and modernize
9 years ago
5aa535c329
[bbccouk] Update tests ( Closes #8090 )
9 years ago
133b1886fc
[20min] Improve ( Closes #8110 )
9 years ago
66295fa4a6
[20min.ch] Added support for videoportal
9 years ago
e54c44eeab
[20min.ch] Add new extractor ( closes #5977 )
9 years ago
a7aaa39863
[utils] Extract known extensions for reuse
9 years ago
ea6abd740f
[nowtv] Mark broken
9 years ago
e1a0bfdffe
[youtube] added vcodec/acodec/abr for multiple itags
...
Should make downloading with filters more precise and easier, ie. bestvideo[vcodec=h264]. By default a lot of codecs are specified as avc1.xxxxxx and unique for each format, which makes them unusable for bestvideo selection.
9 years ago
3f3343cd3e
Merge pull request #8061 from dstftw/introduce-chapter-and-series-fields
...
Introduce chapter and series fields
9 years ago
4059eabd58
[dreisat] use extract_from_xml_url from ZDFIE for info extraction( fixes #7680 )( fixes #8104 )( closes #8121 )
9 years ago
6b46102661
[zdf] fix rtmpt format downloading handle errors
9 years ago
141a273a8b
[qqmusic] Update tests
9 years ago
2fffb1dcd0
[qqmusic:playlist] Capture errors and update tests
9 years ago
e698e4e533
Merge branch 'remitamine-baidu'
9 years ago
b7546397f0
[baidu] Use list comprehension
9 years ago
0311677258
[baidu] Add notes for API calls
9 years ago
88fb59d91b
[bbccouk] Extend title extraction
9 years ago
a1d9f6c5dc
[baidu] Improve playlist description
9 years ago
c579c5e967
[baidu] Cleanups
9 years ago
c9c194053d
Merge branch 'baidu' of https://github.com/remitamine/youtube-dl into remitamine-baidu
9 years ago
f20a11ed25
[bbccouk] Extend _VALID_URL ( Closes #8116 )
9 years ago
76a353c9e5
[ruutu] Fix extraction ( Closes #8107 )
9 years ago
94de6cf59c
Remove testtube import
...
Extractor got deleted in remitamine/youtube-dl@8af2804
9 years ago
8af2804a5d
[testtube] Remove Extractor
9 years ago
054479754c
[revision3] Add new extractor( closes #6388 )
...
- revision3.com
- testtube.com
- animalist.com
9 years ago
5bafcf6525
[udemy] Use chapter_number
9 years ago
306c51c669
[videomore] Use number fields for series
9 years ago
27bfd4e526
[extractor/common] Introduce number fields for chapters and series
9 years ago
ca227c8698
[yahoo] Support pages that use an alias ( fixes #8084 )
9 years ago
32f9036447
[ccc] Add language information to formats
9 years ago
190ef07981
release 2016.01.01
9 years ago
82597f0ec0
[ccc] Extract duration
9 years ago
8499d21158
[ccc] Fix description extraction and update test
9 years ago
c9154514c4
[ccc] Fix upload date extraction
9 years ago
0d5095fc65
[ccc] Update _VALID_URL ( Closes #8097 )
9 years ago
034caf70b2
[youku] Fix extraction ( #8068 )
9 years ago
e565cf6048
[nextmovie] Add new extractor
9 years ago
a0e5beb0fb
[nick] Add new extractor
9 years ago
c1e90619bd
[mtv] extract mgid extraction and query building into separate methods
9 years ago
b26afec81f
[einthusan] Improve extraction ( Closes #7877 )
9 years ago
8f7c4f7d2e
Merge branch 'master' of github.com:rg3/youtube-dl
9 years ago
0416006a30
Fix einthusan parser
9 years ago
7f9134fb2d
[tvland] inherit from MTVServicesInfoExtractor
9 years ago
91e274546c
[tvland] Add new extractor
9 years ago
69f8595256
[espn] Extract better titles
9 years ago
930087f2f6
[espn] Support 'intl' videos ( #7858 )
9 years ago
9f9f7664b5
[espn] Update test
9 years ago
72528252e3
[pandoratv] Add IE names
9 years ago
e4bd63f9c0
[pandoratv] Improve extraction ( Closes #7921 )
9 years ago
9accfed4e7
[pandoratv] Add new extractor ( closes #6884 )
9 years ago
f1e21efe63
[tlc] remove TlcIE
9 years ago
b05641ce40
[discovery] improve _VALID_URL regex
9 years ago
fec040e754
[discovery] add support for discovery related sites
...
- investigationdiscovery.com
- discoverylife.com
- animalplanet.com
- ahctv.com
- destinationamerica.com
- sciencechannel.com
- tlc.com
- velocity.com
9 years ago
34a9da136f
[regiotv] Improve extraction ( Closes #7915 )
9 years ago
c43fda4c1a
[regiotv] Add new extractor ( closes #7797 )
9 years ago
7de81fcc53
release 2015.12.31
9 years ago
9d46608efa
[ora] Add new extractor( closes #7732 )
9 years ago
80b8b72cb8
[animalplanet] Add new extractor( closes #5303 )
9 years ago
9787c5f4c8
[fox] Add new extractor( closes #3063 )
9 years ago
d5f6429de8
[canalplus] improve extraction( fixes #6301 )
...
- extract data from json instead of xml
- fix http format urls
- extract more metadata
- update tests
- make m3u8 and f4m format extraction non fatal
- use m3u8_native implementation
9 years ago
df827a983a
[discovery] Allow https ( Closes #8065 )
9 years ago
29f3683901
[espn] Remove broken flag
9 years ago
c7932289e7
[cbsnews] Fix extraction of the URL for the 'RtmpDesktop' format ( fixes #8048 )
9 years ago
7a0b07c719
[videomore] Extract series info
9 years ago
4d402db521
[udemy] Extract chapter info
9 years ago
7109903e61
[extractor/common] Document chapter and series fields
9 years ago
3092fc4035
[udemy] Fix typo
9 years ago
f5bc4b5f95
[options] Prefer --convert-subs spelling
9 years ago
69759a5990
[videomore] Set IE_NAME
9 years ago
453fe2a345
[dramafever] Fix subtitles extraction ( Closes #8049 )
9 years ago
ff18735cb2
[extractor/generic] Add support for videomore embeds
9 years ago
030dfb04e0
[videomore] Add extractor ( Closes #8040 )
9 years ago
06e4874c99
Merge branch 'jukebox' of https://github.com/remitamine/youtube-dl into remitamine-jukebox
9 years ago
0d8a0fdc30
[srgssr] use SRFIE format ids
9 years ago
0368181998
[wdr] split long lines
9 years ago
6101f45ef9
[ooyala] split long lines, fix test duration and add hdcode param to hds url
9 years ago
bf96b45238
[rai] split long lines
9 years ago
98d7c0f4f7
[tele13] split long lines
9 years ago
f2017cb020
[srgssr] split long lines and use m3u8_native
9 years ago
f889ac45b8
[ign] split long lines
9 years ago
eccde5e9de
[audimedia] split long lines
9 years ago
ce7d243c7e
[srgssr] fix IE_DESC
9 years ago
6c4d6609ad
[phoenix] fix IE_NAME
9 years ago
db710571fd
[daum] fix IE_NAME
9 years ago
574dd17882
Merge branch 'remitamine-srgssr'
9 years ago
422f7c112c
[srgssr] update tests
9 years ago
e974356f32
release 2015.12.29
9 years ago
b19ad2fb53
Merge branch 'srgssr' of https://github.com/remitamine/youtube-dl into remitamine-srgssr
9 years ago
126d7701b0
Merge branch 'daum' of https://github.com/remitamine/youtube-dl into remitamine-daum
9 years ago
ecf17d1653
[franceculture] Add extractor for '/emission-*' urls ( closes #3777 , closes #8022 )
9 years ago
7447661e9b
[franceculture] Fix test
9 years ago
7e5edcfd33
Simplify formats accumulation for f4m/m3u8/smil formats
...
Now all _extract_*_formats routines return a list
9 years ago
39d60b715a
Merge pull request #7769 from remitamine/sort
...
[common] lower (m3u8,rtmp,rtsp) format preference only if required program is not available
9 years ago
d497a201ca
[common] use specific variable for protocol preference in _sort_formats
9 years ago
54537cdfb3
Merge pull request #8023 from remitamine/extract-formats
...
[common] simplify the use of _extract_m3u8_formats and _extract_f4m_formats
9 years ago
bc737bd61a
Merge branch 'zdf'( fixes #8024 )
9 years ago
a5c1d95500
[zdf] fix formats extraction
9 years ago
c1f49e1684
[facebook] Fix authentication
9 years ago
9f66931e16
[facebook] Extract login error
9 years ago
6c6b8bd5cc
[cspan] Fix extraction ( fixes #8032 )
9 years ago
04e24906be
[cspan] Initialize 'video_type' to avoid 'UnboundLocalError' exceptions ( #8032 )
9 years ago
974c1b2d42
Merge branch 'dcn' of github.com:remitamine/youtube-dl into remitamine-dcn
9 years ago
bca9bea1c1
[dcn] make m3u8 formats extraction non fatal
9 years ago
bd3f9ecabe
[tunein] add support for tunein topic,clip and program( fixes #7348 )
9 years ago
c047270c02
[utils] Remove Content-encoding from headers after decompression
...
With cn_verification_proxy, our http_response() is called twice, one from
PerRequestProxyHandler.proxy_open() and another from normal
YoutubeDL.urlopen(). As a result, for proxies honoring Accept-Encoding, the
following bug occurs:
$ youtube-dl -vs --cn-verification-proxy https://secure.uku.im:993 "test:letv"
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['-vs', '--cn-verification-proxy', 'https://secure.uku.im:993 ', 'test:letv']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2015.12.23
[debug] Git HEAD: 97f18fahttp://www.letv.com/ptv/vplay/22005890.html
[Letv] 22005890: Downloading webpage
[Letv] 22005890: Downloading playJson data
ERROR: Unable to download JSON metadata: Not a gzipped file (b'{"') (caused by OSError('Not a gzipped file (b\'{"\')',)); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see https://yt-dl.org/update on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
File "/home/yen/Executables/Multimedia/youtube-dl/youtube_dl/extractor/common.py", line 330, in _request_webpage
return self._downloader.urlopen(url_or_request)
File "/home/yen/Executables/Multimedia/youtube-dl/youtube_dl/YoutubeDL.py", line 1886, in urlopen
return self._opener.open(req, timeout=self._socket_timeout)
File "/usr/lib/python3.5/urllib/request.py", line 471, in open
response = meth(req, response)
File "/home/yen/Executables/Multimedia/youtube-dl/youtube_dl/utils.py", line 773, in http_response
raise original_ioerror
File "/home/yen/Executables/Multimedia/youtube-dl/youtube_dl/utils.py", line 761, in http_response
uncompressed = io.BytesIO(gz.read())
File "/usr/lib/python3.5/gzip.py", line 274, in read
return self._buffer.read(size)
File "/usr/lib/python3.5/gzip.py", line 461, in read
if not self._read_gzip_header():
File "/usr/lib/python3.5/gzip.py", line 409, in _read_gzip_header
raise OSError('Not a gzipped file (%r)' % magic)
9 years ago
97f18fac3a
[vgtv] fix f4m downloading( fixes #7843 )
9 years ago
c71d2e2087
[livestream] change test url
9 years ago
59185202c6
[iqiyi] Add tests for #7894
9 years ago
bee83e84f6
[iqiyi]fix valid url
...
eg:
http://yule.iqiyi.com/zbj.html
9 years ago
82e02ea5fc
Update iqiyi.py
...
Fix part of the address can not be resolved.
eg:http://www.iqiyi.com/w_19rt6o8t9p.html
9 years ago
a95c26a06a
[jwplatform] Carry long line
9 years ago
0b0a17ae9d
[viki] Fix typo
9 years ago
30f51acbc8
[rai] Fix typos
9 years ago
e0898585a1
[jwplatform] Fix typo
9 years ago
62bdc9fecc
[esri] Fix typo
9 years ago
e73277c7e8
[abc7news] Remove redundant formats sorting
9 years ago
8d29e47f54
[common] simplify the use of _extract_m3u8_formats and _extract_f4m_formats
9 years ago
2db772b9ea
Merge branch 'master' of github.com:rg3/youtube-dl
9 years ago
7b81316508
[livestream] skip m3u8 manifest in progressive_urls
9 years ago
05358deeca
Merge branch 'master' of github.com:rg3/youtube-dl
9 years ago
9f610f3a9e
[sportdeutschland] Do not abort if meta info is missing
...
This fixes http://sportdeutschland.tv/badminton/yonex-copenhagen-masters-2015 . No testcase though since the event will be over by 2016.
9 years ago
dbfd06730c
Merge pull request #7892 from remitamine/livestream
...
[livestream] improve extraction(fixes #2133 )(fixes #2838 )(fixes #4152 )(fixes #6988 )
9 years ago
5b025168c7
[livestream] improve extraction
...
- split long lines
- use m3u8 entry protocol for live streams
- extend _VALID_URL regex for livestream original
- extract livestream original live streams
9 years ago
46124a49b2
Merge pull request #7851 from remitamine/kaltura
...
[kaltura] extract more formats
9 years ago
608cc3b85c
[kaltura] add referrer to m3u8 url
9 years ago
6afe044b51
[dcn] improve extraction
9 years ago
15aad84dc5
[lrt] Extract counters
9 years ago
f7e1d82d40
[lrt] Improve
9 years ago
339b1944e7
[lrt] fix the rest of extractor
...
Closes #7690 .
9 years ago
85367c3a47
[lrt] fix duration parsing
9 years ago
607d65fbce
[ign] flake8
9 years ago
9f0ee2a388
Merge pull request #7045 from remitamine/ign
...
[ign] add support for pcmag and extract all formats and more metadata(fixes #5335 )(fixes #7006 )
9 years ago
1fc0b47fdf
[srmediathek] improve extraction
9 years ago
6418b2439b
[rutv] Fix extraction ( Closes #8004 )
9 years ago
06d5556dfa
[rai] improve extraction
9 years ago
fb8e402ad2
[hotstar] Add new extractor
9 years ago
c24044635b
[zdf:channel] Add more tests
9 years ago
Jaime Marquínez Ferrándiz
remitamine
Yen Chi Hsuan
Sergey M․
Jakub Wilk
Vignesh Venkat
Philipp Hagemeister
atomic83
oittaa
kaspi
bpfoley
pingtux
dyn888
j
flatgreen
forDream
gam2046
Giedrius Statkevičius