Commit Graph

10472 Commits (72f3289ac48d8dbfe1ee3fd2d82a23f1bff045df)

Author SHA1 Message Date
Sergey M․ 594b0c4c69
[openload] Fix ext extraction 8 years ago
Sergey M․ eb9ee19422
[utils] Allow None mimetypes in mimetype2ext 8 years ago
Sergey M․ a1394b820d
[openload] Fix title extraction (Closes #9298) 8 years ago
Yen Chi Hsuan aa9dc24f5a
[douyutv] Improve extraction and update tests
The JSON API sometimes return HTML pages with errors
8 years ago
Yen Chi Hsuan 51762e1a31
[xminus] Fix extraction (closes #9228) 8 years ago
Philipp Hagemeister 8b38f2ac40 release 2016.04.24 8 years ago
Yen Chi Hsuan a82398bd72
[kwuo:song] Fix extraction and update the test 8 years ago
remitamine c14dc00df3 [viewster] improve http formats extraction 8 years ago
Yen Chi Hsuan 03dd60ca41
[kuwo:category] Fix the test
Sometimes there are 24 songs and sometimes 30 lol
8 years ago
Yen Chi Hsuan 0738187f9b
[ThePlatform] Fix tests failed since 79ba9140dc 8 years ago
Yen Chi Hsuan a956cb6306
[onionstudios] Fix description extraction
\1 does not work in []. Fixes test_Generic_75
(http://www.clickhole.com/video/dont-understand-bitcoin-man-will-mumble-explanatio-2537)
8 years ago
Yen Chi Hsuan a8062eabcd
[mwave] Skip checking unstable MD5
On my PC the checksum is 02eda6d09fb63131a17a8d44e6237463, while a
recent Travis CI build
(https://travis-ci.org/rg3/youtube-dl/jobs/125341081) shows it's
c930e27b7720aaa3c9d0018dfc8ff6cc
8 years ago
Yen Chi Hsuan 2a7dee8cc5
[yahoo] Improve error detection and update tests 8 years ago
Yen Chi Hsuan d9ed362116
[yahoo] Extract all <iframe>s
Fixes test_yahoo_6

(https://ca.finance.yahoo.com/news/hackers-sony-more-trouble-well-154609075.html)
8 years ago
Yen Chi Hsuan 4f54958097
[yahoo] Update some tests
One has new fields as ThePlatformIE changed, and others have changed
files.
8 years ago
Yen Chi Hsuan 2a7c38831c
[yahoo] Extend _VALID_URL and fix extraction
Closes #9271
8 years ago
Yen Chi Hsuan 949b6497cc
[generic] Unescape the video URL
Fixes #9279
8 years ago
remitamine fda9a1ca9e [viewster] simplify qualities_basename regex 8 years ago
remitamine 864d5e7231 [viewster] extract all http formats 8 years ago
Sergey M․ 5448b781f6
[dplay] Sign unsigned final download hls URLs 8 years ago
Sergey M․ e239413fbc
[dplay] Extract subtitles (Closes #9284) 8 years ago
Sergey M․ fd0ff8bad8
[dplay] Improve extraction and document workarounds and tests 8 years ago
Sergey M․ 397ec446f3
[dplay] Try secure api for no tld (Closes #9282) 8 years ago
remitamine 29a7e8f6f8 [nhl] Add new extractor(closes #8419)(closes #8798) 8 years ago
Yen Chi Hsuan eb01e97e10
[youku] Skip streams with channel_type=tail
Fixes #9275

These video segments look like ads and they don't appear in the web
player.
8 years ago
remitamine cb7d4d0efd [nbc] add support for today.com(closes #2909) 8 years ago
Yen Chi Hsuan c80037918b
[iqiyi] Improve error detection (#9276) 8 years ago
remitamine 237a41108a [eagleplatform] extract all http formats 8 years ago
remitamine e962ae15d3 [newstube] extract http formats(closes #9253) 8 years ago
remitamine 7c36ea7d54 [rtbf] improve extraction(fixes #9267) 8 years ago
remitamine 9260cf1d97 [tubitv] fix extraction(closes #8741) 8 years ago
Sergey M․ bdbb8530c7
[vimeo] Pass Referer for check-password request 8 years ago
Sergey M․ 09a9fadb84
[dump] Remove extractor 8 years ago
Sergey M․ bf09af3acb
Add --hls-prefer-ffmpeg 8 years ago
Sergey M․ 88296ac326
[planetaplay] Remove remainings of extractor 8 years ago
Sergey M․ 870d525848
[options] Remove experimental mark for --hls-prefer-native 8 years ago
Sergey M․ 6577112890
[planetaplay] Remove extractor (Closes #9256) 8 years ago
Sergey M․ 1988647dda
[tvigle] Skip hls completely (#9259) 8 years ago
Yen Chi Hsuan a292cba256
[mgtv] Fix _VALID_URL and add localized name 8 years ago
Yen Chi Hsuan 982e518a96
[dispeak] Rename DigitalSpeaking to DigitallySpeaking 8 years ago
Yen Chi Hsuan 748e730099
[dispeak] Several fixes 8 years ago
Sergey M b6c0d4f431 Merge pull request #9110 from remitamine/parse_duration
[utils] imporove parse_duration to handle more formats
8 years ago
remitamine acaff49575 [utils] imporove parse_duration to handle more formats 8 years ago
Yen Chi Hsuan 1da19488f9
[mgtv] Add new extractor (closes #9212) 8 years ago
Yen Chi Hsuan 442c4d361f
[dispeak/gdcvault] Add the test case from #5784 8 years ago
Yen Chi Hsuan ec59d657e7
[dispeak] Add new extractor
Both GDCVault and GPUTechConf uses the service of DigitalSpeaking.
8 years ago
Yen Chi Hsuan 99ef96f84c
[gdcvault] Fix for videos with hard-coded hostnames
Fixes #9248
8 years ago
Yen Chi Hsuan 4dccea8ad0
[streetvoice] Fix extraction
The old API results in URLs with HTTP 403 from time to time.

Hopefully fixes #9219.
8 years ago
Yen Chi Hsuan 2c0d9c6217
[extractor/common] Allow empty post data 8 years ago
Sergey M․ 12a5134596
[tvigle] Fix extraction (Closes #9259) 8 years ago
Sergey M․ 16e633a5d7
[quickvid] Remove extractor (Closes #9258) 8 years ago
Sergey M․ 494ab6db73
[youtube] Capture and output login error message 8 years ago
Sergey M․ 107701fcfc
[people] Remove bogus comment 8 years ago
Sergey M․ f77970765a
[people] Add extractor 8 years ago
Philipp Hagemeister 81215d5652 release 2016.04.19 8 years ago
Sergey M․ 241a318f27
[vimeo] Improve _VALID_URL (Closes #9229) 8 years ago
Sergey M․ 4fdf082375
[theonion] Remove extractor (Closes #9220)
It now uses generic onionstudios embed
8 years ago
Jaime Marquínez Ferrándiz 1b6182d8f7 [youtube:playlist] Fetch all the videos in a mix (fixes #3837)
Since there doesn't seem to be any indication, it stops when there aren't new videos in the webpage.
8 years ago
remitamine 7bab22a402 [vice] remove unused import and variable 8 years ago
Yen Chi Hsuan 0f97fb4d00
[musicplayon] Relax _VALID_URL and improve metadata extraction
In r'pl=\d+&play=\d+' pages, several metadata items are missing

Closes #9222.
8 years ago
Yen Chi Hsuan b1cf58f48f
[musicplayon] Fix extraction (closes #9222) 8 years ago
remitamine 3014b0ae83 Merge pull request #9195 from remitamine/ffmpeg-pipe
[downloader/external] enable piping for FFmpegFD(closes #2124)
8 years ago
remitamine b9f2fdd37f [ffmpeg] Clarify rationale for pipe(-) exclusion in _ffmpeg_filename_argument 8 years ago
remitamine bbb3f730bb [onionstudios] extract m3u8 formats 8 years ago
remitamine d868f43c58 [ffmpeg] check for - file name in _ffmpeg_filename_argument 8 years ago
Yen Chi Hsuan 21525bb8ca
[kuwo:category] Update the test
Now the webpage says there are 24 songs.
8 years ago
Sergey M․ d8f103159f
[nerdist] Remove extractor
It now uses brightcove
8 years ago
remitamine 663ee5f0a9 [vice] extract youtube embed 8 years ago
Sergey M․ b6b950bf58
[cbs] Remove unused import 8 years ago
Sergey M․ 11e60fcad8
[extractor/generic] Improve instagram embeds (Closes #9213) 8 years ago
Sergey M․ c23533a100
[instagram] Add support for iframe embeds 8 years ago
Sergey M․ 0dafea02e6
[instagram] Add support for embed URLs 8 years ago
Sergey M․ 5d6360c3b7
[mooshare] Remove extractor 8 years ago
Yen Chi Hsuan 5e5c30c3fd
[mdr] Fix extraction and update tests
It's strange that the date is changed. Anyway, new data matches what the
webpage says.
8 years ago
Yen Chi Hsuan 9154c87fc4
[huffpost] Fix a typo 8 years ago
Yen Chi Hsuan ef0e4e7bc0
[generic] Fix test_Generic_2
Now a HEAD request returns 400 Bad Request
8 years ago
Yen Chi Hsuan 67d46a3f90
[ustream] Fix /embed/ URLs and add a test 8 years ago
Yen Chi Hsuan bec47a0748
[tudou] Improve error detection (closes #9175) 8 years ago
Yen Chi Hsuan 36b7d9dbfa
[twitter] Don't check /cards/ URLs
Fixes #9181

In this tweet, there are two cards:
1. https://twitter.com/i/cards/tfw/v1/719944006306701313
   This shows #TeamCap vs. #TeamIronMan
2. https://twitter.com/i/videos/tweet/719944021058060289
   This is the real video and can be handled by TwitterCardIE

In all current test_Twitter* tests, /videos/tweet/ approach works fine.
8 years ago
Yen Chi Hsuan 8c65e4a527
[bbc] Fix a test 8 years ago
Yen Chi Hsuan 6ad2ef8b7c
[audiomack] Update the test
The original test raises 404
8 years ago
Yen Chi Hsuan 00b426d66d
[varzesh3] Add md5 to the test 8 years ago
Yen Chi Hsuan 0de968b584
[newgrounds] Support videos (closes #9138) 8 years ago
remitamine 0841d5013c [cbs] do not catch Exceptions raised by by _extract_theplatform_smil 8 years ago
remitamine a71fca8577 [theplatform] remove _sort_formats from _extract_theplatform_smil 8 years ago
Yen Chi Hsuan ee94e7e66d
[varzesh3] Fix metadata extraction (closes #9197) 8 years ago
Yen Chi Hsuan 759e37c9e6
[gazeta] Relax _VALID_URL and update tests
Closes #9196
8 years ago
Yen Chi Hsuan ae65567102
[eagleplatform] Fix error handling 8 years ago
Yen Chi Hsuan c394b4f4cb
[puls4] Fix error detection (#9194) 8 years ago
Yen Chi Hsuan 260c7036ba
[sportbox] Fix SportBoxEmbedIE
Also fixes test_Generic_29 (http://www.vestifinance.ru/articles/25753)
8 years ago
remitamine f74197a074 [cbs] extract rtmp formats 8 years ago
remitamine f3a58d46bf [youtube:user] check if the url didn't match only the other youtube extractors 8 years ago
Sergey M․ b6612c9b11
[karaoketv] Fix extraction 8 years ago
Yen Chi Hsuan 7e176effb2
[iqiyi] Also suuport pps.tv URLs
PPS is acquired by Baidu and merged with iQiyi in 2013 [1]. Now they
have the same page layouts.

[1] http://www.chinanews.com/it/2013/05-07/4792526.shtml
8 years ago
Yen Chi Hsuan 4a252cc2d2
[karaoketv] Update and mark as not _WORKING 8 years ago
Yen Chi Hsuan f0ec61b525
[huffpost] Fix extraction 8 years ago
Yen Chi Hsuan 66d40ae3a5 Merge pull request #9041 from kasper93/master
[generic] Add support for LiveLeak embeds
8 years ago
Yen Chi Hsuan e6da9240d4
[mixcloud:stream] Add new extractor
Closes #7633
8 years ago
Yen Chi Hsuan dd91dfcd67
[mixcloud] Fix extraction by decrypting play info
Fixes #7521
8 years ago
Yen Chi Hsuan c773082692
Merge branch 'Phaeilo-mixcloud' 8 years ago
Yen Chi Hsuan 9c250931f5
[mixcloud] Improve and simplify mixcloud:user and mixcloud:playlist 8 years ago
Yen Chi Hsuan 56f1750049
[tdslifeway] Use the new Brightcove API
Thanks for @remitamine's suggestion.
8 years ago
Yen Chi Hsuan f2159c9815
[wayofthemaster] Remove extractor
Now it's using YouTube embeds.
8 years ago
Yen Chi Hsuan b0cf2e7c1b
[ubu] Remove extractor
1. Videos on ubu.com are now hosted on Vimeo
2. The duration is far from correct, and may not exist on other videos
   (For example http://ubu.com/film/hammons_king.html)
8 years ago
Yen Chi Hsuan 74b47d00c3
[xboxclips] Use http:// URL
xboxclips has misconfigured certificates
8 years ago
Yen Chi Hsuan 8cb57bab8e
[ministrygrid] Fix extraction and modernize 8 years ago
Yen Chi Hsuan e1bf277e19
[tdslifeway] Add TDSLifewayIE
Used by MinistryGridIE
8 years ago
remitamine ce599d5a7e [downloader/external] enable piping for FFmpegFD(closes #2124) 8 years ago
Sergey M․ 9e28538726
[arte:creative] Improve _VALID_URL 8 years ago
Sergey M․ 404284132c
[arte:info] Add extractor (Closes #9182) 8 years ago
remitamine 5565be9dd9 [aol] relex _VALID_URL regex 8 years ago
Yen Chi Hsuan b3a9474ad1 Merge branch 'mixcloud' of https://github.com/Phaeilo/youtube-dl into Phaeilo-mixcloud 8 years ago
Yen Chi Hsuan 86475d59b1
[metacritic] Add a new valid test case 8 years ago
Yen Chi Hsuan 73d93f948e
[lecture2go] Fix extraction
RTSP stream fails to download. Seems it's a mpv bug as direct playback
works well:

$ mpv --ytdl-format rtsp https://lecture2go.uni-hamburg.de/veranstaltungen/-/v/17473
8 years ago
Yen Chi Hsuan f5d8743e0a
[downloader/rtsp] Print the command 8 years ago
Yen Chi Hsuan d1c4e4ba15
[laola1tv] Improve error detection and skip an invalid test 8 years ago
Yen Chi Hsuan f141fefab7
[karrierevideos] Fix extraction
The server serves malformed header "Content Type: text/xml" for the XML
request (it should be Content-Type but not Content Type). Python 3.x,
which uses email.feedparser rejects such headers. As a result,
Content-Encoding header is not parsed, so the returned content is kept
not decompressed, and thus XML parsing error.
8 years ago
aystroganov@gmail.com 8334637f4a Make tbr field 'int' rather than 'tuple'
Closes #9180.
8 years ago
Philipp Hagemeister b0ba11cc64 release 2016.04.13 8 years ago
Kacper Michajłow b8f67449ec [generic] Add support for LiveLeak embeds 8 years ago
Yen Chi Hsuan 75af5d59ae
[netease] Skip all tests: completely georestricted 8 years ago
Philip Huppert 6d67169509 [mixcloud] improved extraction of user description 8 years ago
Philip Huppert dcaf00fb3e [mixcloud] support older urllib versions 8 years ago
Philip Huppert f896e1ccef [mixcloud] fixed some tests 8 years ago
Philip Huppert c96eca426b [mixcloud] Added support for user uploads, playlists, favorites and listens.
Fixes #3750 and #5272
8 years ago
Sergey M․ 466a614537
[youtube:playlist] Recognize popular uploads playlist as mix (Closes #9170) 8 years ago
Sergey M․ ffa2cecf72
[ard] Change subtitles extension to ttml (Closes #9169)
ttml is now served instead of srt
8 years ago
Yen Chi Hsuan a837416025
[jadorecettepub] Remove extractor: website gone 8 years ago
Yen Chi Hsuan c9d448876f
[izlesene] Fix extraction
description may be absent
8 years ago
Yen Chi Hsuan 8865b8abfd
[howstuffworks] Skip a broken test case 8 years ago
Yen Chi Hsuan c77a0c01cb
[groupon] Fix extraction 8 years ago
Yen Chi Hsuan 12355ac473
[goshgay] Fix extraction
isFamilyFriendly no longer exists in the webpage and I can't find
another indicator.
8 years ago
Sergey M․ 49f523ca50
[mixcloud] Capture error message (#9156) 8 years ago
remitamine 4a903b93a9 Revert "[openclassroom] Add new extractor(closes #9147)"
This reverts commit 13267a2be3.
8 years ago
remitamine 13267a2be3 [openclassroom] Add new extractor(closes #9147) 8 years ago
Yen Chi Hsuan 134c207e3f
[arte.tv:embed] Extended support (#2620) 8 years ago
Yen Chi Hsuan 0f56bd2178
Merge branch 'Phaeilo-presstv' 8 years ago
Yen Chi Hsuan dfbc7f7f3f
[presstv] Improve and simplify 8 years ago
Yen Chi Hsuan 7d58ea7c5b Merge branch 'presstv' of https://github.com/Phaeilo/youtube-dl into Phaeilo-presstv 8 years ago
Sergey M․ 452908b257
[telebruxelles] Fix extraction (Closes #9142) 8 years ago
Sergey M․ 5899e988d5
[glide] Improve extraction and extract upload info 8 years ago
Sergey M․ 4a121d29bb
[glide] Fix extraction (Closes #9141) 8 years ago
Sergey M․ 7ebc36900d
[jwplatform:base] Improve subtitles extraction 8 years ago
Sergey M․ d7eb052fa2
[screencastomatic] Add duration to test 8 years ago
Sergey M․ a6d6722c8f
[jwplatform:base] Extract duration 8 years ago
Sergey M․ 66fa495868
[screencastomatic] Fix extraction (Closes #9136) 8 years ago
Sergey M․ 443285aabe
[ebaumsworlds] Update _VALID_URL (Closes #9135) 8 years ago
Philip Huppert de728757ad [presstv] Refactored extractor. 8 years ago
Sergey M․ f44c276842
[extractor/extractors] Remove non-existant imports 8 years ago
Sergey M․ a1fa60a934
[cliprs] Add extractor (Closes #9099) 8 years ago
Sergey M․ 49caf3307f
[extractor/common] Remove irrelevant comment 8 years ago
Sergey M․ 61dd350a04
[1tv] Fix extraction (Closes #9103) 8 years ago
Philip Huppert 95153a960d [presstv] updated extractor and tests to work with current PressTV website 8 years ago
Yen Chi Hsuan c991106706 [videodetective] Adapt to InternetVideoArchiveIE 8 years ago
Yen Chi Hsuan dae2a058de [rottentomatoes] Adapt to InternetVideoArchiveIE 8 years ago
Yen Chi Hsuan c05025fdd7 [internetvideoarchive] Fix extraction and support json URLs 8 years ago
Philip Huppert bfe96d7bea [presstv] Added extractor PressTV.
Fixes #7060
8 years ago
Yen Chi Hsuan ab481b48e5 [funnyordie] Relax M3U8 URL matching
Also, m3u8_url extraction should be fatal as all formats depends
directly or indirectly on it.

This change fixes test_Generic_26 and TestFunnyOrDieSubtitles
8 years ago
Sergey M․ 92c7f3157a [aol] Add coding cookie 8 years ago
Yen Chi Hsuan cacd996662 [utils] Don't touch URLs if not necessary
Fix test_Generic_15 (Google redirect)
8 years ago
remitamine bffb245a48 [aol] add support for videos with vidible IDs(closes #9124) 8 years ago
Jaime Marquínez Ferrándiz e0986e31cf lazy extractors: Output if it's enabled in the verbose log 8 years ago
Jaime Marquínez Ferrándiz 779822d945 Add experimental support for lazy loading the info extractors
'make lazy-extractors' creates the youtube_dl/extractor/lazy_extractors.py (imported by youtube_dl/extractor/__init__.py), which contains simplified classes that only have the 'suitable' class method and that load the appropiate class with the '__new__' method when a instance is created.
8 years ago
Jaime Marquínez Ferrándiz 1b3d5e05a8 Move the extreactors import to youtube_dl/extractor/extractors.py 8 years ago
Jaime Marquínez Ferrándiz e52d7f85f2 Delay initialization of InfoExtractors until they are needed 8 years ago
Sergey M․ 568d2f78d6 [tnaflix] Fix metadata extraction 8 years ago
Sergey M․ 2f2fcf1a33 [tnaflix] Fix extraction (Closes #9074) 8 years ago
Sergey M․ bacec0397f [extractor/common] Relax _hidden_inputs 8 years ago
Sergey M․ 3c6c7e7d7e [gdcvault] Fix extraction (Closes #9107, closes #9114) 8 years ago
Sergey M․ fb38aa8b53 [extractor/common] Support arbitrary format strings for template based identifiers in mpd manifests (Closes #9119, closes #9120) 8 years ago
Sergey M․ 18da24634c [democracynow] Improve extraction 8 years ago
Sergey M․ a134426d61 [democracynow] Fix tests 8 years ago
Sergey M․ a64c0c9b06 [democracynow] Make description optional (Closes #9115) 8 years ago
Sergey M․ 56019444cb [novamov] Improve _VALID_URL template (Closes #9116) 8 years ago
remitamine a1ff3cd5f9 [acast] fix channel extraction(closes #9117) 8 years ago
remitamine 9a32e80477 [acast] fix extraction(#9117) 8 years ago
Sergey M․ 536a55dabd [YoutubeDL] Sanitize single thumbnail URL 8 years ago
Sergey M․ ed6fb8b804 [vrt] Add support for direct hls playlists and YouTube (Closes #9108) 8 years ago
Sergey M․ 3afef2e3fc [beeg] Improve extraction 8 years ago
Sergey M․ e90d175436 [yandexmusic] Extract music album metafields (Closes #7354) 8 years ago
Sergey M․ 7a93ab5f3f [extractor/common] Introduce music album metafields 8 years ago
Philipp Hagemeister c41cf65d4a release 2016.04.06 8 years ago
Yen Chi Hsuan 92d5477d84 [compat] Handle tuples properly in urlencode()
Fixes #9055
8 years ago
Yen Chi Hsuan 8790249c68 [iqiyi] Improve error detection for VIP-only videos
Closes #9071
8 years ago
Philipp Hagemeister 416930d450 release 2016.04.05 8 years ago
Sergey M․ 65150b41bb [deezer] Fix extraction (Closes #9086) 8 years ago
Sergey M․ e42f413716 [rte] Improve thumbnail extraction (Closes #9085) 8 years ago
Sergey M․ 40a056d85d [extractor/__init__] Remove novamov extractor and sort novamov based extractors alphabetically 8 years ago
Sergey M․ e7d77efb9d [auroravid] Add extractor (Closes #9070) 8 years ago
Sergey M․ 995cf05c96 [novamov] Make title fatal 8 years ago
Jaime Marquínez Ferrándiz 5bf28d7864 [utils] dfxp2srt: add additional namespace
Used by the ZDF subtitles (#9081).
8 years ago
Jaime Marquínez Ferrándiz 8c7d6e8e22 [zdf] Extract subtitles (closes #9081) 8 years ago
Sergey M․ 6d4fc66bfc [youtube] Add support for zwearz (Closes #9062) 8 years ago
remitamine 23576edbfc [brightcove:legacy] skip None value for uploader_id 8 years ago
remitamine 4d4cd35f48 [brightcove:legacy] extract uploader_id as a string 8 years ago
remitamine 3aac9b2fb1 [nowness] update tests 8 years ago
remitamine e47d19e991 [brightcove:new] extract subtitles and strip video title 8 years ago
remitamine 41f5492fbc [brightcove:legacy] improve format extraction and extract uploader_id, duration and timestamp 8 years ago
Jaime Marquínez Ferrándiz 2defa7d75a [instagram:user] Fix extraction (fixes #9059)
The URL for the next page was incorrect and we always got the same page, therefore it got trapped in an infinite loop.
8 years ago
Sergey M․ bbc26c8a01 [bbc] Set vcodec to none for audio formats 8 years ago