Commit Graph

10199 Commits (b0ba11cc64656c09f349117fffa9739dcbb2541e)

Author SHA1 Message Date
remitamine d8873d4def [aenetworks] improve format extraction 8 years ago
remitamine db1c969da5 [theplatform] sign https urls 8 years ago
Philipp Hagemeister 1e02bc7ba2 release 2016.04.01 8 years ago
remitamine 63c55e9f22 [cbs] improve extraction(closes #6321) 8 years ago
remitamine f9b1529af8 [generic] remove sbnation test(handled by VoxMediaIE) 8 years ago
remitamine 961fc024d2 [voxmedia] improve sbnation support 8 years ago
Sergey M․ b53a06e3b9 [udemy:course] Use new URL format 8 years ago
remitamine 4ecc1fc638 [howstuffworks] improve extraction 8 years ago
Yen Chi Hsuan 5b012dfce8 [tudou] Improve error handling (closes #8988) 8 years ago
remitamine 8369942773 [voxmedia] Add new extractor(closes #3182) 8 years ago
Sergey M․ 86f3b66cec [udemy] Remove unused import 8 years ago
Sergey M․ 6bb4600717 [udemy:course] Simplify course curriculum downloading 8 years ago
Sergey M․ 41d06b0424 [extractor/common] Improve _request_webpage
* Do not ignore data, headers and query for Requests
* Default values for headers and query switched to dicts since these are used by urllib itself
8 years ago
Sergey M․ 15d260ebaa [utils] Use update_Request in http_request 8 years ago
Sergey M․ ed0291d153 [utils] Add update_Request 8 years ago
Sergey M․ 81da8cbc45 [udemy] Switch to api 2.0 (Closes #9035) 8 years ago
Sergey M․ 5299bc3f91 [beeg] Switch to api v6 (Closes #9036) 8 years ago
remitamine c9c39c22c5 [nationalgeographic] add support for channel.nationalgeographic.com urls 8 years ago
remitamine d84b48e3f1 [nationalgeographic] improve extraction 8 years ago
remitamine dd17041c82 [tenplay] remove extractor(fixes #6927) 8 years ago
remitamine fea7295b14 [brightcove] relax embed_in_page regex 8 years ago
remitamine 9cf01f7f30 [nbc] add new extractor for csnne.com(#5432) 8 years ago
remitamine ce548296fe [cnbc] fix test 8 years ago
remitamine c02ec7d430 [cnbc] Add new extractor(closes #8012) 8 years ago
remitamine 6b820a2376 [myspace] improve extraction 8 years ago
Yen Chi Hsuan e621a344e6 [kwuo] Port to new API and enable --cn-verification-proxy 8 years ago
Yen Chi Hsuan 3ae6f8fec1 [kwuo] Remove _sort_formats() from KuwoBaseIE._get_formats()
Following the idea proposed in 19dbaeece3
8 years ago
Yen Chi Hsuan 597d52fadb [kuwo:song] Correct song ID extraction (fixes #9033)
Bug introduced in daef04a4e7.
8 years ago
Sergey M․ afca767d19 [tumblr] Improve _VALID_URL (Closes #9027) 8 years ago
remitamine 6e359a1534 [comcarcoff] don not depend on crackle extractor(closes #8995)
previously extraction has been delegated to crackle to extract more info
and subtitles #6106 but some of the episodes can't be extracted using
crackle #8995.
8 years ago
Sergey M․ 33f3040a3e [YoutubeDL] Fix sanitizing subtitles' url 8 years ago
Sergey M․ 03442072c0 [pornhub] Fix typo (Closes #9008) 8 years ago
Sergey M․ c8b13fec02 [foxnews] Restore upload time fields in test 8 years ago
Sergey M․ 87d105ac6c [amp] Fix upload timestamp extraction (Closes #9007) 8 years ago
Sergey M․ 3454139576 [pornhub:uservideos] Add support for multipage videos (Closes #9006) 8 years ago
Sergey M․ 3a23bae9cc [pornhub:playlistbase] Do not include videos not from playlist 8 years ago
Sergey M․ 8f9a477e7f [pornhub:playlistbase] Use orderedSet 8 years ago
Sergey M․ a1cf3e38a3 [bbc] Extend vpid regex (Closes #9003) 8 years ago
Philipp Hagemeister a122e7080b release 2016.03.27 8 years ago
Sergey M․ b22ca76204 [extractor/common] Filter out unsupported encrypted media for f4m formats (Closes #8573) 8 years ago
Sergey M․ f7df343b4a [downloader/f4m] Extract routine for removing unsupported encrypted media 8 years ago
Sergey M․ 19dbaeece3 Remove _sort_formats from _extract_*_formats methods
Now _sort_formats should be called explicitly.
_sort_formats has been added to all the necessary places in code.

Closes #8051
8 years ago
Yen Chi Hsuan 395fd4b08a [twitter] Handle another form of embedded Vine
Fixes #8996
8 years ago
Sergey M․ 8018028d0f [pluralsight] Extract chapter metadata (Closes #8993) 8 years ago
Sergey M․ 00322ad4fd [lynda] Extract chapter metadata (#8993) 8 years ago
Sergey M․ 4cf3489c6e [vevo] Update videoservice API URL (Closes #8900) 8 years ago
Sergey M․ b24ab3e341 [udemy] Improve paid course detection 8 years ago
Sergey M․ af4116f4f0 [udemy] Improve format_id 8 years ago
Sergey M․ f973e5d54e [udemy] Drop outputs' formats
Always results in 403
8 years ago
Sergey M․ 62f55aa68a [udemy] Add outputs metadata to view_html formats 8 years ago
Sergey M․ 02d7634d24 [udemy] Fix outputs' formats format_id 8 years ago
Sergey M․ 48dce58ca9 [udemy] Use custom sorting 8 years ago
Sergey M․ efcba804f6 [udemy] Extract formats from view_html (Closes #8979) 8 years ago
Sergey M․ 6dee688e6d [youtube:playlistsbase] Restrict playlist regex (Closes #8986) 8 years ago
Sergey M․ eedb7ba536 [YoutubeDL] Sort imports 8 years ago
Sergey M․ dcf77cf1a7 [YoutubeDL] Sanitize final URLs (Closes #8991) 8 years ago
Sergey M․ 17bcc626bf [utils] Extract sanitize_url routine 8 years ago
Sergey M․ b5a5bbf376 [mailru] Extend _VALID_URL (Closes #8990) 8 years ago
Yen Chi Hsuan e68d3a010f [twitter] Fix extraction (closes #8966)
HLS and DASH formats are no longer appeared in test cases. I keep them
for fear of triggering new errors.
8 years ago
Yen Chi Hsuan d10fe8358c [generic] Add a test case for brightcove embed
Closes #8862
8 years ago
Yen Chi Hsuan d6c340cae5 [brightcove] Extract more formats (#8862) 8 years ago
Yen Chi Hsuan 5964b598ff [brightcove] Support alternative BrightcoveExperience layout
The full URL lays in the `data` attribute of <object> (#8862)
8 years ago
Philipp Hagemeister 62cdb96f51 release 2016.03.26 8 years ago
Sergey M․ 6e6bc8dae5 Use urlencode_postdata across the codebase 8 years ago
Sergey M․ 15707c7e02 [compat] Add compat_urllib_parse_urlencode and eliminate encode_dict
encode_dict functionality has been improved and moved directly into compat_urllib_parse_urlencode
All occurrences of compat_urllib_parse.urlencode throughout the codebase have been replaced by compat_urllib_parse_urlencode

Closes #8974
8 years ago
Sergey M․ 2156f16ca7 [thescene] Fix extraction and improve style (Closes #8978) 8 years ago
Sergey M․ 4db441de72 [once] Relax _VALID_URL (Closes #8976) 8 years ago
Philipp Hagemeister 0be8314dc8 release 2016.03.25 8 years ago
Yen Chi Hsuan d7f62b049a [iqiyi] Update enc_key 8 years ago
Yen Chi Hsuan 3bb3356812 [douyutv] Extend _VALID_URL 8 years ago
Sergey M․ 98e68806fb [mnet] Improve (Closes #8958) 8 years ago
Kagami Hiiragi e031768666 [mnet] Add new extractor 8 years ago
Sergey M․ 5eb7db4ee9 [udemy] Add support for new URL schema 8 years ago
Sergey M․ f0e83681d9 [udemy] Extract formats from outputs 8 years ago
Sergey M․ ff9d5d0938 [udemy] Improve course enrolling 8 years ago
Sergey M․ d041a73674 [extractor/__init__] Add youtube:live and sort youtube extractors alphabetically 8 years ago
Sergey M․ f07e276a04 [youtube:live] Add extractor (Closes #8959) 8 years ago
Sergey M․ 993271da0a [nytimes] Tolerate missing metadata (Closes #8952) 8 years ago
Sergey M․ 369e7e3ff0 [iprima] Fix extraction (Closes #8953) 8 years ago
Sergey M․ 5767b4eeae [mtv] Fix description extraction (Closes #8962) 8 years ago
Yen Chi Hsuan 622d19160b [utils] Clarify Python versions affected by buggy struct module 8 years ago
Yen Chi Hsuan 32d88410eb [tumblr] Add a test with Instagram embed
Closes #8817
8 years ago
Yen Chi Hsuan 5a51775a58 [generic] Extract Instagram embeds (#8817) 8 years ago
Yen Chi Hsuan 87696e78d7 [instagram] Unescape description (#8817) 8 years ago
Yen Chi Hsuan c4096e8aea [instagram] Extract embed videos (#8817) 8 years ago
Yen Chi Hsuan fc27ea9464 [tumblr] Support Vine embeds (#8817) 8 years ago
Yen Chi Hsuan 088e1aac59 [generic] Support Vine embeds (#8817) 8 years ago
Sergey M 4333d56494 Merge pull request #8898 from dstftw/fragment-retries
Add --fragment-retries option (Fixes #8466)
8 years ago
Sergey M․ 882c699296 [tunein] Fix stream data extraction (Closes #8899, closes #8924) 8 years ago
Yen Chi Hsuan efbed08dc2 [utils] Encode hostnames before passing to urllib
With IDN (Internationalized Domain Name) and a proxy, non-ascii URLs
are passed down to urllib/urllib2, causing UnicodeEncodeError

Fixes #8890
8 years ago
Jaime Marquínez Ferrándiz 7da2c87119 Add extractor for thescene.com (closes #8929) 8 years ago
Sergey M․ c6ca11f1b3 [once] Prevent ads from embedding into m3u8 playlists (Closes #8893) 8 years ago
Sergey M․ 2beeb286e1 [laola1tv] Add support for livestreams (Closes #8934) 8 years ago
Sergey M․ cc7397b04d [ceskatelevize] Make m3u8 formats extraction non fatal (Closes #8933) 8 years ago
Sergey M․ bc5d16b302 [animeondemand] Skip dash for now 8 years ago
Sergey M․ 85c637b737 [animeondemand] Extract teaser when no full episode available (#8923) 8 years ago
Sergey M․ 5c69f7a479 [animeondemand] Respect startvideo (Closes #8923) 8 years ago
Sergey M․ ff5873b72d [motherless] Detect friends only videos 8 years ago
Sergey M․ 065c4b27bf [xhamster:embed] Extract vars (Closes #8912) 8 years ago
Sergey M․ 1600ed1ff9 [rutv] Improve flash version pattern (Closes #8911) 8 years ago
Sergey M․ 5886b38d73 Add support for https for all extractors as preventive and future-proof measure 8 years ago
Sergey M․ 0cef27ad25 Add missing r prefix for _VALID_URLs 8 years ago
Sergey M․ 12af4beb3e [mailru] Add support for https (Closes #8920) 8 years ago
Sergey M․ 9016d76f71 [YoutubeDL] Improve _format_note 8 years ago
Sergey M․ 3c5d183c19 [animeondemand] Extract all formats (Closes #8906) 8 years ago
Sergey M․ 3e8bb9a972 [animeondemand] Detect geo restriction 8 years ago
Yen Chi Hsuan daef04a4e7 [kwuo] Fix KuwoChartIE and KuwoSingerIE and accept new URL forms 8 years ago
Yen Chi Hsuan 2648918c81 [vlive] Fix creator extraction (closes #8814) 8 years ago
Yen Chi Hsuan 9e3c2f1d74 [openload] Misc improvements
* Add thumbnail
* Detect errors (#6469)
* Match more (#6469, #8489)
8 years ago
Yen Chi Hsuan 2bfeee69b9 [openload] Add new extractor (closes #8489) 8 years ago
Yen Chi Hsuan 664bcd80b9 [tudou] Use InAdvancePagedList (closes #8884) 8 years ago
Sergey M․ 3c20208eff [francetv] Improve formats extraction 8 years ago
Sergey M․ db264e3cc3 [francetvinfo] Add support for france3-regions and strip title (Closes #7673) 8 years ago
Sergey M․ 96a9f22d98 [discovery] Relax _VALID_URL (Closes #8903) 8 years ago
Sergey M․ 40025ee2a3 [postprocessort/ffmpeg] Allow embedding webvtt into webm (Closes #8874) 8 years ago
Sergey M․ 298c04b464 [91porn] Use common messages' wording 8 years ago
Sergey M․ d95114dd83 [91porn] Unquote final URL (Closes #8881) 8 years ago
Sergey M․ fa023ccb2c [biobiochiletv] Fix extraction, extract m3u8 formats and overall improve (Closes #7314) 8 years ago
jjatria e36f4aa72b [biobiotv] Add extractor 8 years ago
Sergey M․ f1ced6df51 [cda] Improve and simplify (Closes #8805) 8 years ago
Kacper Michajłow 8b0d7a66ef [cda] Add new extractor for cda.pl
Fixes #8760
8 years ago
Sergey M․ 3aec71766d [safari:api] Separate extractor (Closes #8871) 8 years ago
Sergey M․ 16a8b7986b [downloader/fragment] Document fragment_retries 8 years ago
Sergey M․ 617e58d850 [downloader/{common,fragment}] Fix total retries reporting on python 2.6 8 years ago
Sergey M․ e33baba0dd [downloader/dash] Add fragment retry capability
YouTube may often return 404 HTTP error for a fragment causing the
whole download to fail. However if the same fragment is immediately
retried with the same request data this usually succeeds (1-2 attemps
is usually enough) thus allowing to download the whole file successfully.
So, we will retry all fragments that fail with 404 HTTP error for now.
8 years ago
Sergey M․ 721f26b821 [downloader/fragment] Add report_retry_fragment 8 years ago
Sergey M․ 52bb437e41 [options] Add --fragment-retries option 8 years ago
Jaime Marquínez Ferrándiz 782b1b5bd1 [utils] lookup_unit_table: Match word boundary instead of end of string 8 years ago
Sergey M․ 0d769bcb78 [extractor/generic] Fix missing byte literal prefix 8 years ago
remitamine 4cd70099ea [hbo] Add new extractor 8 years ago
Jaime Marquínez Ferrándiz 09fc33198a utils: lookup_unit_table: Use a stricter regex
In parse_count multiple units start with the same letter, so it would match different units depending on the order they were sorted when iterating over them.
8 years ago
John Peel d5aacf9a90 Added format_id to the filers on -f. 8 years ago
Sergey M․ 19e2617a6f [commonprotocols] Add generic support for rtmp URLs (Closes #8488) 8 years ago
Sergey M․ edd9b71c2c [extractor/generic] Add a test for m3u playlist served without proper Content-Type 8 years ago
Sergey M․ 5940862d5a [extractor/generic] Detect m3u playlists served without proper Content-Type 8 years ago
Sergey M․ de6c51e88e [extractor/generic] Fix direct link semantics 8 years ago
Sergey M․ 303dcdb995 [extractor/generic] Simplify upload_date extraction 8 years ago
Sergey M․ 20938f768b [extractor/generic] Add another test for generic m3u8 8 years ago
Sergey M․ 955737b2d4 [extractor/generic] Force Content-Type to lowecase 8 years ago
Sergey M․ 263eff9537 [extractor/generic] Properly extract format id from Content-Type
Fixes extraction for cases like: audio/x-mpegURL; charset=utf-8
8 years ago
Sergey M․ cae21032ab [theplatform] Improve geo restriction detection 8 years ago
remitamine 6187091532 [once] check http formats availability 8 years ago
Philipp Hagemeister 0d33166ec5 release 2016.03.18 8 years ago
remitamine 87c03c6bd2 [theplatform] remove unnecessary import 8 years ago
remitamine 4c92fd2e83 [theplatform] always force theplatform to return a smil for _extract_theplatform_smil 8 years ago
Sergey M․ e3d17b3c07 [noz] Fix extraction on python 2.6 by means of using compat_xpath 8 years ago
Sergey M․ 810c10baa1 [utils] Use compat_xpath 8 years ago
Sergey M․ 57f7e3c62d [compat] Add compat_xpath 8 years ago
Sergey M․ 0d0e282912 [animeondemand] Fix typo and improve 8 years ago
Sergey M․ 85e8f26b82 [animeondemand] Improve extraction 8 years ago