Commit Graph

966 Commits (master)

Author SHA1 Message Date
Sergey M․ befa4708fd
[utils] Fixup some common URL's typos in sanitize_url (closes #15649) 6 years ago
Sergey M․ 6fcc053947
[test_downloader_http] Use try_rm 6 years ago
Sergey M․ f19eae429a
[test_http] Use 127.0.0.1 instead of localhost 6 years ago
Sergey M․ ba515388b8
Introduce --http-chunk-size 6 years ago
squibbysquibby 655c410063 [test_download] Fix download tests for lazy extractors (closes #13554, closes #13757) 6 years ago
Sergey M․ c707b1d828
[test_utils] Add tests for malformed JSON handling in js_to_json 6 years ago
Mike Fährmann c384d537f8 [util] Improve scientific notation handling in js_to_json (closes #14789) 6 years ago
Sergey M․ 9d6ac71c27
[extractor/common] Fix extraction of DASH formats with the same representation id (closes #15111) 6 years ago
Sergey M․ b555ae9bf1
[utils] Add another date format pattern (#14999) 6 years ago
Sergey M․ 78593e294c
Add references for #14844 6 years ago
Petr Novak 41bf647e89
[extractor/common] Add support for DASH manifests with SegmentLists with bare SegmentURLs 6 years ago
Yen Chi Hsuan f58a506044 [test_InfoExtractor] Fix flake8 6 years ago
Sergey M․ d08dcd2dbd
[test_YoutubeDL] Fix typo (closes #14856) 6 years ago
Sergey M․ 181e381fda
[test_InfoExtractor] Add test for #14660 7 years ago
Sergey M․ 056653bbb1
[utils] Add support for zero years and months in parse_duration 7 years ago
Sergey M․ af0f74288d
[YoutubeDL] Improve _default_format_spec (closes #14461) 7 years ago
Sergey M․ cd6fc19ed7
[YoutubeDL] Ignore duplicates in --playlist-items
E.g. '--playlist-items 2-4,3-4,3' should result in '[2,3,4]', not '[2,3,4,3,4,3]'
7 years ago
Sergey M․ 86a15ed64b
[test_YoutubeDL] Add test for #14425 7 years ago
Yen Chi Hsuan 3869028ffb [utils] Use bytes-like objects in dfxp2srt
This fixes handling of non-UTF8 TTML subtitles

Closes #14191
7 years ago
Yen Chi Hsuan 95f3f7c20a
[utils] Fix unescapeHTML for misformed string like "&a"" (#13935) 7 years ago
Sergey M․ 4850478543
[extractor/common] Add support for float durations in _parse_mpd_formats (closes #13919) 7 years ago
Sergey M․ 5b232f46dc
[utils] Skip missing params in cli_bool_option (closes #13865) 7 years ago
Sergey M․ 8cda78ef72
[test_YoutubeDL] Add a test for #10083 7 years ago
Yen Chi Hsuan 73095e013f
[options] Typo 7 years ago
Yen Chi Hsuan 905d18a7aa
[options] Correctly hide login info from debug outputs (#13696)
Iterate over opts instead of PRIVATE_OPTS for both performance and
correctness
7 years ago
Sergey M․ 0017d9ad6d
[YoutubeDL] Improve default format specification (closes #13704) 7 years ago
Sergey M․ 0396806f67
[YoutubeDL] Do not override id, extractor and extractor_key in url_transparent
All these meta fields must be borrowed from final extractor that actually performs extraction.
This commit fixes extractor id in download archives for url_transparent downloads. Previously, 'transparent' extractor was erroneously
used for extractor archive id, e.g. 'eggheadlesson 4n8ugwwj5t' instead of 'wistia 4n8ugwwj5t'.
7 years ago
Sergey M․ 15da37c7dc
[YoutubeDL] Don't expand env variables in meta fields (closes #13637) 7 years ago
Sergey M․ dee2ff1d81
[test_utils] Fix tests under Windows 7 years ago
Yen Chi Hsuan 609ff8ca19 [utils] Support attributes with no values in get_elements_by_attribute() 7 years ago
Sergey M․ b4a3d461e4
[utils] Handle HTMLParseError in extract_attributes (closes #13349) 7 years ago
Sergey M․ 2ae2ffda5e
[utils] Improve unified_timestamp 7 years ago
Sergey M․ 39d4c1be4d
[youtube] Improve chapters extraction (closes #13247) 7 years ago
Yen Chi Hsuan 5552c9eb0f
[utils] Recognize more patterns in strip_jsonp()
Used in Youku Show pages
7 years ago
Sergey M․ e4a75d7932
[test_youtube_chapters] PEP 8 7 years ago
Sergey M․ a57a8e9918
[test_youtube_chapters] Add coding cookie 7 years ago
Sergey M․ 9cafc3fd8b
[youtube] Extract chapters 7 years ago
Yen Chi Hsuan 0c26548601
[cda] Implement birthday verification (closes #12789) 7 years ago
Sergey M․ deef31955b
[utils] Improve unified_timestamp
Seen at http://zaq1.pl/video/xev0e
7 years ago
Tithen-Firion 9222d94510 [test_utils] Add one more clean_html test 7 years ago
Sergey M․ 30bb6ce1a4
[test_InfoExtractor] Fix test_parse_m3u8_formats 7 years ago
Tithen-Firion 374560f018 [test_download] Fix order when testing file's md5 7 years ago
Sergey M․ ff99fe529e
Don't list master m3u8 playlists in format list (closes #12832) 7 years ago
Sergey M․ 538eee7b6a
Add missing test m3u8 file 7 years ago
Sergey M․ ddd258f922
[test_InfoExtractor] Add m3u8 parsing test for NAME attribute in EXT-X-STREAM-INF tag 7 years ago
Sergey M․ cb2520802d
[extractor/common] Improve m3u8 extraction (closes #12211)
* Extract m3u8 parsing to separate method
* Improve rendition groups extraction
* Build stream name according stream GROUP-ID
* Ignore reference to AUDIO group without URI when stream has no CODECS
+ Add test coverage for parsing m3u8 from #11507, #11995, #12211 and twitch vod
7 years ago
Remita Amine 5b995f713b [utils] add support for ttml styles 7 years ago
Sergey M․ 51350db5a3
[test_YoutubeDL] Add test for #11163 7 years ago
Sergey M․ 364a69e8c6
[test_download] Fix testing playlists with single video and add comments 7 years ago
Sergey M․ 60e5016199
[test_download] Remove unused import 7 years ago
Sergey M․ c4d6fc6d65
[test_subtitles] Fix raiplay test 7 years ago
Sergey M․ 80b2fdf9ac
[test_download] Match info dicts against tests before matching info file 7 years ago
John Hawkinson 3bef10a50c [test_download] typo in comment 7 years ago
John Hawkinson a84da06f49 [test_download] Improve diagnostic on wrong 'id' 7 years ago
Sergey M․ 942b44a052
[test_compat] Do not use dash in env variables' names 7 years ago
Sergey M․ a426ef6d78
[test_utils] Do not use dash in env variables' names 7 years ago
Sergey M․ 41c5e60dd5
[test_utils] Fix expand_path tests 7 years ago
Sergey M․ 51098426b8
[utils] Introduce expand_path 7 years ago
John Hawkinson c6c22e984d [test_download] Print additional IEs in summary output 7 years ago
Sergey M․ 7f3590c43b
[test_InfoExtractor] Add some realworld tests for _extract_jwplayer_data 7 years ago
Sergey M․ 4b5de77bdb
[utils] Process bytestrings in urljoin (closes #12369) 7 years ago
Yen Chi Hsuan f48409c7ac [utils] Add pkcs1pad
Used in daisuki.net (#4738)
7 years ago
Yen Chi Hsuan c9619f0a17 [aes] Add aes_cbc_encrypt
Used in daisuki.net (#4738)
7 years ago
Sergey M․ d0d9ade486 [YoutubeDL] Add support for string formatting operations in output template 7 years ago
Yen Chi Hsuan 8936f68a0b
[travis] Run tests in parallel
[test_download] Print test names in case of network errors

[test_download] Add comments for nose parameters

[test_download] Modify outtmpl to prevent info JSON filename conflicts

Thanks @jaimeMF for the idea.

[travis] Only download tests should be run in parallel
7 years ago
Sergey M․ 398dea3210
[test_YoutubeDL] Fix invalid escape sequences 7 years ago
Sergey M․ db13c16ef8
[utils] Add support for quoted string literals in --match-filter (closes #8050, closes #12142, closes #12144) 7 years ago
Thomas Christlieb 2af12ad9d2 Introduce get_elements_by_class and get_elements_by_attribute utility functions 7 years ago
Sergey M․ 4195096ea8
[utils] Improve comments processing in js_to_json (closes #11947) 7 years ago
Michal Čihař b3ee552e4b
[utils] Handle single-line comments in js_to_json 7 years ago
Sergey M․ 15846398ca
[utils] Improve parse_duration 7 years ago
Sergey M․ cb655f34fb
[utils] Add more date formats 7 years ago
Remita Amine 7fe1592073 [common] fix dash codec information for mixed videos and fragment url construction(#11490) 7 years ago
Sergey M․ b0c65c677f
[utils] Improve urljoin 7 years ago
Sergey M․ e34c33614d
[utils] Add convenience urljoin 7 years ago
Yen Chi Hsuan 582be35847
Update coding style after pycodestyle 2.1.0
In pycodestyle 2.1.0, E305 was introduced, which requires two blank
lines after top level declarations, too.

See https://github.com/PyCQA/pycodestyle/issues/400

See also #10689; thanks @stepshal for first mentioning this issue and
initial patches
8 years ago
Kacper Michajłow 189935f159 [jsinterp] Fix function calls without arguments. 8 years ago
Sergey M․ 02dc0a36b7
[utils] Introduce base_url 8 years ago
Sergey M․ e5a088dc4b
[utils] Fix --match-filter for int-like strings (closes #11082) 8 years ago
Yen Chi Hsuan 6f20b65e72
[test/test_http] Update tests
After switching to HTML5 extraction helpers in generic.py, the result
info_dict is always a playlist.
8 years ago
Sergey M․ c6eed6b8c0
[utils] Lower priority for rare date formats and add tests 8 years ago
Sergey M․ 3e4185c396
[utils] Use native french month names 8 years ago
Sergey M․ f6717dec8a
[utils] Improve month_by_name and add tests 8 years ago
Sergey M․ 6562d34a8c
[utils] Improve mimetype2ext 8 years ago
Yen Chi Hsuan 70852b47ca
[utils] Recognize units with full names in parse_filename
Reference: https://en.wikipedia.org/wiki/Template:Quantities_of_bytes
8 years ago
Yen Chi Hsuan e4659b4547
[utils] Correct octal/hexadecimal number detection in js_to_json 8 years ago
Sergey M․ 13585d7682
[utils] Recognize lowercase units in parse_filesize 8 years ago
Yen Chi Hsuan 52aa7e7476
[test_verbose_output] Fix tests under Python 3 8 years ago
Remita Amine 5f2c2b7936 [test_utils] add test for option with not str value 8 years ago
Sergey M․ a8795327ca
[utils] Add support TV Parental Guidelines ratings in parse_age_limit 8 years ago
Yen Chi Hsuan 7dc2a74e0a
[utils] Fix unified_timestamp for formats parsed by parsedate_tz() 8 years ago
Sergey M․ b070564efb
[extractor/common] Support multiple properties in _og_search_property 8 years ago
Philipp Hagemeister ce28252c48 [options] Add test that checks that --password=secret is hidden in verbose output 8 years ago
Yen Chi Hsuan 14a28e705b
[test/test_all_urls] Remove *.cc.com tests 8 years ago
Sergey M․ 317f7ab634
[YoutubeDL] Fix format selection with filters (Closes #10083) 8 years ago
Yen Chi Hsuan 0b68de3cc1 Merge pull request #8876 from remitamine/html5_media
[extractor/common] add helper method to extract html5 media entries
8 years ago
Yen Chi Hsuan dfe5fa49ae
[compat] Fix compat_shlex_split for non-ASCII input
Closes #9871
8 years ago
Yen Chi Hsuan 84c237fb8a
[utils] Add get_element_by_class
For #9950
8 years ago
Remita Amine dfaa86b75e [test_utils] add test for smuggling a smuggled url 8 years ago
Yen Chi Hsuan 40f3666f6b
[test/test_http] Update tests for 38cce791c7 8 years ago