781 Commits

• [utils] imporove parse_duration to handle more formats
  remitamine · 2016-04-21 16:34:54 +01:00
  acaff49575
• [compat] Handle tuples properly in urlencode()

  Fixes #9055

  Yen Chi Hsuan · 2016-04-06 18:29:54 +08:00
  92d5477d84
• [test_compat] Add tests for compat_urllib_parse_urlencode
  Sergey M․ · 2016-03-26 02:38:33 +06:00
  e289d6d62c
• [test/test_utils] Update for escape_url change (again)
  Yen Chi Hsuan · 2016-03-23 23:23:26 +08:00
  81f36eba88
• [test/test_utils] Update for escape_url change
  Yen Chi Hsuan · 2016-03-23 23:20:28 +08:00
  2d60465e44
• [utils] Encode hostnames before passing to urllib

  With IDN (Internationalized Domain Name) and a proxy, non-ascii URLs
  are passed down to urllib/urllib2, causing UnicodeEncodeError
  
  Fixes #8890

  Yen Chi Hsuan · 2016-03-23 22:24:52 +08:00
  efbed08dc2
• [utils] lookup_unit_table: Match word boundary instead of end of string
  Jaime Marquínez Ferrándiz · 2016-03-19 11:44:49 +01:00
  782b1b5bd1
• [test_YoutubeDL] Add test for format_id format selection
  Sergey M․ · 2016-03-19 00:04:26 +06:00
  4c3b16d5d1
• [utils] PEP 8
  Sergey M․ · 2016-03-16 21:50:04 +06:00
  c5229f3926
• Merge pull request #8092 from bpfoley/twitter-thumbnail

  [utils] Add extract_attributes for extracting html tag attributes

  remitamine · 2016-03-16 13:16:27 +01:00
  83548824c2
• [bbc] Generalize unit table lookup and add parse_count
  Sergey M․ · 2016-03-13 16:27:20 +06:00
  fb47597b09
• [test_YoutubeDL] PEP 8
  Sergey M․ · 2016-03-10 09:04:48 +06:00
  e0dccdd398
• [YoutubeDL] Improve _format_note
  Sergey M․ · 2016-03-10 01:03:18 +06:00
  5d583bdf6c
• Merge pull request #8739 from remitamine/update_url_params

  [utils] add update_url_query function to create or update query string params

  remitamine · 2016-03-03 19:24:04 +01:00
  1255733945
• [test/test_utils] add more tests for update_url_query
  remitamine · 2016-03-03 19:18:57 +01:00
  3201a67f61
• [test/test_utils] add tests for update_url_query
  remitamine · 2016-03-03 18:40:05 +01:00
  fb640d0a3d
• [test/http] Fix failure in Jython

  make offlinetest passed on the latest Jython hg version with patched
  lib-python/2.7/urllib2.py pulled from CPython 2.7.11

  Yen Chi Hsuan · 2016-03-03 21:55:17 +08:00
  429491f531
• [jython] Introduce compat_os_name

  os.name is always 'java' on Jython

  Yen Chi Hsuan · 2016-03-03 19:24:24 +08:00
  e9c0cdd389
• [utils] Add extract_attributes for extracting html tag attributes

  This is much more robust than just using regexps, and handles all
  the common scenarios, such as empty/no values, repeated attributes,
  entity decoding, mixed case names, and the different possible value
  quoting schemes.

  Brian Foley · 2016-03-03 10:11:37 +00:00
  8bb56eeeea
• [utils] Multiple changes to base_n()

  1. Renamed to encode_base_n()
  2. Allow tables longer than 62 characters
  3. Raise ValueError instead of AssertionError for invalid input data
  4. Return the first character in the table instead of '0' for number 0
  5. Add tests

  Yen Chi Hsuan · 2016-02-27 03:22:52 +08:00
  5eb6bdced4
• [utils] Remove AM/PM from unified_strdate patterns
  Sergey M․ · 2016-02-25 00:52:49 +06:00
  f160785c5c
• [test_iqiyi_sdk_interpreter] Add test for iQiyi login
  Yen Chi Hsuan · 2016-02-20 23:10:39 +08:00
  a4e4d7dfcd
• [utils] Add OHDave's RSA encryption function
  Yen Chi Hsuan · 2016-02-20 19:54:58 +08:00
  5bc880b988
• [test_YoutubeDL] Make test pass until more intelligent sort formats (Closes #8462)
  Sergey M․ · 2016-02-20 03:36:03 +06:00
  86bf29050e
• [utils] Allow dot in strip_jsonp
  Sergey M․ · 2016-02-07 19:47:09 +06:00
  8411229bd5
• [utils] Add ability to control skipping false values in dict_get
  Sergey M․ · 2016-02-07 08:13:04 +06:00
  86296ad2cd
• [utils] Add dict_get convenience method
  Sergey M․ · 2016-02-07 06:12:53 +06:00
  cbecc9b903
• rename _parse_mpd to _parse_mpd_formats and add default value for mpd namespace
  remitamine · 2016-02-06 14:03:48 +01:00
  91cb6b5065
• [test_subtitles] update youtube subtitles tests
  remitamine · 2016-02-04 08:50:55 +01:00
  920d21b9d3
• [test_YoutubeDL] Fix test_youtube_format_selection

  Broken since a6c2c24479. Thanks to
  @jaimeMF and @anisse for pointing that out

  Yen Chi Hsuan · 2016-02-03 03:42:37 +08:00
  1df4141196
• [YoutubeDL] Do not override ie_key in url_transparent
  Yen Chi Hsuan · 2016-02-01 17:05:48 +08:00
  b286f201a8
• [test_subtitles] Fix TestRaiSubtitles

  RaiIE is renamed to RaiTVIE in 06d5556dfa

  Yen Chi Hsuan · 2016-01-31 20:12:43 +08:00
  189d72d5fd
• [test_youtube_lists] Fix TestYoutubeLists.test_youtube_course

  Youtube entries are now generators

  Yen Chi Hsuan · 2016-01-31 20:12:43 +08:00
  a7aab0c23e
• [youtube:user] Require 'https?://' in the url (fixes #8356)

  It was matching www.youtube.com/embed/WpfukLMe1TM.
  The generic extractor automatically adds http:// if it's missing.

  Jaime Marquínez Ferrándiz · 2016-01-29 11:27:11 +01:00
  70029bc348
• Test codec with a dot '.' in name selection.
  dyn888 · 2016-01-28 15:07:33 +01:00
  b913348d5f
• [update] fix (unexploitable) BB'06 vulnerability in rsa_verify

  The rsa_verify code was vulnerable to a BB'06 attack, allowing to forge
  signatures for arbitrary messages if and only if the public key exponent is
  3.  Since the updates key is hardcoded to 65537, there is no risk for
  youtube-dl, but I don't want vulnerable code in the wild.
  
  The new function adopts a way safer approach of encoding-and-comparing to
  replace the dangerous parsing code.

  Filippo Valsorda · 2016-01-21 20:12:17 +00:00
  4d318be195
• [YoutubeDL] urlopen: disable the 'file:' protocol (#8227)

  If someone is running youtube-dl on a server to deliver files, the user could input 'file:///some/important/file' and youtube-dl would save that file as a video giving access to sensitive information to the user.
  'file:' urls can be filtered, but the user can use an URL to a crafted m3u8 manifest like:
  
      #EXTM3U
      #EXT-X-MEDIA-SEQUENCE:0
      #EXTINF:10.0
      file:///etc/passwd
      #EXT-X-ENDLIST
  
  With this patch 'file:' URLs raise URLError like for unknown protocols.

  Jaime Marquínez Ferrándiz · 2016-01-14 00:24:04 +01:00
  e37afbe0b8
• Fix typos

  Closes #8200.

  Jakub Wilk · 2016-01-10 17:24:28 +01:00
  dfb1b1468c
• [test_subtitles] remove BlipTV test
  remitamine · 2015-12-21 16:52:47 +01:00
  f11d00fa41
• [test_utils] Add tests for encode_compat_str
  Sergey M․ · 2015-12-20 07:07:14 +06:00
  6b77d52b1f
• [utils] Support alternative timestamp format in TTML

  Fixes #7608

  Yen Chi Hsuan · 2015-12-19 19:29:51 +08:00
  db2fe38b55
• [utils] Fix TTML conversion

  Tolerate invalid timestamps (closes #7909)

  Yen Chi Hsuan · 2015-12-19 18:21:42 +08:00
  d631d5f9f2
• [utils] Add remove_quotes
  Sergey M․ · 2015-12-14 21:30:58 +06:00
  31b2051e21
• [test/test_all_urls] Update pbs extractor name

  It's in lowercase now (since e15e2ef7a0).

  Jaime Marquínez Ferrándiz · 2015-12-08 21:12:13 +01:00
  47f48f5d85
• [utils] Check ext with trailing slash against the list of known extensions
  Sergey M․ · 2015-11-22 17:27:13 +06:00
  9cb9a5df77
• [test_utils] Add tests for determine_ext
  Sergey M․ · 2015-11-22 06:33:52 +06:00
  5035536e3f
• [utils] Skip invalid/non HTML entities (Closes #7518)
  Sergey M․ · 2015-11-16 20:20:16 +06:00
  7aefc49c40
• [jsinterp] Support alternative function definition form
  Yen Chi Hsuan · 2015-11-10 12:54:02 +08:00
  ff29bf81f8
• [test/subtitles] Add test for DemocracynowIE
  Yen Chi Hsuan · 2015-11-04 00:53:30 +08:00
  66d041f250
• [utils] unified_strdate: Return None if the date format can't be recognized (fixes #7340)

  This issue was introduced with ae12bc3ebb, it returned 'None'.

  Jaime Marquínez Ferrándiz · 2015-11-02 14:08:38 +01:00
  6a75040278