153 Commits

• Added sanitization support for Hungarian letters Ő and Ű
  bzc6p · 2016-06-02 11:39:32 +02:00
  b96f007eeb
• [utils] Allow None in remove_{start,end}
  Sergey M․ · 2016-05-19 04:31:30 +06:00
  46bc9b7d7c
• [test_utils] PEP 8
  Sergey M․ · 2016-05-14 20:46:33 +06:00
  364cf465dd
• [utils] Process non-base 10 integers in js_to_json
  Sergey M․ · 2016-05-14 20:39:58 +06:00
  89ac4a19e6
• [utils] js_to_json: various improvements

  now JS object literals like { /* " */ 0: ",]\xaa<\/p>", } will be correctly converted to JSON.

  felix · 2016-05-14 20:12:39 +06:00
  bd1e484448
• [utils] Add Œ and œ found in French to ACCENT_CHARS

  Fixes #9463

  Yen Chi Hsuan · 2016-05-12 19:48:48 +08:00
  778a1ccca7
• [utils,compat] Move struct_pack and struct_unpack to compat.py
  Yen Chi Hsuan · 2016-05-10 14:51:38 +08:00
  dab0daeeb0
• Instead of replacing accented characters with an underscore when sanitizing file names in restricted mode, replace them with their non-accented equivalents fixes #9347
  Adam Thalhammer · 2016-05-02 13:25:12 +10:00
  31c4448f6e
• Instead of replacing accented characters with an underscore when sanitizing file names in restricted mode, replace them with their non-accented equivalents fixes #9347
  Adam Thalhammer · 2016-05-02 13:21:39 +10:00
  79a2e94e79
• Merge pull request #9110 from remitamine/parse_duration

  [utils] imporove parse_duration to handle more formats

  Sergey M · 2016-04-21 22:53:16 +07:00
  b6c0d4f431
• [utils] imporove parse_duration to handle more formats
  remitamine · 2016-04-21 16:34:54 +01:00
  acaff49575
• [test/utils] Add test for date_from_str
  Jaime Marquínez Ferrándiz · 2016-04-09 22:40:05 +02:00
  eb9c3edd5e
• [test/test_utils] Update for escape_url change (again)
  Yen Chi Hsuan · 2016-03-23 23:23:26 +08:00
  81f36eba88
• [test/test_utils] Update for escape_url change
  Yen Chi Hsuan · 2016-03-23 23:20:28 +08:00
  2d60465e44
• [utils] lookup_unit_table: Match word boundary instead of end of string
  Jaime Marquínez Ferrándiz · 2016-03-19 11:44:49 +01:00
  782b1b5bd1
• [utils] PEP 8
  Sergey M․ · 2016-03-16 21:50:04 +06:00
  c5229f3926
• Merge pull request #8092 from bpfoley/twitter-thumbnail

  [utils] Add extract_attributes for extracting html tag attributes

  remitamine · 2016-03-16 13:16:27 +01:00
  83548824c2
• [bbc] Generalize unit table lookup and add parse_count
  Sergey M․ · 2016-03-13 16:27:20 +06:00
  fb47597b09
• [test/test_utils] add more tests for update_url_query
  remitamine · 2016-03-03 19:18:57 +01:00
  3201a67f61
• [test/test_utils] add tests for update_url_query
  remitamine · 2016-03-03 18:40:05 +01:00
  fb640d0a3d
• [utils] Add extract_attributes for extracting html tag attributes

  This is much more robust than just using regexps, and handles all
  the common scenarios, such as empty/no values, repeated attributes,
  entity decoding, mixed case names, and the different possible value
  quoting schemes.

  Brian Foley · 2016-03-03 10:11:37 +00:00
  8bb56eeeea
• [utils] Multiple changes to base_n()

  1. Renamed to encode_base_n()
  2. Allow tables longer than 62 characters
  3. Raise ValueError instead of AssertionError for invalid input data
  4. Return the first character in the table instead of '0' for number 0
  5. Add tests

  Yen Chi Hsuan · 2016-02-27 03:22:52 +08:00
  5eb6bdced4
• [utils] Remove AM/PM from unified_strdate patterns
  Sergey M․ · 2016-02-25 00:52:49 +06:00
  f160785c5c
• [utils] Add OHDave's RSA encryption function
  Yen Chi Hsuan · 2016-02-20 19:54:58 +08:00
  5bc880b988
• [utils] Allow dot in strip_jsonp
  Sergey M․ · 2016-02-07 19:47:09 +06:00
  8411229bd5
• [utils] Add ability to control skipping false values in dict_get
  Sergey M․ · 2016-02-07 08:13:04 +06:00
  86296ad2cd
• [utils] Add dict_get convenience method
  Sergey M․ · 2016-02-07 06:12:53 +06:00
  cbecc9b903
• [test_utils] Add tests for encode_compat_str
  Sergey M․ · 2015-12-20 07:07:14 +06:00
  6b77d52b1f
• [utils] Support alternative timestamp format in TTML

  Fixes #7608

  Yen Chi Hsuan · 2015-12-19 19:29:51 +08:00
  db2fe38b55
• [utils] Fix TTML conversion

  Tolerate invalid timestamps (closes #7909)

  Yen Chi Hsuan · 2015-12-19 18:21:42 +08:00
  d631d5f9f2
• [utils] Add remove_quotes
  Sergey M․ · 2015-12-14 21:30:58 +06:00
  31b2051e21
• [utils] Check ext with trailing slash against the list of known extensions
  Sergey M․ · 2015-11-22 17:27:13 +06:00
  9cb9a5df77
• [test_utils] Add tests for determine_ext
  Sergey M․ · 2015-11-22 06:33:52 +06:00
  5035536e3f
• [utils] Skip invalid/non HTML entities (Closes #7518)
  Sergey M․ · 2015-11-16 20:20:16 +06:00
  7aefc49c40
• [utils] unified_strdate: Return None if the date format can't be recognized (fixes #7340)

  This issue was introduced with ae12bc3ebb, it returned 'None'.

  Jaime Marquínez Ferrándiz · 2015-11-02 14:08:38 +01:00
  6a75040278
• Merge pull request #7296 from jaimeMF/xml_attrib_unicode

  Use a wrapper around xml.etree.ElementTree.fromstring in python 2.x (…

  Sergey M · 2015-10-31 18:15:21 +00:00
  30eecc6a04
• [utils] Support list of xpath in xpath_element
  Sergey M․ · 2015-10-31 22:39:44 +06:00
  578c074575
• [utils] Improve parse_iso8601
  Sergey M․ · 2015-10-28 21:40:22 +06:00
  52c3a6e49d
• Use a wrapper around xml.etree.ElementTree.fromstring in python 2.x (#7178)

  Attributes aren't unicode objects, so they couldn't be directly used in info_dict fields (for example '--write-description' doesn't work with bytes).

  Jaime Marquínez Ferrándiz · 2015-10-25 20:13:16 +01:00
  36e6f62cd0
• [utils:js_to_json] Fix bad escape in double quoted strings
  Sergey M․ · 2015-10-20 23:09:51 +06:00
  d01949dc89
• [test_utils] Add tests for cli option converters
  Sergey M․ · 2015-09-05 03:07:19 +06:00
  f71264490c
• [test_utils] Add more tests for xpath
  Sergey M․ · 2015-09-05 00:36:16 +06:00
  87f70ab39d
• [utils] Make value optional for find_xpath_attr

  This allows selecting particular attributes by name but without specifying the value and similar to xpath syntax `[@attrib]`

  Sergey M․ · 2015-08-01 20:22:13 +06:00
  ee114368ad
• [utils] Improve parse_duration

  Now dots are parsed. For example '87 Min.'

  Yen Chi Hsuan · 2015-07-22 23:15:22 +08:00
  9c29bc69f7
• [utils] Support TTML without default namespace

  In a strict sense such TTML is invalid, but Yahoo uses it.

  Yen Chi Hsuan · 2015-05-19 00:45:01 +08:00
  1b0427e6c4
• [utils] Support 'dur' field in TTML
  Yen Chi Hsuan · 2015-05-12 12:47:37 +08:00
  7dff03636a
• [utils] Remove sanitize_url_path_consecutive_slashes()

  This function is used only in SohuIE, which is updated to use a new
  extraction logic.

  Yen Chi Hsuan · 2015-05-09 17:37:39 +08:00
  d39e0f05db
• [NBC] Enhance embedURL extraction (closes #2549)
  Yen Chi Hsuan · 2015-05-04 21:55:04 +08:00
  0fe2ff78e6
• [utils] Add replace_extension
  Sergey M․ · 2015-05-02 23:23:06 +06:00
  b3ed15b760
• [test_utils] Add tests for prepend_extension
  Sergey M․ · 2015-05-02 23:10:48 +06:00
  a4bcaad773