Akkariin/youtube-dl
1
0
Fork 0
mirror of https://github.com/l1ving/youtube-dl synced 2024-11-25 17:12:57 +08:00
Code Issues Releases Wiki Activity
d9dd3584e1
youtube-dl/test/test_all_urls.py

182 lines
9.0 KiB
Python
Raw Normal View History

Let youtube IE handle IDs starting with PL (Closes #572)
2012-12-04 17:59:38 +08:00
#!/usr/bin/env python
[pbs] Add support for viralplayer links (Fixes #2350)
2014-02-09 01:37:33 +08:00
from __future__ import unicode_literals
Simplify tests * Make them directly executable again * Move common stuff (md5, parameters) to helper * Never import * * General clean up
2013-10-15 08:00:53 +08:00
# Allow direct execution
import os
Let youtube IE handle IDs starting with PL (Closes #572)
2012-12-04 17:59:38 +08:00
import sys
import unittest
Simplify tests * Make them directly executable again * Move common stuff (md5, parameters) to helper * Never import * * General clean up
2013-10-15 08:00:53 +08:00
sys.path.insert(0, os.path.dirname(os.path.dirname(os.path.abspath(__file__))))
Let youtube IE handle IDs starting with PL (Closes #572)
2012-12-04 17:59:38 +08:00
[test] Rename get_testcases to gettestcases Apparently, newer versions of nosetests are somewhat over-eager in their test discovery.
2014-03-17 21:30:13 +08:00
from test.helper import gettestcases
Simplify tests * Make them directly executable again * Move common stuff (md5, parameters) to helper * Never import * * General clean up
2013-10-15 08:00:53 +08:00
from youtube_dl.extractor import (
[facebook] Recognize #! URLs (Fixes #1988)
2013-12-17 04:10:06 +08:00
FacebookIE,
Simplify tests * Make them directly executable again * Move common stuff (md5, parameters) to helper * Never import * * General clean up
2013-10-15 08:00:53 +08:00
gen_extractors,
JustinTVIE,
[pbs] Add support for viralplayer links (Fixes #2350)
2014-02-09 01:37:33 +08:00
PBSIE,
Simplify tests * Make them directly executable again * Move common stuff (md5, parameters) to helper * Never import * * General clean up
2013-10-15 08:00:53 +08:00
YoutubeIE,
)
Let youtube IE handle IDs starting with PL (Closes #572)
2012-12-04 17:59:38 +08:00
Allow ampersand right after ? in youtube URLs (Closes #602)
2012-12-27 12:31:36 +08:00
class TestAllURLsMatching(unittest.TestCase):
[youtube] Urls like youtube.com/NASA are now interpreted as users (fixes #1069) Video urls like http://youtube.com/BaW_jenozKc are not valid, but http://youtu.be/BaW_jenozKc is correct.
2013-09-06 04:38:23 +08:00
def setUp(self):
self.ies = gen_extractors()
def matching_ies(self, url):
return [ie.IE_NAME for ie in self.ies if ie.suitable(url) and ie.IE_NAME != 'generic']
def assertMatch(self, url, ie_list):
self.assertEqual(self.matching_ies(url), ie_list)
Allow ampersand right after ? in youtube URLs (Closes #602)
2012-12-27 12:31:36 +08:00
def test_youtube_playlist_matching(self):
[youtube] Fix some issues with the detection of playlist/channel urls (reported in #1374) They were being caught by YoutubeUserIE, now it only extracts a url if the rest of extractors aren't suitable. Now the url tests check that the urls can only be extracted with an specific extractor.
2013-09-06 22:24:24 +08:00
assertPlaylist = lambda url: self.assertMatch(url, ['youtube:playlist'])
[pbs] Add support for viralplayer links (Fixes #2350)
2014-02-09 01:37:33 +08:00
assertPlaylist('ECUl4u3cNGP61MdtwGTqZA0MreSaDybji8')
assertPlaylist('UUBABnxM4Ar9ten8Mdjj1j0Q') #585
assertPlaylist('PL63F0C78739B09958')
assertPlaylist('https://www.youtube.com/playlist?list=UUBABnxM4Ar9ten8Mdjj1j0Q')
assertPlaylist('https://www.youtube.com/course?list=ECUl4u3cNGP61MdtwGTqZA0MreSaDybji8')
assertPlaylist('https://www.youtube.com/playlist?list=PLwP_SiAcdui0KVebT0mU9Apz359a4ubsC')
assertPlaylist('https://www.youtube.com/watch?v=AV6J6_AeFEQ&playnext=1&list=PL4023E734DA416012') #668
self.assertFalse('youtube:playlist' in self.matching_ies('PLtS2H6bU1M'))
[youtube:playlist] Recognize ‘top tracks’ urls (closes #2332) The list parameter starts with ‘MC’ and can have more characters after it, including dots
2014-02-07 02:46:26 +08:00
# Top tracks
assertPlaylist('https://www.youtube.com/playlist?list=MCUS.20142101')
Let youtube IE handle IDs starting with PL (Closes #572)
2012-12-04 17:59:38 +08:00
def test_youtube_matching(self):
[pbs] Add support for viralplayer links (Fixes #2350)
2014-02-09 01:37:33 +08:00
self.assertTrue(YoutubeIE.suitable('PLtS2H6bU1M'))
self.assertFalse(YoutubeIE.suitable('https://www.youtube.com/watch?v=AV6J6_AeFEQ&playnext=1&list=PL4023E734DA416012')) #668
[youtube] Urls like youtube.com/NASA are now interpreted as users (fixes #1069) Video urls like http://youtube.com/BaW_jenozKc are not valid, but http://youtu.be/BaW_jenozKc is correct.
2013-09-06 04:38:23 +08:00
self.assertMatch('http://youtu.be/BaW_jenozKc', ['youtube'])
self.assertMatch('http://www.youtube.com/v/BaW_jenozKc', ['youtube'])
[youtube] support youtube.googleapis.com/v/* urls (fixes #1425)
2013-09-15 18:14:59 +08:00
self.assertMatch('https://youtube.googleapis.com/v/BaW_jenozKc', ['youtube'])
[youtube] Add support for cleanvideosearch.com (Fixes #2734)
2014-04-11 19:51:47 +08:00
self.assertMatch('http://www.cleanvideosearch.com/media/action/yt/watch?videoId=8v_4O44sfjM', ['youtube'])
Let youtube IE handle IDs starting with PL (Closes #572)
2012-12-04 17:59:38 +08:00
Add tests for YoutubeChannelIE - tests for identifying channel urls - test retrieval of paginated channel - test retrieval of autogenerated channel
2013-04-20 06:06:28 +08:00
def test_youtube_channel_matching(self):
[youtube] Fix some issues with the detection of playlist/channel urls (reported in #1374) They were being caught by YoutubeUserIE, now it only extracts a url if the rest of extractors aren't suitable. Now the url tests check that the urls can only be extracted with an specific extractor.
2013-09-06 22:24:24 +08:00
assertChannel = lambda url: self.assertMatch(url, ['youtube:channel'])
assertChannel('https://www.youtube.com/channel/HCtnHdj3df7iM')
assertChannel('https://www.youtube.com/channel/HCtnHdj3df7iM?feature=gb_ch_rec')
assertChannel('https://www.youtube.com/channel/HCtnHdj3df7iM/videos')
Add tests for YoutubeChannelIE - tests for identifying channel urls - test retrieval of paginated channel - test retrieval of autogenerated channel
2013-04-20 06:06:28 +08:00
[youtube] Urls like youtube.com/NASA are now interpreted as users (fixes #1069) Video urls like http://youtube.com/BaW_jenozKc are not valid, but http://youtu.be/BaW_jenozKc is correct.
2013-09-06 04:38:23 +08:00
def test_youtube_user_matching(self):
self.assertMatch('www.youtube.com/NASAgovVideo/videos', ['youtube:user'])
[youtube] Fix detection of feeds urls (fixes #1294) Urls like https://www.youtube.com/feed/watch_later were being as users (before the last changes to YoutubeUserIE, as videos)
2013-09-06 20:38:41 +08:00
def test_youtube_feeds(self):
self.assertMatch('https://www.youtube.com/feed/watch_later', ['youtube:watch_later'])
self.assertMatch('https://www.youtube.com/feed/subscriptions', ['youtube:subscriptions'])
self.assertMatch('https://www.youtube.com/feed/recommended', ['youtube:recommended'])
self.assertMatch('https://www.youtube.com/my_favorites', ['youtube:favorites'])
[youtube] Fix some issues with the detection of playlist/channel urls (reported in #1374) They were being caught by YoutubeUserIE, now it only extracts a url if the rest of extractors aren't suitable. Now the url tests check that the urls can only be extracted with an specific extractor.
2013-09-06 22:24:24 +08:00
def test_youtube_show_matching(self):
self.assertMatch('http://www.youtube.com/show/airdisasters', ['youtube:show'])
[youtube] Match more truncated URLs (Closes #2402)
2014-02-17 21:56:21 +08:00
def test_youtube_truncated(self):
self.assertMatch('http://www.youtube.com/watch?', ['youtube:truncated_url'])
[youtube] Add support for search result URLs (Fixes #2495)
2014-03-04 10:32:28 +08:00
def test_youtube_search_matching(self):
self.assertMatch('http://www.youtube.com/results?search_query=making+mustard', ['youtube:search_url'])
self.assertMatch('https://www.youtube.com/results?baz=bar&search_query=youtube-dl+test+video&filters=video&lclk=video', ['youtube:search_url'])
Merge within test_all_urls
2013-06-04 19:06:49 +08:00
def test_justin_tv_channelid_matching(self):
[test_all_urls] Simplify
2014-04-19 19:01:15 +08:00
self.assertTrue(JustinTVIE.suitable('justin.tv/vanillatv'))
self.assertTrue(JustinTVIE.suitable('twitch.tv/vanillatv'))
self.assertTrue(JustinTVIE.suitable('www.justin.tv/vanillatv'))
self.assertTrue(JustinTVIE.suitable('www.twitch.tv/vanillatv'))
self.assertTrue(JustinTVIE.suitable('http://www.justin.tv/vanillatv'))
self.assertTrue(JustinTVIE.suitable('http://www.twitch.tv/vanillatv'))
self.assertTrue(JustinTVIE.suitable('http://www.justin.tv/vanillatv/'))
self.assertTrue(JustinTVIE.suitable('http://www.twitch.tv/vanillatv/'))
Merge within test_all_urls
2013-06-04 19:06:49 +08:00
def test_justintv_videoid_matching(self):
[test_all_urls] Simplify
2014-04-19 19:01:15 +08:00
self.assertTrue(JustinTVIE.suitable('http://www.twitch.tv/vanillatv/b/328087483'))
Merge within test_all_urls
2013-06-04 19:06:49 +08:00
def test_justin_tv_chapterid_matching(self):
[test_all_urls] Simplify
2014-04-19 19:01:15 +08:00
self.assertTrue(JustinTVIE.suitable('http://www.twitch.tv/tsm_theoddone/c/2349361'))
Merge within test_all_urls
2013-06-04 19:06:49 +08:00
Allow ampersand right after ? in youtube URLs (Closes #602)
2012-12-27 12:31:36 +08:00
def test_youtube_extract(self):
[jadorecettepub] Add extractor (Fixes #2148)
2014-02-09 02:20:11 +08:00
assertExtractId = lambda url, id: self.assertEqual(YoutubeIE.extract_id(url), id)
[youtube] Modify the regex to match ids of length 11 (fixes #1396) In urls like http://www.youtube.com/watch?v=BaW_jenozKcsharePLED17F32AD9753930 you can't split the query string and ids always have that length.
2013-09-09 16:33:12 +08:00
assertExtractId('http://www.youtube.com/watch?&v=BaW_jenozKc', 'BaW_jenozKc')
assertExtractId('https://www.youtube.com/watch?&v=BaW_jenozKc', 'BaW_jenozKc')
assertExtractId('https://www.youtube.com/watch?feature=player_embedded&v=BaW_jenozKc', 'BaW_jenozKc')
assertExtractId('https://www.youtube.com/watch_popup?v=BaW_jenozKc', 'BaW_jenozKc')
assertExtractId('http://www.youtube.com/watch?v=BaW_jenozKcsharePLED17F32AD9753930', 'BaW_jenozKc')
assertExtractId('BaW_jenozKc', 'BaW_jenozKc')
Allow ampersand right after ? in youtube URLs (Closes #602)
2012-12-27 12:31:36 +08:00
[facebook] Recognize #! URLs (Fixes #1988)
2013-12-17 04:10:06 +08:00
def test_facebook_matching(self):
[pbs] Add support for viralplayer links (Fixes #2350)
2014-02-09 01:37:33 +08:00
self.assertTrue(FacebookIE.suitable('https://www.facebook.com/Shiniknoh#!/photo.php?v=10153317450565268'))
[facebook] Recognize #! URLs (Fixes #1988)
2013-12-17 04:10:06 +08:00
Make sure that IEs only accept their own URLs
2013-06-28 03:21:54 +08:00
def test_no_duplicates(self):
ies = gen_extractors()
[test_all_urls] Add support for distributed URL matching test definition
2014-04-20 01:41:06 +08:00
for tc in gettestcases(include_onlymatching=True):
Make sure that IEs only accept their own URLs
2013-06-28 03:21:54 +08:00
url = tc['url']
for ie in ies:
[facebook] Recognize #! URLs (Fixes #1988)
2013-12-17 04:10:06 +08:00
if type(ie).__name__ in ('GenericIE', tc['name'] + 'IE'):
Make sure that IEs only accept their own URLs
2013-06-28 03:21:54 +08:00
self.assertTrue(ie.suitable(url), '%s should match URL %r' % (type(ie).__name__, url))
else:
self.assertFalse(ie.suitable(url), '%s should not match URL %r' % (type(ie).__name__, url))
[youtube:subscriptions] Use colon for differentiation of shortcuts
2013-07-07 23:13:26 +08:00
def test_keywords(self):
[youtube] Urls like youtube.com/NASA are now interpreted as users (fixes #1069) Video urls like http://youtube.com/BaW_jenozKc are not valid, but http://youtu.be/BaW_jenozKc is correct.
2013-09-06 04:38:23 +08:00
self.assertMatch(':ytsubs', ['youtube:subscriptions'])
self.assertMatch(':ytsubscriptions', ['youtube:subscriptions'])
[youtube] Add an extractor for downloading the watch history (closes #1821)
2013-11-24 21:33:50 +08:00
self.assertMatch(':ythistory', ['youtube:history'])
Update the keywords tests for the rename of the old ComedyCentralIE
2013-11-25 05:13:20 +08:00
self.assertMatch(':thedailyshow', ['ComedyCentralShows'])
self.assertMatch(':tds', ['ComedyCentralShows'])
self.assertMatch(':colbertreport', ['ComedyCentralShows'])
self.assertMatch(':cr', ['ComedyCentralShows'])
[youtube:subscriptions] Use colon for differentiation of shortcuts
2013-07-07 23:13:26 +08:00
[vimeo] Add an extractor for users (closes #1871)
2013-12-02 05:36:18 +08:00
def test_vimeo_matching(self):
self.assertMatch('http://vimeo.com/channels/tributes', ['vimeo:channel'])
[vimeo] Now VimeoIE doesn't match urls of channels with a numeric id (fixes #2552)
2014-03-12 21:20:51 +08:00
self.assertMatch('http://vimeo.com/channels/31259', ['vimeo:channel'])
self.assertMatch('http://vimeo.com/channels/31259/53576664', ['vimeo'])
[vimeo] Add an extractor for users (closes #1871)
2013-12-02 05:36:18 +08:00
self.assertMatch('http://vimeo.com/user7108434', ['vimeo:user'])
[vimeo] Fix playlist URL matching
2014-01-07 14:13:42 +08:00
self.assertMatch('http://vimeo.com/user7108434/videos', ['vimeo:user'])
self.assertMatch('https://vimeo.com/user21297594/review/75524534/3c257a1b5d', ['vimeo:review'])
[vimeo] Add an extractor for users (closes #1871)
2013-12-02 05:36:18 +08:00
[soundcloud] Do not match sets (Fixes #1930)
2013-12-10 02:57:00 +08:00
# https://github.com/rg3/youtube-dl/issues/1930
def test_soundcloud_not_matching_sets(self):
self.assertMatch('http://soundcloud.com/floex/sets/gone-ep', ['soundcloud:set'])
Make sure that IEs only accept their own URLs
2013-06-28 03:21:54 +08:00
[tumblr] Test new URL format (#2255)
2014-01-28 10:37:23 +08:00
def test_tumblr(self):
self.assertMatch('http://tatianamaslanydaily.tumblr.com/post/54196191430/orphan-black-dvd-extra-behind-the-scenes', ['Tumblr'])
self.assertMatch('http://tatianamaslanydaily.tumblr.com/post/54196191430', ['Tumblr'])
[pbs] Add support for viralplayer links (Fixes #2350)
2014-02-09 01:37:33 +08:00
def test_pbs(self):
# https://github.com/rg3/youtube-dl/issues/2350
self.assertMatch('http://video.pbs.org/viralplayer/2365173446/', ['PBS'])
[pbs] Add support for widget URLs (Fixes #2594)
2014-03-21 07:46:32 +08:00
self.assertMatch('http://video.pbs.org/widget/partnerplayer/980042464/', ['PBS'])
[pbs] Add support for viralplayer links (Fixes #2350)
2014-02-09 01:37:33 +08:00
[comedycentral] Add a testcase for extended-interviews URLs (#2636)
2014-03-27 09:02:48 +08:00
def test_ComedyCentralShows(self):
[comedycentral] Add support for /videos URLs (Fixes #2660)
2014-04-01 06:02:29 +08:00
self.assertMatch(
'http://thedailyshow.cc.com/extended-interviews/xm3fnq/andrew-napolitano-extended-interview',
['ComedyCentralShows'])
self.assertMatch(
'http://thecolbertreport.cc.com/videos/29w6fx/-realhumanpraise-for-fox-news',
['ComedyCentralShows'])
[comedycentral] Allow URLs with query parts (fixes #2661)
2014-04-01 06:25:11 +08:00
self.assertMatch(
'http://thecolbertreport.cc.com/videos/gh6urb/neil-degrasse-tyson-pt--1?xrs=eml_col_031114',
['ComedyCentralShows'])
[comedycentral] Add test for #2677
2014-04-03 21:31:04 +08:00
self.assertMatch(
'http://thedailyshow.cc.com/guests/michael-lewis/3efna8/exclusive---michael-lewis-extended-interview-pt--3',
['ComedyCentralShows'])
[comedycentral] Match more URLs Looks like they only offer clips instead of full episodes now. We'll need to add new parsing code as well.
2014-04-09 17:43:13 +08:00
self.assertMatch(
'http://thedailyshow.cc.com/episodes/sy7yv0/april-8--2014---denis-leary',
['ComedyCentralShows'])
self.assertMatch(
'http://thecolbertreport.cc.com/episodes/8ase07/april-8--2014---jane-goodall',
['ComedyCentralShows'])
self.assertMatch(
'http://thedailyshow.cc.com/video-playlists/npde3s/the-daily-show-19088-highlights',
['ComedyCentralShows'])
[comedycentral:shows] Add support for TDS special editions (Fixes #2733)
2014-04-11 15:30:07 +08:00
self.assertMatch(
'http://thedailyshow.cc.com/special-editions/2l8fdb/special-edition---a-look-back-at-food',
['ComedyCentralShows'])
[comedycentral] Add a testcase for extended-interviews URLs (#2636)
2014-03-27 09:02:48 +08:00
[yahoo] Support https and -uploader URLs (Fixes #2701)
2014-04-05 04:23:59 +08:00
def test_yahoo_https(self):
# https://github.com/rg3/youtube-dl/issues/2701
self.assertMatch(
'https://screen.yahoo.com/smartwatches-latest-wearable-gadgets-163745379-cbs.html',
['Yahoo'])
[test_all_urls] Add support for distributed URL matching test definition
2014-04-20 01:41:06 +08:00
Let youtube IE handle IDs starting with PL (Closes #572)
2012-12-04 17:59:38 +08:00
if __name__ == '__main__':
unittest.main()
Reference in New Issue Copy Permalink