246168bd72
Remove unused imports
2014-07-20 23:38:44 +02:00
2c57c7fa5a
[youtube] Fix extraction of age gate videos ( closes #3270 )
...
Setting the correct value of the 'sts' paramater in the 'get_video_info' url gives the correct urls.
Removed parameters that are not needed.
2014-07-20 21:05:02 +02:00
b8c74d606a
[youtube] fix display of swf player id
2014-07-20 20:20:42 +02:00
5425626790
[youtube] Move swfinterp into its own file
2014-07-18 10:24:28 +02:00
5dc3552d85
[youtube] Add support for classes in swf parser
2014-07-18 00:54:17 +02:00
3fbd27f73e
[youtube] SWF parser: Add opcode 86
...
Yes, I know we need 96, but an implementation of 86 could help avoid a similar issue.
2014-07-17 23:22:49 +02:00
cf01013161
[youtube] Find more swf players ( Closes #3270 , refer #3271 )
2014-07-17 16:28:36 +02:00
c8bf86d50d
[youtube] Correct signature extraction error detection
2014-07-11 10:44:39 +02:00
b3a8878080
[youtube] Remove static signatures
...
The always fail by now. Instead, use only automatic signature extraction
2014-07-11 10:23:19 +02:00
6feb2d5e80
[youtube:search_url] Update regexes
2014-07-04 19:21:19 +07:00
dc2fc73691
[youtube:truncated_url] Move test to extractor
2014-07-01 15:49:34 +02:00
c4808c6009
[youtube_truncated_url] Add support for truncated watch URLs with annotations ( #3178 )
2014-07-01 15:49:16 +02:00
18061bbab0
[Youtube] add DASH format 272 ( fixes #3128 )
2014-06-21 12:03:27 +02:00
c26e9ac4b2
[youtube] Recognize signature functions that contain '$' ( fixes #3104 )
2014-06-19 16:42:49 +02:00
7d568f5ab8
[Youtube] Recognize playlists with LL
2014-06-14 13:23:28 +02:00
3c80377b69
[Youtube] Add format code 271 (1440p webm)
2014-06-07 14:31:10 +02:00
70e322695d
[youtube:playlist] Fix mixes extraction ( fixes #3051 )
...
The username seems to be empty now.
2014-06-05 21:23:27 +02:00
263bd4ec50
Recognize a third format of the upload_date in the 'watch-uploader-info' element
2014-06-02 13:30:23 +04:00
76e92371ac
[youtube] Recognize a second format of the upload_date in the 'watch-uploader-info' element ( #2911 )
2014-05-16 22:12:52 +02:00
05ee2b6dad
[youtube] Fix extraction of the feed 'paging' values ( fixes #2925 )
2014-05-16 16:01:13 +02:00
beee53de06
[youtube] Look for published-on date if uploaded-on is not found
...
Fixes #2911
2014-05-16 13:21:44 +02:00
01ed5c9be3
[youtube] Fix typo
2014-05-15 13:43:29 +02:00
ad3bc6acd5
Document and test categories ( #2923 )
2014-05-15 12:41:42 +02:00
ec8deefc27
[youtube] Video categories added to metadata
2014-05-15 13:59:27 +07:00
e399853d0c
[youtube:playlist] Improve detection of private lists ( #2840 )
2014-05-12 07:59:33 +02:00
10c0e2d818
[youtube:playlist] Raise an error if the list doesn't exist or is private ( closes #2840 )
2014-05-01 15:40:35 +02:00
e75cafe9fb
Clean up format list for consistency
...
This should make the format list output look a bit nicer.
2014-04-30 01:52:05 +02:00
aa92f06308
[youtube] Don't call 'unquote_plus' on the video title ( fixes #2799 )
...
It's already unquoted after calling 'compat_parse_qs'.
It replaced '+' with spaces, for example in https://www.youtube.com/watch?v=XC0b5YexO-I .
2014-04-25 13:19:03 +02:00
e00c9cf599
[youtube] Update test description field
2014-04-25 13:14:15 +02:00
ba60a3ebe0
[youtube] Update test description field
2014-04-25 12:57:04 +02:00
d11271dd29
[youtube] Include video Id in common error message ( Fixes #2786 )
2014-04-21 20:34:03 +02:00
1db2666916
[youtube:playlist] Correct playlist ID output
...
The ID now starts with PL, so we don't need to output that twice.
2014-04-15 17:55:52 +02:00
b9c76aa1a9
[youtube] Add support for cleanvideosearch.com ( Fixes #2734 )
2014-04-11 13:53:05 +02:00
68eb8e90e6
[youtube:playlist] Fix playlists for logged-in users ( Fixes #2690 )
2014-04-04 02:23:36 +02:00
e45d40b171
[youtube:subscriptions] Add space to the description
2014-04-03 15:13:52 +02:00
f6177462db
[youtube] feeds: Also look for the html in the 'content_html' field ( fixes #2671 )
2014-04-02 14:13:08 +02:00
5912c639df
[youtube] Transform google's JSON dialect ( fixes #2663 )
2014-04-01 05:56:56 +02:00
83d548ef0f
[youtube] Encode ytsearch query
2014-03-30 15:57:35 +02:00
acd213ed6d
Remove unusued imports
2014-03-30 07:16:07 +02:00
2b25cb5d76
[youtube] Move JavaScript interpreter into its own module
2014-03-30 07:02:58 +02:00
43b81eb98a
[youtube] Remove useless resolution fields from format definitions
...
These can be - and are - calculated automatically by the YoutubeDL core.
2014-03-22 14:22:41 +01:00
278229d195
itag 160 is 144p, not 192p
2014-03-22 12:15:45 +01:00
7e8c0af004
Add --prefer-insecure option ( Fixes #2364 )
2014-03-21 00:37:10 +01:00
bc6d597828
Add bestvideo and worstvideo to special format names ( #2163 )
2014-03-14 17:01:47 +01:00
ae7ed92057
[youtube] Fix up invalid JSON
2014-03-10 13:35:45 +01:00
c9ae7b9565
[youtube] Add support for search result URLs ( Fixes #2495 )
2014-03-04 03:32:28 +01:00
60d3a2e0f8
Fix incorrect format codes
...
Corrects the descriptions for the DASH video format codes 264 and 138
(1440p and 2160p, respectively).
2014-02-24 21:29:37 -05:00
a2dafe2887
[youtube] Fix mix video regex
...
Attributes' order in <li> is arbitrary and changes every time playlist
page is fetched, so we can't rely on `data-index` to be before
`data-video-username`.
2014-02-24 12:52:02 +07:00
bc2f773b4f
[youtube:playlist] Fix mixes extraction ( fixes #2444 )
2014-02-23 17:17:36 +01:00
521ee82334
Fix imports
2014-02-22 23:03:12 +01:00
3489b7d26c
[youtube] Simplify the decryption process for the manifest urls and add a test ( closes #2422 )
2014-02-21 15:15:58 +01:00
acd2bcc384
Merge branch 'youtube-dash' of github.com:m0vie/youtube-dl
2014-02-21 15:02:47 +01:00
dbb94fb044
[youtube] Fix playlist extraction ( Closes #2423 , #2424 , #2425 )
2014-02-21 17:19:55 +07:00
d68f0cdb23
[youtube] decrypt signature when downloading dash manifest
2014-02-21 03:24:56 +01:00
f7000f3a1b
[youtube] Add support for yourepeat.com URLs ( Closes #2397 )
2014-02-19 02:00:54 +07:00
2eb5d315d4
[youtube] Match more truncated URLs ( Closes #2402 )
2014-02-17 14:56:21 +01:00
07ad22b8af
[youtube:search] Mark "no results found" error as expected
2014-02-15 16:30:11 +01:00
e70dc1d14b
[youtube] Correct a minor regex typo
2014-02-10 01:30:47 +01:00
81c2f20b53
[youtube] Correct invalid JSON ( Fixes #2353 )
2014-02-09 17:56:10 +01:00
9766538124
[jadorecettepub] Add extractor ( Fixes #2148 )
2014-02-08 19:20:23 +01:00
d67cc9fa7c
[youtube:playlist] Recognize ‘top tracks’ urls ( closes #2332 )
...
The list parameter starts with ‘MC’ and can have more characters after it, including dots
2014-02-06 19:46:26 +01:00
20650c8654
[youtube] signatures: Recognize javascript functions that contain “$” ( fixes #2304 )
2014-02-04 21:38:50 +01:00
b11cec4162
[youtube:user] Fix id key ( Fixes #1745 )
2014-01-29 11:16:12 +01:00
5700e7792a
[youtube] Encode the data when submitting the form for confirming the age
...
Needed on python 3
2014-01-25 17:22:41 +01:00
38c2e5b8d5
[youtube] Use https: in more urls
2014-01-25 17:11:55 +01:00
beddbc2ad1
[youtube:toplist] Make the regex for finding the playlist link more flexible
...
`title={foo}` may not be at the end of the `href` string.
2014-01-25 15:47:03 +01:00
2c5bae429a
[youtube] Fix new formats
2014-01-24 00:06:26 +01:00
1394ce65b4
[youtube] Add new formats ( Fixes #2221 )
2014-01-23 23:54:06 +01:00
0b65e5d40f
[youtube] Do not break upon unknown formats
2014-01-23 23:21:42 +01:00
975d35dbab
[youtube:truncated_url] Also match mail subscription links ( #2214 )
2014-01-23 16:14:54 +01:00
4919603f66
[youtube] Make DASH manifest download conditional for now
...
DASH download fails on many videos (all with encrypted signatures? not sure yet), for example 07FYdnEawAQ, with a 403.
2014-01-22 21:56:38 +01:00
65697b3bf3
Merge branch 'paged-lists'
...
Conflicts:
test/test_utils.py
youtube_dl/extractor/youtube.py
2014-01-22 20:00:16 +01:00
50317b111d
Merge branch 'youtube-dash-manifest'
...
Conflicts:
youtube_dl/extractor/youtube.py
2014-01-22 19:58:31 +01:00
b7ab059084
Add infrastructure for paged lists
...
This commit allows to download pages in playlists as needed instead of all at once.
Before this commit,
youtube-dl http://www.youtube.com/user/ANNnewsCH/videos --playlist-end 2 --skip-download
took quite some time - now it's almost instantaneous.
As an example, the youtube:user extractor has been converted.
Fixes #2175
2014-01-20 11:36:47 +01:00
c91778f8c0
[youtube] Fall back to header if playlist title is not available
...
Sometimes (in about 10% of requests), the og:title is missing for a weird reason.
See #2170 for an example
2014-01-20 02:45:51 +01:00
dd27fd1739
[youtube] Download DASH manifest
...
If given, download and parse the DASH manifest file, in order to get ultra-HQ formats.
Fixes #2166
2014-01-19 05:47:20 +01:00
484aaeb204
[everyonesmixtape] Add support ( Fixes #2161 )
2014-01-17 02:56:13 +01:00
ce6b9a2dba
[youtube] Add a pseudo format for rtmp videos ( #2123 )
2014-01-09 02:38:50 +01:00
c3197e3e5c
[youtube] Correct subtitle URL ( Fixes #2120 )
2014-01-09 01:36:21 +01:00
b4622a328b
Use double quotes in error message ( #2112 )
...
On Windows, double quotes are required, because single quotes get served to youtube-dl. (Yes, cmd.exe is crazy like that).
On other system, both double and single quotes are fine, unless the string contains a dollar sign (then you need single quotes).
Since virtually no URLs contain dollar signs, double quotes should do.
2014-01-08 00:05:11 +01:00
8fa8a6299b
[youtube] Add itag 264 ( closes #2063 )
...
It has a better bitrate than 137 but the same resolution
2014-01-01 13:45:33 +01:00
2c62dc26c8
[youtube] Simplify format specification
2013-12-24 12:34:09 +01:00
4bcc7bd1f2
Add temporary _sort_formats helper function
2013-12-24 12:31:42 +01:00
d80044c235
[youtube] Prefer videos with sound
2013-12-23 04:51:42 +01:00
f82b18efc1
Merge remote-tracking branch 'rzhxeo/youtube'
2013-12-23 04:37:40 +01:00
e302f9ce32
[youtube:user] Speed up --match-title
2013-12-22 03:57:42 +01:00
e56f22ae20
[YoutubeIE] Sort formats by resolution
2013-12-18 21:22:37 +01:00
dbd1988ed9
[YoutubeIE] Add width and height to format dict
2013-12-18 21:21:25 +01:00
4ea3be0a5c
[YoutubeIE] Externalize format selection
2013-12-18 03:30:55 +01:00
46374a56b2
[youtube] Do not warn for videos with allow_rating=0
...
This fixes #1982
Test video: http://www.youtube.com/watch?v=gi2uH3YxohU
2013-12-17 02:49:56 +01:00
b466b7029d
[youtube] Make duration an integer or None
2013-12-16 04:09:05 +01:00
ffa8f0df0a
Merge remote-tracking branch 'jaimeMF/yt-toplists'
2013-12-09 04:49:32 +01:00
7cc3570e53
Add fatal=False parameter to _download_* functions.
...
This allows us to simplify the calls in the youtube extractor even further.
2013-12-09 01:49:03 +01:00
baa7b1978b
Remove the calls to 'compat_urllib_request.urlopen' in a few extractors
2013-12-08 22:24:55 +01:00
31812a9e0e
[youtube:channel] Fix automated channel detection
2013-12-08 07:30:42 +01:00
715c8e7bdb
[youtube:playlist] Recognize mix ids for direct use ( fixes #1295 )
2013-12-06 19:52:41 +01:00
7d4afc557f
[youtube:playlist] Support mix ids longer than 13 ( #1295 )
2013-12-06 19:48:54 +01:00
336c3a69bd
[youtube] Extract like and dislike count ( #1895 )
2013-12-06 13:22:27 +01:00
27dcce1904
[youtube] Resolve URLs in comments
2013-12-04 14:18:49 +01:00
cb7fb54600
Change the ie_name of YoutubeSearchDateIE
...
It produced a duplicate entry when listing the extractors with '--list-extractors' and generates noise in the commit log when generating the supported sites webpage (like in 09f355f73bf1657ecacfd05eda21d2c4bf1cc4a8)
2013-12-03 13:55:25 +01:00
0a688bc0b2
[youtube] Add support for downloading top lists ( fixes #1868 )
...
It needs to know the channel and the title of the list, because the ids change every time you browse the channels and are attached to a 'VISITOR_INFO1_LIVE' cookie.
2013-11-30 14:56:51 +01:00
0e44d8381a
[youtube:feeds] Use the 'paging' value from the downloaded json information ( fixes #1845 )
2013-11-28 00:33:27 +01:00
76d1700b28
[youtube:playlist] Fix the extraction of the title for some mixes ( #1844 )
...
Like https://www.youtube.com/watch?v=g8jDB5xOiuE&list=RDIh2gxLqR7HM
2013-11-27 20:01:51 +01:00
652cdaa269
[youtube:playlist] Add support for YouTube mixes ( fixes #1839 )
2013-11-26 21:35:03 +01:00
e26f871228
Use the new '_download_xml' helper in more extractors
2013-11-26 19:17:25 +01:00
6e47b51eef
[youtube:playlist] Remove the link with index 0
...
It's not the first video of the playlist, it appears in the 'Play all' button (see the test course for an example)
2013-11-26 19:09:14 +01:00
ea36cbac5e
Merge remote-tracking branch 'rbrito/swap-dimensions'
2013-11-25 06:19:15 +01:00
f459d17018
[youtube] Add an extractor for downloading the watch history ( closes #1821 )
2013-11-24 14:33:50 +01:00
66ec019240
[youtube] do not use variable name twice
2013-11-24 06:54:26 +01:00
7012b23c94
Match --download-archive during playlist processing ( Fixes #1745 )
2013-11-22 22:46:46 +01:00
3f8ced5144
Merge remote-tracking branch 'jaimeMF/yt-playlists'
2013-11-22 20:11:54 +01:00
cb7dfeeac4
[youtube] only allow domain name to be upper-case ( #1786 )
2013-11-18 16:42:35 +01:00
83aa529330
Support protocol-independent URLs ( #1787 )
2013-11-18 13:18:17 +01:00
fccd377198
Suppor embed-only videos ( Fixes #1746 )
2013-11-18 13:05:18 +01:00
1d699755e0
[youtube] Add view_count ( Fixes #1781 )
2013-11-17 11:06:16 +01:00
b9643eed7c
[youtube:channel] Fix the extraction of autogenerated channels
...
The ajax pages are empty, now it looks directly in the channel's /videos page
2013-11-15 11:51:45 +01:00
0e145dd541
Merge branch 'master' of github.com:rg3/youtube-dl
2013-11-15 01:46:50 +01:00
9f9be844fc
[youtube] Fix protocol-independent URLs ( Fixes #1768 )
2013-11-15 01:45:39 +01:00
ca715127a2
Don't assume the 'subtitlesformat' is set in the params dict ( fixes #1750 )
2013-11-13 17:14:10 +01:00
880e1c529d
[youtube:playlist] Login into youtube if requested ( fixes #1757 )
...
Allows to download private playlists
2013-11-13 16:39:11 +01:00
dcbb45803f
[youtube:playlist] Don't use the gdata api ( closes #1508 )
...
Parse the playlist pages instead
2013-11-13 16:26:50 +01:00
231516b6c9
Merge pull request #1705 from iemejia/master
...
[ted] support for subtitles
2013-11-10 11:54:18 +01:00
4f045eef8f
[youtube:channel] Fix the extraction
...
The page don't include the 'load more' button anymore, now we directly get the 'c4_browse_ajax' pages.
2013-11-06 21:42:33 +01:00
08fb86c49b
[youtube] Add description for YoutubeSearchDateIE ( #1710 )
2013-11-03 15:59:10 +01:00
3633d77c0f
Merge remote-tracking branch 'CBGoodBuddy/ytsearchtime'
2013-11-03 15:56:55 +01:00
9103bbc5cd
Add the 'webpage_url' field to info_dict
...
The url for the video page, it must allow to reproduce the result.
It's automatically set by YoutubeDL if it's missing.
2013-11-03 12:11:13 +01:00
a3dd924871
Add YoutubeSearchDateIE extractor to youtube.py & __init__.py, which searches by publication date.
2013-11-02 22:40:48 -04:00
cf51923545
[youtube] Remove vevo test
...
The video is no longer available and it seems that vevo video don't use encrypted signatures anymore.
2013-11-02 20:46:26 +01:00
38db46794f
Merge branch 'ted_subtitles'
2013-11-02 19:50:45 +01:00
1f343eaabb
[subtitles] refactor to support websites with subtitle information the
...
webpage.
I added the parameter webpage, so now it's similar to the way automatic
captions are handled. This is an improvement needed for websites like
TED.
2013-11-02 19:29:25 +01:00
8eddf3e91d
[youtube] Encode subtitle track name in request ( Fixes #1700 )
2013-11-02 11:21:05 +01:00
795f28f871
[youtube] Fix login ( Fixes #1681 )
2013-10-29 06:45:54 +01:00
600cc1a4f0
[youtube] Set the format_id field to the itag of the format ( closes #1624 )
2013-10-25 17:17:46 +02:00
ea32fbacc8
Fix the extensions of two tests with youtube videos
...
The best quality is now a mp4 video.
2013-10-25 16:55:37 +02:00
00fe14fc75
[youtube] Also use the 'adaptative_fmts' field from the /get_video_info page ( fixes #1649 )
...
The 'adaptative_fmts' field from the video page is not added to the 'url_encoded_fmt_stream_map'
2013-10-25 16:52:58 +02:00
6803655ced
Merge pull request #1622 from rbrito/fix-extension
...
extractor: youtube: Set extension of AAC audio formats to m4a.
2013-10-22 15:16:26 -07:00
f6a54188c2
[youtube] Use 'node is None' when checking if the video has automatic captions
...
It had stopped working and it reports a FutureWarning
2013-10-21 16:28:55 +02:00
d5a9bb4ea9
extractor: youtube: Swap video dimensions to match standard practice.
...
While working on this, I thought about simplifying things like changing
480x854 to 480p, and that seemed like a good option, until I realized that
people (me included) usually link the concept of some number followed by a p
with the video being 16:9.
So, we would be losing some information and, as we all know,
[explicit is better than implicit][*].
[*]: http://www.python.org/dev/peps/pep-0020/
This closes #1446 .
Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
2013-10-19 14:04:44 -03:00
f6f1fc9286
extractor: youtube: Fix extension of dash formats.
...
While we are at it, separate the audio formats from the video formats.
Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
2013-10-18 18:53:00 -03:00
16f36a6fc9
extractor: youtube: Set extension of AAC audio formats to m4a.
...
This, in particular, eases downloading both audio and videos in DASH formats
before muxing them, which alleviates the problem that I exposed on issue
Furthermore, one may argue that this is, indeed, the case for correctness's
sake.
Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
2013-10-18 17:50:55 -03:00
a733eb6c53
[youtube] Do not crash if caption info is missing altogether ( Fixes #1610 )
2013-10-17 02:19:19 +02:00
1fb07d10a3
[youtube] Adds #1312 Download annotations
...
Adds #1321 Download annotations from youtube
Annotations are downloaded and written to a .annotations.xml file using the https://www.youtube.com/annotations_invideo?features=1&legacy=1&video_id=$VIDEOID API.
Added unit test for annotations.
2013-10-14 16:22:27 +11:00
57da92b7df
[youtube] Do not recognize attribution link as user ( Fixes #1573 )
2013-10-09 23:50:38 +02:00
a34c2faae4
[youtube] set the 'name' parameter in the subtitles url ( fixes #1577 )
2013-10-09 16:41:36 +02:00
15870e90b0
Restore warning when user forgets to quote URL ( #1396 )
2013-10-07 12:21:24 +02:00
cfadd183c4
Call extracted property age_limit everywhere
2013-10-06 16:23:06 +02:00
8dbe9899a9
Allow users to specify an age limit ( fixes #1545 )
...
With these changes, users can now restrict what videos are downloaded by the intented audience, by specifying their age with --age-limit YEARS .
Add rudimentary support in youtube, pornotube, and youporn.
2013-10-06 06:08:56 +02:00
7f8ae73a5d
Include length in player cache ID
...
Some videos use the same player with IDs of multiple lengths.
See https://travis-ci.org/rg3/youtube-dl/jobs/12126506#L319 for an example.
2013-10-04 11:36:06 +02:00
c21315f273
[youtube] new static 82 signature
2013-10-04 00:43:01 +02:00
c38b1e776d
[youtube] Simplify cache_dir code ( #1529 )
2013-10-02 08:41:14 +02:00
Philipp Hagemeister