Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.lang.python > #54832 > unrolled thread

Download all youtube favorites with youtube-dl script

Started byBill <Bill@bill.com>
First post2013-09-26 16:13 +0100
Last post2013-09-27 22:19 +0200
Articles 9 — 6 participants

Back to article view | Back to comp.lang.python

Contents

  Download all youtube favorites with youtube-dl script Bill <Bill@bill.com> - 2013-09-26 16:13 +0100
    Re: Download all youtube favorites with youtube-dl script Joel Goldstick <joel.goldstick@gmail.com> - 2013-09-26 11:21 -0400
      Re: Download all youtube favorites with youtube-dl script Bill <bill@bill.com> - 2013-09-26 19:14 +0100
        Re: Download all youtube favorites with youtube-dl script MRAB <python@mrabarnett.plus.com> - 2013-09-26 19:33 +0100
    Re: Download all youtube favorites with youtube-dl script Philipp Hagemeister <phihag@phihag.de> - 2013-09-26 17:35 +0200
      Re: Download all youtube favorites with youtube-dl script Bill <bill@bill.com> - 2013-09-26 19:15 +0100
    Re: Download all youtube favorites with youtube-dl script Thomas Kandler <hallo@thomaskandler.net> - 2013-09-27 09:27 +0200
      Re: Download all youtube favorites with youtube-dl script Bill <bill@bill.com> - 2013-09-27 20:50 +0100
        Re: Download all youtube favorites with youtube-dl script Thomas Kandler <hallo@thomaskandler.net> - 2013-09-27 22:19 +0200

#54832 — Download all youtube favorites with youtube-dl script

FromBill <Bill@bill.com>
Date2013-09-26 16:13 +0100
SubjectDownload all youtube favorites with youtube-dl script
Message-ID<AaY0u.152844$6P7.33824@fx26.am4>
I have been using the script youtube-dl http://rg3.github.io/youtube-dl/

And I was wondering if there is a way to download all of a user's 
favorites or uploads.

The script has a functionality to download all videos in a txt file. So 
if there is a way using the youtube API or JSON (none of which I am 
familiar with) to bring up a list of all these videos then it'd be a 
simple case putting these urls into a file.

The problem is youtube displays favorites or user uploads in pages or 
infinite scroll. So it is difficult to access them by the BeautifulSoup 
module.


What do you suggest?

[toc] | [next] | [standalone]

#54834

FromJoel Goldstick <joel.goldstick@gmail.com>
Date2013-09-26 11:21 -0400
Message-ID<mailman.357.1380208880.18130.python-list@python.org>
In reply to#54832

[Multipart message — attachments visible in raw view] — view raw

On Thu, Sep 26, 2013 at 11:13 AM, Bill <Bill@bill.com> wrote:

> I have been using the script youtube-dl http://rg3.github.io/youtube-**dl/<http://rg3.github.io/youtube-dl/>
>
> And I was wondering if there is a way to download all of a user's
> favorites or uploads.
>
> The script has a functionality to download all videos in a txt file. So if
> there is a way using the youtube API or JSON (none of which I am familiar
> with) to bring up a list of all these videos then it'd be a simple case
> putting these urls into a file.
>
> The problem is youtube displays favorites or user uploads in pages or
> infinite scroll. So it is difficult to access them by the BeautifulSoup
> module.
>
>
> What do you suggest?
> --
> https://mail.python.org/**mailman/listinfo/python-list<https://mail.python.org/mailman/listinfo/python-list>
>

Have you looked at the youtube API?  That would be better than screen
scraping.  https://developers.google.com/youtube/getting_started


-- 
Joel Goldstick
http://joelgoldstick.com

[toc] | [prev] | [next] | [standalone]

#54845

FromBill <bill@bill.com>
Date2013-09-26 19:14 +0100
Message-ID<eQ_0u.115750$G02.26251@fx13.am4>
In reply to#54834
Joel Goldstick wrote:
>
>
>
> On Thu, Sep 26, 2013 at 11:13 AM, Bill <Bill@bill.com
> <mailto:Bill@bill.com>> wrote:
>
>     I have been using the script youtube-dl
>     http://rg3.github.io/youtube-__dl/ <http://rg3.github.io/youtube-dl/>
>
>     And I was wondering if there is a way to download all of a user's
>     favorites or uploads.
>
>     The script has a functionality to download all videos in a txt file.
>     So if there is a way using the youtube API or JSON (none of which I
>     am familiar with) to bring up a list of all these videos then it'd
>     be a simple case putting these urls into a file.
>
>     The problem is youtube displays favorites or user uploads in pages
>     or infinite scroll. So it is difficult to access them by the
>     BeautifulSoup module.
>
>
>     What do you suggest?
>     --
>     https://mail.python.org/__mailman/listinfo/python-list
>     <https://mail.python.org/mailman/listinfo/python-list>
>
>
> Have you looked at the youtube API?  That would be better than screen
> scraping. https://developers.google.com/youtube/getting_started
>
>
> --
> Joel Goldstick
> http://joelgoldstick.com

I remember looking at this a while ago. These are the relevant sections 
of the API:

https://developers.google.com/youtube/2.0/developers_guide_protocol?hl=en#User_Uploaded_Videos

https://developers.google.com/youtube/2.0/developers_guide_protocol?hl=en#Favorite_Videos

The problem with the API is that with both of these, it only brings up 
25 videos e.g. https://gdata.youtube.com/feeds/api/users/scooby1961/uploads

Unless I'm missing something? There must be a way to bring up all of 
them on one page right? Or at least cycle through the rest of them.

Same problem with favorties: 
https://gdata.youtube.com/feeds/api/users/adambuxton/favorites/

[toc] | [prev] | [next] | [standalone]

#54847

FromMRAB <python@mrabarnett.plus.com>
Date2013-09-26 19:33 +0100
Message-ID<mailman.366.1380220411.18130.python-list@python.org>
In reply to#54845
On 26/09/2013 19:14, Bill wrote:
> Joel Goldstick wrote:
>>
>>
>>
>> On Thu, Sep 26, 2013 at 11:13 AM, Bill <Bill@bill.com
>> <mailto:Bill@bill.com>> wrote:
>>
>>     I have been using the script youtube-dl
>>     http://rg3.github.io/youtube-__dl/ <http://rg3.github.io/youtube-dl/>
>>
>>     And I was wondering if there is a way to download all of a user's
>>     favorites or uploads.
>>
>>     The script has a functionality to download all videos in a txt file.
>>     So if there is a way using the youtube API or JSON (none of which I
>>     am familiar with) to bring up a list of all these videos then it'd
>>     be a simple case putting these urls into a file.
>>
>>     The problem is youtube displays favorites or user uploads in pages
>>     or infinite scroll. So it is difficult to access them by the
>>     BeautifulSoup module.
>>
>>
>>     What do you suggest?
>>     --
>>     https://mail.python.org/__mailman/listinfo/python-list
>>     <https://mail.python.org/mailman/listinfo/python-list>
>>
>>
>> Have you looked at the youtube API?  That would be better than screen
>> scraping. https://developers.google.com/youtube/getting_started
>>
>>
>> --
>> Joel Goldstick
>> http://joelgoldstick.com
>
> I remember looking at this a while ago. These are the relevant sections
> of the API:
>
> https://developers.google.com/youtube/2.0/developers_guide_protocol?hl=en#User_Uploaded_Videos
>
> https://developers.google.com/youtube/2.0/developers_guide_protocol?hl=en#Favorite_Videos
>
> The problem with the API is that with both of these, it only brings up
> 25 videos e.g. https://gdata.youtube.com/feeds/api/users/scooby1961/uploads
>
> Unless I'm missing something? There must be a way to bring up all of
> them on one page right? Or at least cycle through the rest of them.
>
You _are_ missing something. That section of "#User_Uploaded_Videos"
mentions the parameters "start-index" and "max-results".

> Same problem with favorties:
> https://gdata.youtube.com/feeds/api/users/adambuxton/favorites/
>

[toc] | [prev] | [next] | [standalone]

#54837

FromPhilipp Hagemeister <phihag@phihag.de>
Date2013-09-26 17:35 +0200
Message-ID<mailman.359.1380211605.18130.python-list@python.org>
In reply to#54832
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512

Hi Bill,

the best way to ask for features or file bugs on youtube-dl is asking
us at http://github.com/rg3/youtube-dl/issues . Luckily, I this list
from time to time ;)

Simply use

youtube-dl --username user@gmail.com --password secret :ytfav

Best,

Philipp

On 09/26/2013 05:13 PM, Bill wrote:
> I have been using the script youtube-dl
> http://rg3.github.io/youtube-dl/
> 
> And I was wondering if there is a way to download all of a user's 
> favorites or uploads.
> 
> The script has a functionality to download all videos in a txt
> file. So if there is a way using the youtube API or JSON (none of
> which I am familiar with) to bring up a list of all these videos
> then it'd be a simple case putting these urls into a file.
> 
> The problem is youtube displays favorites or user uploads in pages
> or infinite scroll. So it is difficult to access them by the
> BeautifulSoup module.
> 
> 
> What do you suggest?

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.14 (GNU/Linux)

iQIcBAEBCgAGBQJSRFQmAAoJENtLVMukgmoYaz0P/ifoPqcx4dpShXyigwGxzhsa
ht8sjIP8n3bNJ+J7Jvx0uM6Sv/Hu/U1CC09G1pT9nquHDYYvmko+MoBkXbc8JmlC
R0qPhX0I2xGH9G1EL+83J4zzte3K7p5ErLY1V1S9cWuBKot16eKtrxhIgWxTMfE1
l93az4Uz4YLzUPYEXSO7pNX9cvxyrEjsqSJE3Jftn5ZqbUO46M+7gMKG2g46C/W4
IQtg2v9cHE3xKV5c+wCFjjIHtOGg+leOTMFdiD6oIa/uNfV/3tzpiyQ1e2QgyrvU
UK4zz3TxqxWswDTrxRdc7fFNAGoNSrxU2hwyvjc/CGehORv7ktBjJJbtt3PfvHsi
nov+OEIToDFTO1nCzQ39qQP0Ibl0LpNbvJGWyJqubFsZd0uiU1EwONXFchNwHeil
Yce4DT8Tzf4zv6y3YNJCz1RCM1G308vQav539w6D7vfIUc5F28gnWKkd5NIcCpyu
URVWp0HxV7d+kCekbxhnd+Ah/XvsrHhkI3cxOHvc1QjGwToRWawJQT0LD72E6PqW
MmnOUTZhrxebyAx1HEt45l19fuW/TfwCWWzAtRscr8uFLFf0/Hwm41tSo8FjxqK2
OVZAckmVYIKP0F+u6hcSg/INl6rs6R+Co4/S8aFdKh2N16wmwQ7hevoTIpXIFwwK
hkpwAUdlQxIWzSe8uJMV
=nRz7
-----END PGP SIGNATURE-----

[toc] | [prev] | [next] | [standalone]

#54846

FromBill <bill@bill.com>
Date2013-09-26 19:15 +0100
Message-ID<XQ_0u.115751$G02.79395@fx13.am4>
In reply to#54837
Philipp Hagemeister wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA512
>
> Hi Bill,
>
> the best way to ask for features or file bugs on youtube-dl is asking
> us at http://github.com/rg3/youtube-dl/issues . Luckily, I this list
> from time to time ;)
>
> Simply use
>
> youtube-dl --username user@gmail.com --password secret :ytfav
>
> Best,
>
> Philipp
>
> On 09/26/2013 05:13 PM, Bill wrote:
>> I have been using the script youtube-dl
>> http://rg3.github.io/youtube-dl/
>>
>> And I was wondering if there is a way to download all of a user's
>> favorites or uploads.
>>
>> The script has a functionality to download all videos in a txt
>> file. So if there is a way using the youtube API or JSON (none of
>> which I am familiar with) to bring up a list of all these videos
>> then it'd be a simple case putting these urls into a file.
>>
>> The problem is youtube displays favorites or user uploads in pages
>> or infinite scroll. So it is difficult to access them by the
>> BeautifulSoup module.
>>
>>
>> What do you suggest?
>
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.4.14 (GNU/Linux)
>
> iQIcBAEBCgAGBQJSRFQmAAoJENtLVMukgmoYaz0P/ifoPqcx4dpShXyigwGxzhsa
> ht8sjIP8n3bNJ+J7Jvx0uM6Sv/Hu/U1CC09G1pT9nquHDYYvmko+MoBkXbc8JmlC
> R0qPhX0I2xGH9G1EL+83J4zzte3K7p5ErLY1V1S9cWuBKot16eKtrxhIgWxTMfE1
> l93az4Uz4YLzUPYEXSO7pNX9cvxyrEjsqSJE3Jftn5ZqbUO46M+7gMKG2g46C/W4
> IQtg2v9cHE3xKV5c+wCFjjIHtOGg+leOTMFdiD6oIa/uNfV/3tzpiyQ1e2QgyrvU
> UK4zz3TxqxWswDTrxRdc7fFNAGoNSrxU2hwyvjc/CGehORv7ktBjJJbtt3PfvHsi
> nov+OEIToDFTO1nCzQ39qQP0Ibl0LpNbvJGWyJqubFsZd0uiU1EwONXFchNwHeil
> Yce4DT8Tzf4zv6y3YNJCz1RCM1G308vQav539w6D7vfIUc5F28gnWKkd5NIcCpyu
> URVWp0HxV7d+kCekbxhnd+Ah/XvsrHhkI3cxOHvc1QjGwToRWawJQT0LD72E6PqW
> MmnOUTZhrxebyAx1HEt45l19fuW/TfwCWWzAtRscr8uFLFf0/Hwm41tSo8FjxqK2
> OVZAckmVYIKP0F+u6hcSg/INl6rs6R+Co4/S8aFdKh2N16wmwQ7hevoTIpXIFwwK
> hkpwAUdlQxIWzSe8uJMV
> =nRz7
> -----END PGP SIGNATURE-----
>

If I can't figure this out myself, I'll be sure to do that.

Cheers

[toc] | [prev] | [next] | [standalone]

#54866

FromThomas Kandler <hallo@thomaskandler.net>
Date2013-09-27 09:27 +0200
Message-ID<bakqbrFprmqU1@mid.individual.net>
In reply to#54832
On 26.09.2013 17:13, Bill wrote:
> I have been using the script youtube-dl http://rg3.github.io/youtube-dl/
> 
> And I was wondering if there is a way to download all of a user's
> favorites or uploads.
> 
> The script has a functionality to download all videos in a txt file. So
> if there is a way using the youtube API or JSON (none of which I am
> familiar with) to bring up a list of all these videos then it'd be a
> simple case putting these urls into a file.
> 
> The problem is youtube displays favorites or user uploads in pages or
> infinite scroll. So it is difficult to access them by the BeautifulSoup
> module.
> 
> 
> What do you suggest?

Regarding the uploads: most profiles do have something called 'Popular
Uploads' or 'Recent Uploads'. Hover with the mouse over the link, a
'play'-Button appears, click it, copy the URL (should have a &list
parameter), paste the URL in youtube-dl (or a txt-file) and it will
fetch all videos.

I am not sure if this works for favorites, too, but that's the way I do it.

[toc] | [prev] | [next] | [standalone]

#54907

FromBill <bill@bill.com>
Date2013-09-27 20:50 +0100
Message-ID<ckl1u.5898$Kk5.5842@fx36.am4>
In reply to#54866
Thomas Kandler wrote:
> On 26.09.2013 17:13, Bill wrote:
>> I have been using the script youtube-dl http://rg3.github.io/youtube-dl/
>>
>> And I was wondering if there is a way to download all of a user's
>> favorites or uploads.
>>
>> The script has a functionality to download all videos in a txt file. So
>> if there is a way using the youtube API or JSON (none of which I am
>> familiar with) to bring up a list of all these videos then it'd be a
>> simple case putting these urls into a file.
>>
>> The problem is youtube displays favorites or user uploads in pages or
>> infinite scroll. So it is difficult to access them by the BeautifulSoup
>> module.
>>
>>
>> What do you suggest?
>
> Regarding the uploads: most profiles do have something called 'Popular
> Uploads' or 'Recent Uploads'. Hover with the mouse over the link, a
> 'play'-Button appears, click it, copy the URL (should have a &list
> parameter), paste the URL in youtube-dl (or a txt-file) and it will
> fetch all videos.
>
> I am not sure if this works for favorites, too, but that's the way I do it.
>

Hi.

A screenshot would help me locate it.

Cheers

[toc] | [prev] | [next] | [standalone]

#54909

FromThomas Kandler <hallo@thomaskandler.net>
Date2013-09-27 22:19 +0200
Message-ID<bam7j1F4qreU1@mid.individual.net>
In reply to#54907
On 27.09.2013 21:50, Bill wrote:
> Hi.
> 
> A screenshot would help me locate it.
> 
> Cheers

Sure. http://i.imgur.com/LvrNZYO.png

I don't thing *every* profile has this, but as I said, I use youtube-dl
quite often this way.

Best

[toc] | [prev] | [standalone]

Back to top | Article view | comp.lang.python

csiph-web