Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.lang.python > #85087 > unrolled thread

Downloading videos (in flash applications) using python

Back to article view | Back to comp.lang.python

Contents

  Downloading videos (in flash applications) using python Gabriel Ferreira <gabrielbianchiferreira@gmail.com> - 2015-02-02 08:00 -0800
    Re: Downloading videos (in flash applications) using python Steven D'Aprano <steve+comp.lang.python@pearwood.info> - 2015-02-03 03:19 +1100
      Re: Downloading videos (in flash applications) using python Gabriel Ferreira <gabrielbianchiferreira@gmail.com> - 2015-02-02 08:22 -0800
        Re: Downloading videos (in flash applications) using python Irmen de Jong <irmen.NOSPAM@xs4all.nl> - 2015-02-02 19:43 +0100
    Re: Downloading videos (in flash applications) using python Ben Finney <ben+python@benfinney.id.au> - 2015-02-03 05:57 +1100
    Re: Downloading videos (in flash applications) using python Gabriel Ferreira <gabrielbianchiferreira@gmail.com> - 2015-02-02 11:15 -0800
      Re: Downloading videos (in flash applications) using python Paul Rubin <no.email@nospam.invalid> - 2015-02-02 11:24 -0800
        Re: Downloading videos (in flash applications) using python Gabriel Ferreira <gabrielbianchiferreira@gmail.com> - 2015-02-02 11:30 -0800
          Re: Downloading videos (in flash applications) using python Irmen de Jong <irmen.NOSPAM@xs4all.nl> - 2015-02-02 21:01 +0100
            Re: Downloading videos (in flash applications) using python Gabriel Ferreira <gabrielbianchiferreira@gmail.com> - 2015-02-02 14:09 -0800
              Re: Downloading videos (in flash applications) using python Mark Lawrence <breamoreboy@yahoo.co.uk> - 2015-02-02 22:13 +0000
                Re: Downloading videos (in flash applications) using python Gabriel Ferreira <gabrielbianchiferreira@gmail.com> - 2015-02-02 15:21 -0800
                  Re: Downloading videos (in flash applications) using python Rustom Mody <rustompmody@gmail.com> - 2015-02-02 18:41 -0800
                  Re: Downloading videos (in flash applications) using python Michael Torrie <torriem@gmail.com> - 2015-02-02 20:12 -0700
                  Re: Downloading videos (in flash applications) using python alister <alister.nospam.ware@ntlworld.com> - 2015-02-03 11:54 +0000
          Re: Downloading videos (in flash applications) using python Paul Rubin <no.email@nospam.invalid> - 2015-02-02 12:16 -0800
            Re: Downloading videos (in flash applications) using python Steven D'Aprano <steve+comp.lang.python@pearwood.info> - 2015-02-03 12:53 +1100
          Re: Downloading videos (in flash applications) using python Michael Torrie <torriem@gmail.com> - 2015-02-02 14:26 -0700

#85087 — Downloading videos (in flash applications) using python

Hello, 

I need some help in downloading videos from flash applications in web using python. Is there any lib to deal with flash player using python?

The videos I need to download are, in fact, live streaming content.
You can see an example here:

http://vejoaovivo.com.br/sc/itapema/avenida-nereu-ramos-1029.html

Thanks

[toc] | [next] | [standalone]

#85090

Gabriel Ferreira wrote:

> Hello,
> 
> I need some help in downloading videos from flash applications in web
> using python. Is there any lib to deal with flash player using python?

Try Youtube-DL

http://rg3.github.io/youtube-dl


-- 
Steven

[toc] | [prev] | [next] | [standalone]

#85092

Thanks for the Hint... But it seems not to support the website i mentioned... Is there a way to make it possible for any kind of video player in the net? Flash player... Since it's not a ordinary video... I'm trying to record & download a live streaming video!! 

Thx

[toc] | [prev] | [next] | [standalone]

#85100

On 2-2-2015 17:22, Gabriel Ferreira wrote:
> Thanks for the Hint... But it seems not to support the website i mentioned... Is
> there a way to make it possible for any kind of video player in the net? Flash
> player... Since it's not a ordinary video... I'm trying to record & download a live
> streaming video!!
> 
> Thx
> 


Youtube-dl has a modular structure and is open-source:
https://github.com/rg3/youtube-dl/

It should be fairly easy to add a module/plugin that groks your site.

Irmen

[toc] | [prev] | [next] | [standalone]

#85104

Gabriel Ferreira <gabrielbianchiferreira@gmail.com> writes:

> I need some help in downloading videos from flash applications in web
> using python. Is there any lib to deal with flash player using python?

Yes, the ‘youtube-dl’ application is the most likely to have the library
code you need.

> The videos I need to download are, in fact, live streaming content.
> You can see an example here:
>
> http://vejoaovivo.com.br/sc/itapema/avenida-nereu-ramos-1029.html

If ‘youtube-dl’ doesn't support a particular site, please report a bug
at its bug tracker. I'm sure they would like to have a working
implementation too.

This isn't really a question about using Python, so it may be best to
continue the discussion in a bug report against ‘youtube-dl’.

-- 
 \     “It is far better to grasp the universe as it really is than to |
  `\    persist in delusion, however satisfying and reassuring.” —Carl |
_o__)                                                            Sagan |
Ben Finney

[toc] | [prev] | [next] | [standalone]

#85106

I appreciate your help. I'm just afraid that Youtube-DL doesn't allow me to record or download a LIVE STREAMING VIDEO. Do you guys think it is possible, since I make some adjustments into the code of the library?

[toc] | [prev] | [next] | [standalone]

#85107

Gabriel Ferreira <gabrielbianchiferreira@gmail.com> writes:
> I appreciate your help. I'm just afraid that Youtube-DL doesn't allow
> me to record or download a LIVE STREAMING VIDEO. Do you guys think it
> is possible, since I make some adjustments into the code of the
> library?

If the stream operator really wants stop you from downloading (and some
of them do), they can make it pretty difficult.  I haven't looked at
youtube-dl closely but those things are generally http retrievers.
Flash videos can use other sorts of streaming protocols, with Macromedia
or other DRM in some cases.  You can presumably still get around it with
enough hassle, but I decided a long time ago that I'd rather just shrink
the audience of those sorts of streams, by choosing not to watch them.

[toc] | [prev] | [next] | [standalone]

#85108

Hi Paul, I presume the stream operator doesn't want to prevent me from downloading or recording the videos. I just wanna know more about some lib that could be used to deal with Flash Player Applications... Or possibly, anything that could lead me to be able to get those streaming videos.

Thx

[toc] | [prev] | [next] | [standalone]

#85109

On 2-2-2015 20:30, Gabriel Ferreira wrote:
> Hi Paul, I presume the stream operator doesn't want to prevent me from downloading or recording the videos. I just wanna know more about some lib that could be used to deal with Flash Player Applications... Or possibly, anything that could lead me to be able to get those streaming videos.
> 
> Thx
> 


Right, have you tried VLC then? (unless you really want to do this from python...)
VLC can play streams, probably yours too, and convert it to another file.

Irmen

[toc] | [prev] | [next] | [standalone]

#85112

The original plan was doing it using python. But, anyway, I should build a robot program to do that task for me... Because I need to capture hundreds of hours of different videos... You mean that is difficult because it's Python... or it's difficult because it's a Flash Application?

Thx

[toc] | [prev] | [next] | [standalone]

#85113

On 02/02/2015 22:09, Gabriel Ferreira wrote:
> The original plan was doing it using python. But, anyway, I should build a robot program to do that task for me... Because I need to capture hundreds of hours of different videos... You mean that is difficult because it's Python... or it's difficult because it's a Flash Application?
>
> Thx
>

I don't actually know, but could you please provide some context and 
write in plain English, those damn ... things are extremely annoying.

-- 
My fellow Pythonistas, ask not what our language can do for you, ask
what you can do for our language.

Mark Lawrence

[toc] | [prev] | [next] | [standalone]

#85115

Mark Lawrence  wrote:

> I don't actually know, but could you please provide some context and 
> write in plain English, those damn ... things are extremely annoying.
> 

Hi, Mark. 

I am developing a research project, which includes video analysis (computer vision, big data, data mining, etc). The first part of the project is about building a database containing a big amount of video of urban zones. I live in Brazil, so the plan is collecting videos from urban areas of Brazilian big cities, like Sao Paulo. 

I have to make this task "automatic". in other words, I don't want to manually download hundreds or thousands hours of videos. So I have to develop a "robot" to do that assingment for me. (I wish I could do that using Python).

I have found a good website that provides me live images from several cities in Brazil. So that's it! That's what I need. I was expecting to develop a program to record & download those videos, that are being broadcasted live on that website. So I would be able to form my database and continue my research.

The problem is that this particular website uses a flash player application do broadcast the live images of the urban areas. I'm not too familiar with Flash Applications. I don't know how to deal with them using Python. I was wondering if someone could help me solve this problem. The goal is recording & downloading those videos, from the mentioned website. And, yes, it has to be an automated program (no manual work).

I wish I had been clear with you guys!

THX!

[toc] | [prev] | [next] | [standalone]

#85117

On Tuesday, February 3, 2015 at 4:51:18 AM UTC+5:30, Gabriel Ferreira wrote:
> Mark Lawrence  wrote:
> 
> > I don't actually know, but could you please provide some context and 
> > write in plain English, those damn ... things are extremely annoying.
> > 
> 
> Hi, Mark. 
> 
> I am developing a research project, which includes video analysis (computer vision, big data, data mining, etc). The first part of the project is about building a database containing a big amount of video of urban zones. I live in Brazil, so the plan is collecting videos from urban areas of Brazilian big cities, like Sao Paulo. 
> 
> I have to make this task "automatic". in other words, I don't want to manually download hundreds or thousands hours of videos. So I have to develop a "robot" to do that assingment for me. (I wish I could do that using Python).

Develop robot -- right
Do it in python -- probably not so right

> 
> I have found a good website that provides me live images from several cities in Brazil. So that's it! That's what I need. I was expecting to develop a program to record & download those videos, that are being broadcasted live on that website. So I would be able to form my database and continue my research.
> 
> The problem is that this particular website uses a flash player application do broadcast the live images of the urban areas. I'm not too familiar with Flash Applications. I don't know how to deal with them using Python. I was wondering if someone could help me solve this problem. The goal is recording & downloading those videos, from the mentioned website. And, yes, it has to be an automated program (no manual work).

The instinct is natural but probably inaccurate:
Python is nice; JS/Flash not so much.

However to get on top of this you probably need to debug the streaming
with a modern browser using JS developer-tools/firebug etc, so that then
you can script what you have debugged.

If you do it in JS, there will be minor glitches once you have debugged the process.
If you do it in python, you will have to jump into (rather out of) many hoops
to go from JS to python.
And debugging the process is not an option.

[Disclaimer: I dont know what I am talking about]

[toc] | [prev] | [next] | [standalone]

#85118

On 02/02/2015 04:21 PM, Gabriel Ferreira wrote:
> The problem is that this particular website uses a flash player
> application do broadcast the live images of the urban areas. I'm not
> too familiar with Flash Applications. I don't know how to deal with
> them using Python. I was wondering if someone could help me solve
> this problem. The goal is recording & downloading those videos, from
> the mentioned website. And, yes, it has to be an automated program
> (no manual work).

As I said before you need to look into the RTP protocol.  There are
utilities for proxying and dumping the stream parameters.  Once they are
known you can pull them in using rtmpdump.  Sometimes the stream
parameters can be determined from the web page.  get_iplayer, for
instance, can create rtp parameters for BBC programs and then stream
them with rtmpdump, since the parameters seem to be well defined and
consistent.  But every streaming site is going to be different.  I
posted the link to the rtmpdump utilities in my other post.  You may be
to drive rtmpdump from Python.

[toc] | [prev] | [next] | [standalone]

#85140

On Mon, 02 Feb 2015 15:21:07 -0800, Gabriel Ferreira wrote:

> Mark Lawrence  wrote:
> 
>> I don't actually know, but could you please provide some context and
>> write in plain English, those damn ... things are extremely annoying.
>> 
>> 
> Hi, Mark.
> 
> I am developing a research project, which includes video analysis
> (computer vision, big data, data mining, etc). The first part of the
> project is about building a database containing a big amount of video of
> urban zones. I live in Brazil, so the plan is collecting videos from
> urban areas of Brazilian big cities, like Sao Paulo.
> 
> I have to make this task "automatic". in other words, I don't want to
> manually download hundreds or thousands hours of videos. So I have to
> develop a "robot" to do that assingment for me. (I wish I could do that
> using Python).
> 
> I have found a good website that provides me live images from several
> cities in Brazil. So that's it! That's what I need. I was expecting to
> develop a program to record & download those videos, that are being
> broadcasted live on that website. So I would be able to form my database
> and continue my research.
> 
> The problem is that this particular website uses a flash player
> application do broadcast the live images of the urban areas. I'm not too
> familiar with Flash Applications. I don't know how to deal with them
> using Python. I was wondering if someone could help me solve this
> problem. The goal is recording & downloading those videos, from the
> mentioned website. And, yes, it has to be an automated program (no
> manual work).
> 
> I wish I had been clear with you guys!
> 
> THX!

So why not speak to the owners of the web site & see if thay can provide 
you with easier access to their video streams
if this is a genuine research project I am sure they would like to help




-- 
If God had a beard, he'd be a UNIX programmer.

[toc] | [prev] | [next] | [standalone]

#85110

Gabriel Ferreira <gabrielbianchiferreira@gmail.com> writes:
> Hi Paul, I presume the stream operator doesn't want to prevent me from
> downloading or recording the videos.  

It's hard to tell why anyone uses Flash anymore, but impeding (if not
preventing) downloads is probably a common reason.

> I just wanna know more about some lib that could be used to deal with
> Flash Player Applications... Or possibly, anything that could lead me
> to be able to get those streaming videos.

Gnash maybe?  https://www.gnu.org/software/gnash/

[toc] | [prev] | [next] | [standalone]

#85116

Paul Rubin wrote:

> It's hard to tell why anyone uses Flash anymore

Masochism and/or sadism, depending on whether they get more pain from
writing the Flash code in the first place or pleasure from forcing Flash on
the viewer.



-- 
Steven

[toc] | [prev] | [next] | [standalone]

#85111

On 02/02/2015 12:30 PM, Gabriel Ferreira wrote:
> Hi Paul, I presume the stream operator doesn't want to prevent me
> from downloading or recording the videos. I just wanna know more
> about some lib that could be used to deal with Flash Player
> Applications... Or possibly, anything that could lead me to be able
> to get those streaming videos.

You can't do it directly with any Python library that I know of.  You
can, however, use the tools that come with rtmpdump:

https://rtmpdump.mplayerhq.hu/

It's not automatic, and requires some iptables tricks, but once you get
the stream information, you can always download it via rtmpdump.

[toc] | [prev] | [standalone]

Back to top | Article view | comp.lang.python

csiph-web