Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.lang.python > #73729

Re:Writing Multiple files at a times

Show all headers | View raw

[Multipart message — attachments visible in raw view] - view raw

subhabangalore@gmail.com Wrote in message:
> Dear Group,
> 
> I am trying to crawl multiple URLs. As they are coming I want to write them as string, as they are coming, preferably in a queue. 
> 
> If any one of the esteemed members of the group may kindly help.
> 

>From your subject line,  it appears you want to keep multiple files open, and write to each in an arbitrary order.  That's no problem,  up to the operating system limits.  Define a class that holds the URL information and for each instance,  add an attribute for an output file handle. 

Don't forget to close each file when you're done with the corresponding URL. 

-- 
DaveA

Back to comp.lang.python | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread

Thread

Writing Multiple files at a times subhabangalore@gmail.com - 2014-06-29 03:49 -0700
  Re: Writing Multiple files at a times Mark Lawrence <breamoreboy@yahoo.co.uk> - 2014-06-29 12:17 +0100
  Re:Writing Multiple files at a times Dave Angel <davea@davea.name> - 2014-06-29 09:33 -0400
    Re: Writing Multiple files at a times Roy Smith <roy@panix.com> - 2014-06-29 10:01 -0400
      Re: Writing Multiple files at a times subhabangalore@gmail.com - 2014-06-29 10:32 -0700
        Re: Writing Multiple files at a times Denis McMahon <denismfmcmahon@gmail.com> - 2014-06-29 19:21 +0000
  Re: Writing Multiple files at a times subhabangalore@gmail.com - 2014-06-30 12:23 -0700
    Re: Writing Multiple files at a times Denis McMahon <denismfmcmahon@gmail.com> - 2014-06-30 23:22 +0000

csiph-web