Path: csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!feeder.erje.net!eu.feeder.erje.net!newsfeed.fsmpi.rwth-aachen.de!rt.uk.eu.org!newsfeed.xs4all.nl!newsfeed4.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
Return-Path: <python-python-list@m.gmane.org>
X-Original-To: python-list@python.org
Delivered-To: python-list@mail.python.org
X-Spam-Status: OK 0.007
X-Spam-Evidence: '*H*': 0.99; '*S*': 0.00; 'url:pypi': 0.03; 'from:addr:yahoo.co.uk': 0.04; 'preferably': 0.05; 'lawrence': 0.09; 'received:80.91': 0.09; 'received:80.91.229': 0.09; 'received:gmane.org': 0.09; 'received:list': 0.09; 'subject:files': 0.09; 'language.': 0.14; 'received:80.91.229.3': 0.16; 'received:plane.gmane.org': 0.16; 'subject:Writing': 0.16; 'url:urllib': 0.16; 'language': 0.16; 'wrote:': 0.18; 'trying': 0.19; 'help.': 0.21; 'header:User-Agent:1': 0.23; 'string,': 0.24; '---': 0.24; 'header:X-Complaints-To:1': 0.27; 'header:In-Reply- To:1': 0.27; 'url:python': 0.33; 'url:org': 0.36; 'url:library': 0.38; 'to:addr:python-list': 0.38; 'to:addr:python.org': 0.39; 'received:org': 0.40; 'free': 0.61; 'url:3': 0.61; 'viruses': 0.61; 'kindly': 0.61; 'email addr:gmail.com': 0.63; 'protection': 0.63; 'group,': 0.63; 'our': 0.64; 'dear': 0.65; 'url:0': 0.67; 'antivirus': 0.68; 'coming,': 0.84; 'subject:times': 0.84; 'esteemed': 0.91
X-Injected-Via-Gmane: http://gmane.org/
To: python-list@python.org
From: Mark Lawrence <breamoreboy@yahoo.co.uk>
Subject: Re: Writing Multiple files at a times
Date: Sun, 29 Jun 2014 12:17:04 +0100
References: <b8951113-5171-4441-b490-4d731eb56cec@googlegroups.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Gmane-NNTP-Posting-Host: host-92-18-5-57.as13285.net
User-Agent: Mozilla/5.0 (Windows NT 6.1; rv:24.0) Gecko/20100101 Thunderbird/24.6.0
In-Reply-To: <b8951113-5171-4441-b490-4d731eb56cec@googlegroups.com>
X-Antivirus: avast! (VPS 140628-0, 28/06/2014), Outbound message
X-Antivirus-Status: Clean
X-BeenThere: python-list@python.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe: <https://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive: <http://mail.python.org/pipermail/python-list/>
List-Post: <mailto:python-list@python.org>
List-Help: <mailto:python-list-request@python.org?subject=help>
List-Subscribe: <https://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups: comp.lang.python
Message-ID: <mailman.11324.1404040636.18130.python-list@python.org>
Lines: 27
NNTP-Posting-Host: 2001:888:2000:d::a6
X-Trace: 1404040636 news.xs4all.nl 2927 [2001:888:2000:d::a6]:55176
X-Complaints-To: abuse@xs4all.nl
Xref: csiph.com comp.lang.python:73728

On 29/06/2014 11:49, subhabangalore@gmail.com wrote:
> Dear Group,
>
> I am trying to crawl multiple URLs. As they are coming I want to write them as string, as they are coming, preferably in a queue.
>
> If any one of the esteemed members of the group may kindly help.
>
> Regards,
> Subhabrata Banerjee.
>

https://docs.python.org/3/library/urllib.html#module-urllib
https://pypi.python.org/pypi/requests/2.3.0

https://docs.python.org/3/library/queue.html

-- 
My fellow Pythonistas, ask not what our language can do for you, ask 
what you can do for our language.

Mark Lawrence

---
This email is free from viruses and malware because avast! Antivirus protection is active.
http://www.avast.com