Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.lang.python > #74962

Re: asyncip application hangs

Path csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!feeder.erje.net!us.feeder.erje.net!newsfeed.xs4all.nl!newsfeed3a.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
Return-Path <yasar11732@gmail.com>
X-Original-To python-list@python.org
Delivered-To python-list@mail.python.org
X-Spam-Status OK 0.052
X-Spam-Evidence '*H*': 0.90; '*S*': 0.00; 'that?': 0.05; 'subject:application': 0.07; 'wrapped': 0.09; 'pil.': 0.16; 'code.': 0.18; 'file.': 0.24; 'header:In-Reply-To:1': 0.27; 'message-id:@mail.gmail.com': 0.30; 'getting': 0.31; 'anyone': 0.31; 'figure': 0.32; 'supposed': 0.32; 'skip:t 40': 0.33; 'something': 0.35; 'but': 0.35; 'received:google.com': 0.35; 'doing': 0.36; 'should': 0.36; 'wrong': 0.37; 'tasks': 0.38; 'to:addr:python-list': 0.38; "couldn't": 0.39; 'to:addr:python.org': 0.39; 'how': 0.40; 'skip:a 30': 0.61; 'from:charset:utf-8': 0.61; 'therefore,': 0.64
DKIM-Signature v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; bh=MNq6JDHfmQ++h4YRN+jq/T5y2Wf+sKkGh1QrqsOPoRs=; b=S+6uqDLeZfpNkkZzXIZYHFywG6wW43Bevn1Ppo5JW+wih1eNB8KjZRotAtOv7sN4ij JUcbbQswPdDllqLN3lNMSGK+s9SemzFx8jzVgxtMDL340F7RkDde75z2kjKT3FVxbbC5 8oQVJYpuRHTU47JBDYx994h+Y6nVxTDfRvXfBDLB73762s42Jp5e+KZgl5tTX6/KCyKY jHufzH6ZMo/wD6lAwoStDxLSDEPCVfQP9R9o0lPEew4qc/BEzIs/qsxq0bwZy8Oz03/W FDbU0u2LYvZ3OBSUEEpFI2mu/ZtxPdNjZElEvcYSO3CwsP9VVNYwyz9O6RWmS/9XIxIs 3CJg==
MIME-Version 1.0
X-Received by 10.236.106.10 with SMTP id l10mr4194955yhg.101.1405982097907; Mon, 21 Jul 2014 15:34:57 -0700 (PDT)
In-Reply-To <CAFEUn8YM+wA-Ri=GguzLzoQsXeo-Swk7fZgjW+R6-G7U0oMjFg@mail.gmail.com>
References <CAFEUn8YM+wA-Ri=GguzLzoQsXeo-Swk7fZgjW+R6-G7U0oMjFg@mail.gmail.com>
Date Tue, 22 Jul 2014 01:34:57 +0300
Subject Re: asyncip application hangs
From Yaşar Arabacı <yasar11732@gmail.com>
To python-list@python.org
Content-Type text/plain; charset=UTF-8
Content-Transfer-Encoding quoted-printable
X-BeenThere python-list@python.org
X-Mailman-Version 2.1.15
Precedence list
List-Id General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe <https://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive <http://mail.python.org/pipermail/python-list/>
List-Post <mailto:python-list@python.org>
List-Help <mailto:python-list-request@python.org?subject=help>
List-Subscribe <https://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups comp.lang.python
Message-ID <mailman.12157.1405982107.18130.python-list@python.org> (permalink)
Lines 32
NNTP-Posting-Host 2001:888:2000:d::a6
X-Trace 1405982107 news.xs4all.nl 2963 [2001:888:2000:d::a6]:52688
X-Complaints-To abuse@xs4all.nl
Xref csiph.com comp.lang.python:74962

Show key headers only | View raw


2014-07-22 1:19 GMT+03:00 Yaşar Arabacı <yasar11732@gmail.com>:
> This program is supposed to give me status codes for web pages that
> are found on my sitemap.xml file. But program hangs as Tasks wait for
> getting something out of the Queue. I think it has something to do
> with how I am using asyncio.Queue, but I couldn't figure out what am I
> doing wrong here. Can anyone help me with that?

Ok, I figured out what was wrong with my code.

Since asyncio.Queue.put() is a coroutine, I should have wrapped those
with asyncio.Task in order for them to start executing.

Therefore, this works;

    q = asyncio.Queue()
    loop = asyncio.get_event_loop()

    for i in range(num_coroutines):  # start 10 tasks
        tasks.append(asyncio.Task(print_status_code(q)))

    for loc in soup.find_all('loc'):
        asyncio.Task(q.put(loc.string))

    for i in range(num_coroutines):  # Put poison pil.
        asyncio.Task(q.put(None))

    print("%i items in queue" % q.qsize())

    loop.run_until_complete(asyncio.wait(tasks))

-- 
http://ysar.net/

Back to comp.lang.python | Previous | Next | Find similar | Unroll thread


Thread

Re: asyncip application hangs Yaşar Arabacı <yasar11732@gmail.com> - 2014-07-22 01:34 +0300

csiph-web