Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.lang.python > #74478

Anything better than asyncio.as_completed() and asyncio.wait() to manage execution of large amount of tasks?

From Valery Khamenya <khamenya@gmail.com>
Date 2014-07-15 14:20 +0200
Subject Anything better than asyncio.as_completed() and asyncio.wait() to manage execution of large amount of tasks?
Newsgroups comp.lang.python
Message-ID <mailman.11834.1405426868.18130.python-list@python.org> (permalink)

Show all headers | View raw


[Multipart message — attachments visible in raw view] - view raw

Hi,

both asyncio.as_completed() and asyncio.wait() work with lists only. No
generators are accepted. Are there anything similar to those functions that
pulls Tasks/Futures/coroutines one-by-one and processes them in a limited
task pool?

I have gazillion of Tasks, and do not want to instantiate them all at once,
but to instantiate and to address them one by one as the running tasks are
completed.

best regards
--
Valery

Back to comp.lang.python | Previous | Next | Find similar | Unroll thread


Thread

Anything better than asyncio.as_completed() and asyncio.wait() to manage execution of large amount of tasks? Valery Khamenya <khamenya@gmail.com> - 2014-07-15 14:20 +0200

csiph-web