Re: submit jobs on multi-core

References	<CAPxp-0QQd_MMvmiVt0Lf8bWo4N04Hhz4Kh6mTzZx2geFC0JXrA@mail.gmail.com> <504ED1EB.1080008@shopzeus.com> <CALwzid=72f+wF+atz9DS9ZcEKHubgRGQyUQ2cmbcHie2DKHFzQ@mail.gmail.com>
Date	2012-09-12 19:59 -0600
Subject	Re: submit jobs on multi-core
From	Jason Friedman <jason@powerpull.net>
Newsgroups	comp.lang.python
Message-ID	<mailman.586.1347501552.27098.python-list@python.org> (permalink)

Show all headers | View raw

>>> I have a python script in which I have a list of files to input one by one
>>> and for each file I get a number as an output.
>>> I used for loop to submit the file to script.
>>> My script uses one file at a time and returns the output.
>>>
>>> My computers has 8 cores.
>>> Is there any way that I could submit 8 jobs at a time and get all the
>>> output faster ?
>>
> Or if Python 3.2 is an option, the concurrent.futures module would be
> very well suited for this task.

Agreed.

Back to comp.lang.python | Previous | Next — Next in thread | Find similar | Unroll thread

Thread

Re: submit jobs on multi-core Jason Friedman <jason@powerpull.net> - 2012-09-12 19:59 -0600
  Re: submit jobs on multi-core Matej Cepl <mcepl@redhat.com> - 2012-09-13 09:30 +0200

csiph-web