Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]
Groups > comp.lang.python > #18694
| Path | csiph.com!x330-a1.tempe.blueboxinc.net!usenet.pasdenom.info!weretis.net!feeder1.news.weretis.net!feeder.erje.net!newsfeed.xs4all.nl!newsfeed6.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail |
|---|---|
| Return-Path | <d@davea.name> |
| X-Original-To | python-list@python.org |
| Delivered-To | python-list@mail.python.org |
| X-Spam-Status | OK 0.012 |
| X-Spam-Evidence | '*H*': 0.98; '*S*': 0.00; 'stuff.': 0.05; 'imports': 0.07; 'suggesting': 0.07; 'subject:Processing': 0.09; 'am,': 0.12; 'copied,': 0.16; 'guidance.': 0.16; 'shared.': 0.16; 'simplest': 0.16; 'cc:addr:python-list': 0.16; 'wrote:': 0.18; 'jan': 0.19; 'cc:no real name:2**0': 0.20; 'assume': 0.22; 'header:In-Reply- To:1': 0.22; 'thus': 0.23; 'ones.': 0.23; 'cc:2**0': 0.24; 'libraries': 0.24; 'library.': 0.24; 'code': 0.25; 'guess': 0.26; 'expect': 0.26; 'separate': 0.28; 'process,': 0.28; 'tend': 0.28; "wasn't": 0.28; 'cc:addr:python.org': 0.29; 'error': 0.29; 'pm,': 0.29; 'processes.': 0.30; 'shared': 0.31; "didn't": 0.31; 'header :User-Agent:1': 0.33; 'rather': 0.33; 'things': 0.34; 'calling': 0.34; 'thank': 0.35; 'trouble': 0.35; 'moving': 0.35; 'things,': 0.37; 'but': 0.37; 'received:192': 0.37; 'another': 0.37; 'think': 0.37; 'could': 0.37; 'some': 0.38; "i'd": 0.39; "it's": 0.40; 'received:192.168': 0.40; 'once': 0.60; 'your': 0.61; 'alternative': 0.65; 'header:Reply-To:1': 0.71; 'reply-to:no real name:2**0': 0.72; 'low': 0.74; '12:02': 0.84; 'harness': 0.84 |
| Date | Sun, 08 Jan 2012 21:46:05 -0500 |
| From | Dave Angel <d@davea.name> |
| User-Agent | Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.2.23) Gecko/20110922 Thunderbird/3.1.15 |
| MIME-Version | 1.0 |
| To | Yigit Turgut <y.turgut@gmail.com> |
| Subject | Re: Parallel Processing |
| References | <mailman.24510.1326051902.27777.python-list@python.org> <mailman.4536.1326067374.27778.python-list@python.org> <baff2c26-0cdf-4b1b-b7ee-1a9ad02d22f9@dp8g2000vbb.googlegroups.com> |
| In-Reply-To | <baff2c26-0cdf-4b1b-b7ee-1a9ad02d22f9@dp8g2000vbb.googlegroups.com> |
| Content-Type | text/plain; charset=ISO-8859-1; format=flowed |
| Content-Transfer-Encoding | 7bit |
| X-Provags-ID | V02:K0:hecN0KvJKTGmcNmsUziF6S7m9BONwBnvkYFkWwAXjEi Ca34IpZzXz0ztbniMqDKTCChK2zXmastvdMd6vvxS9j5HL8Ac6 olLFI4MeIUMS8cCC3l7Z+z8mbAyrEc4MmU5qXJJWMzcozJcbYg jlPUnYDKWwU5vB2/wsWmR8haMcDgEe+mjahinIGV4hXDPLMKVx +oF9aCHXHNb9LcKmcMYQhUukuPHEV7y8xlZ9pNTgmHryBsIEsp MUeAAjeH7RvpEd//t6QkPSkArv7rQTHzuTLC/MNUwm61Qrvjdr nQEQqtJoak8iliAtLi3lJ5POTlQGO+N1/AGNYr9w0O9JRbWSgU dUaJ3t9F993bGhGezQXE= |
| Cc | python-list@python.org |
| X-BeenThere | python-list@python.org |
| X-Mailman-Version | 2.1.12 |
| Precedence | list |
| Reply-To | d@davea.name |
| List-Id | General discussion list for the Python programming language <python-list.python.org> |
| List-Unsubscribe | <http://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe> |
| List-Archive | <http://mail.python.org/pipermail/python-list> |
| List-Post | <mailto:python-list@python.org> |
| List-Help | <mailto:python-list-request@python.org?subject=help> |
| List-Subscribe | <http://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe> |
| Newsgroups | comp.lang.python |
| Message-ID | <mailman.4538.1326077174.27778.python-list@python.org> (permalink) |
| Lines | 28 |
| NNTP-Posting-Host | 2001:888:2000:d::a6 |
| X-Trace | 1326077174 news.xs4all.nl 6904 [2001:888:2000:d::a6]:42846 |
| X-Complaints-To | abuse@xs4all.nl |
| Xref | x330-a1.tempe.blueboxinc.net comp.lang.python:18694 |
Show key headers only | View raw
On 01/08/2012 08:46 PM, Yigit Turgut wrote: > On Jan 9, 12:02 am, Dave Angel<d...@davea.name> wrote: >> <SNIP> >> Then i'd try calling separate functions (declaring them in depfuncs). >> And finally I'd try some 3rd party library. > Don't think will try another package for the same task. I am now > moving on to PP + PyCUDA to harness GPU available CPU cores. > > Thank you for the guidance. > Actually, I wasn't suggesting an alternative to pp, but rather introducing refs to libraries like numpy. I don't know what pp's methodology is, but I can guess which parts are trivial, and which parts tend to be trickier. Once things are in a separate process, it's best not to assume any shared state between the processes. Thus I'd expect globals() to be copied, not shared. And the error messages had very low line numbers, which I could take to mean they didn't add your imports and other stuff. Point is, when i start having trouble with code that's inadequately documented, I try the simplest things, and work up to the complex ones. -- DaveA
Back to comp.lang.python | Previous | Next — Previous in thread | Find similar | Unroll thread
Re: Parallel Processing David Hoese <dhoese@gmail.com> - 2012-01-08 18:02 -0600
Re: Parallel Processing Yigit Turgut <y.turgut@gmail.com> - 2012-01-08 17:46 -0800
Re: Parallel Processing Dave Angel <d@davea.name> - 2012-01-08 21:46 -0500
csiph-web