Path: csiph.com!x330-a1.tempe.blueboxinc.net!usenet.pasdenom.info!weretis.net!feeder1.news.weretis.net!feeder.erje.net!newsfeed.xs4all.nl!newsfeed6.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
Return-Path: <d@davea.name>
X-Original-To: python-list@python.org
Delivered-To: python-list@mail.python.org
X-Spam-Status: OK 0.012
X-Spam-Evidence: '*H*': 0.98; '*S*': 0.00; 'stuff.': 0.05; 'imports': 0.07; 'suggesting': 0.07; 'subject:Processing': 0.09; 'am,': 0.12; 'copied,': 0.16; 'guidance.': 0.16; 'shared.': 0.16; 'simplest': 0.16; 'cc:addr:python-list': 0.16; 'wrote:': 0.18; 'jan': 0.19; 'cc:no real name:2**0': 0.20; 'assume': 0.22; 'header:In-Reply- To:1': 0.22; 'thus': 0.23; 'ones.': 0.23; 'cc:2**0': 0.24; 'libraries': 0.24; 'library.': 0.24; 'code': 0.25; 'guess': 0.26; 'expect': 0.26; 'separate': 0.28; 'process,': 0.28; 'tend': 0.28; "wasn't": 0.28; 'cc:addr:python.org': 0.29; 'error': 0.29; 'pm,': 0.29; 'processes.': 0.30; 'shared': 0.31; "didn't": 0.31; 'header :User-Agent:1': 0.33; 'rather': 0.33; 'things': 0.34; 'calling': 0.34; 'thank': 0.35; 'trouble': 0.35; 'moving': 0.35; 'things,': 0.37; 'but': 0.37; 'received:192': 0.37; 'another': 0.37; 'think': 0.37; 'could': 0.37; 'some': 0.38; "i'd": 0.39; "it's": 0.40; 'received:192.168': 0.40; 'once': 0.60; 'your': 0.61; 'alternative': 0.65; 'header:Reply-To:1': 0.71; 'reply-to:no real name:2**0': 0.72; 'low': 0.74; '12:02': 0.84; 'harness': 0.84
Date: Sun, 08 Jan 2012 21:46:05 -0500
From: Dave Angel <d@davea.name>
User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.2.23) Gecko/20110922 Thunderbird/3.1.15
MIME-Version: 1.0
To: Yigit Turgut <y.turgut@gmail.com>
Subject: Re: Parallel Processing
References: <mailman.24510.1326051902.27777.python-list@python.org>	<mailman.4536.1326067374.27778.python-list@python.org> <baff2c26-0cdf-4b1b-b7ee-1a9ad02d22f9@dp8g2000vbb.googlegroups.com>
In-Reply-To: <baff2c26-0cdf-4b1b-b7ee-1a9ad02d22f9@dp8g2000vbb.googlegroups.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Provags-ID: V02:K0:hecN0KvJKTGmcNmsUziF6S7m9BONwBnvkYFkWwAXjEi Ca34IpZzXz0ztbniMqDKTCChK2zXmastvdMd6vvxS9j5HL8Ac6 olLFI4MeIUMS8cCC3l7Z+z8mbAyrEc4MmU5qXJJWMzcozJcbYg jlPUnYDKWwU5vB2/wsWmR8haMcDgEe+mjahinIGV4hXDPLMKVx +oF9aCHXHNb9LcKmcMYQhUukuPHEV7y8xlZ9pNTgmHryBsIEsp MUeAAjeH7RvpEd//t6QkPSkArv7rQTHzuTLC/MNUwm61Qrvjdr nQEQqtJoak8iliAtLi3lJ5POTlQGO+N1/AGNYr9w0O9JRbWSgU dUaJ3t9F993bGhGezQXE=
Cc: python-list@python.org
X-BeenThere: python-list@python.org
X-Mailman-Version: 2.1.12
Precedence: list
Reply-To: d@davea.name
List-Id: General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe: <http://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive: <http://mail.python.org/pipermail/python-list>
List-Post: <mailto:python-list@python.org>
List-Help: <mailto:python-list-request@python.org?subject=help>
List-Subscribe: <http://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups: comp.lang.python
Message-ID: <mailman.4538.1326077174.27778.python-list@python.org>
Lines: 28
NNTP-Posting-Host: 2001:888:2000:d::a6
X-Trace: 1326077174 news.xs4all.nl 6904 [2001:888:2000:d::a6]:42846
X-Complaints-To: abuse@xs4all.nl
Xref: x330-a1.tempe.blueboxinc.net comp.lang.python:18694

On 01/08/2012 08:46 PM, Yigit Turgut wrote:
> On Jan 9, 12:02 am, Dave Angel<d...@davea.name>  wrote:
>> <SNIP>
>> Then i'd try calling separate functions (declaring them in depfuncs).
>> And finally I'd try some 3rd party library.
> Don't think will try another package for the same task. I am now
> moving on to PP + PyCUDA to harness GPU available CPU cores.
>
> Thank you for the guidance.
>
Actually, I wasn't suggesting an alternative to pp, but rather 
introducing refs to libraries like numpy.  I don't know what pp's 
methodology is, but I can guess which parts are trivial, and which parts 
tend to be trickier.  Once things are in a separate process, it's best 
not to assume any shared state between the processes.  Thus I'd expect 
globals() to be copied, not shared.  And the error messages had very low 
line numbers, which I could take to mean they didn't add your imports 
and other stuff.

Point is, when i start having trouble with code that's inadequately 
documented, I try the simplest things, and work up to the complex ones.



-- 

DaveA