Path: csiph.com!x330-a1.tempe.blueboxinc.net!usenet.pasdenom.info!gegeweb.org!de-l.enfer-du-nord.net!feeder1.enfer-du-nord.net!newsfeed.eweka.nl!eweka.nl!feeder3.eweka.nl!newsfeed.xs4all.nl!newsfeed6.news.xs4all.nl!xs4all!post.news.xs4all.nl!not-for-mail
Sender: Ixokai <ixokai@ixokai.io>
Date: Thu, 01 Sep 2011 15:27:32 -0700
From: Stephen Hansen <me+list/python@ixokai.io>
MIME-Version: 1.0
To: python-list@python.org
Subject: Re: Threads in Python
References: <CA+kOh44brn-ZnaQEeaXrscrnTwY-A7rAuCTsvwX4egKxa8U60Q@mail.gmail.com>
In-Reply-To: <CA+kOh44brn-ZnaQEeaXrscrnTwY-A7rAuCTsvwX4egKxa8U60Q@mail.gmail.com>
OpenPGP: id=555B1FE5; url=http://id.ixokai.io/pub.asc
Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enigD37D8E8F032C9B27D5BCB9DE"
Precedence: list
Reply-To: me+list/python@ixokai.io
Newsgroups: comp.lang.python
Message-ID: <mailman.670.1314916069.27778.python-list@python.org>
Lines: 96
NNTP-Posting-Host: 2001:888:2000:d::a6
Xref: x330-a1.tempe.blueboxinc.net comp.lang.python:12588

This is an OpenPGP/MIME signed message (RFC 2440 and 3156)
--------------enigD37D8E8F032C9B27D5BCB9DE
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

On 9/1/11 2:45 PM, George Kovoor wrote:
> Hi,
> Why doesn't python threads show an associated PID?  On spawning python
> threads using the threading module I can only see the main thread's pid=
 on
> using top or ps unix command, no  subprocesses are displayed. In otherw=
ords
> top or ps in not aware of any subprocesses created using threading modu=
le in
> python.
>
> Whereas in Java , creating threads will result in separate pid , these
> subprocesses can be listed using top or ps. Java threads get mapped to =
the
> cores in the system.

I think you're confused about what threads and subprocesses are. They
are completely different mechanisms for concurrent code. Threads never
show up on top or ps, in any language ... or the language isn't offering
threads. I don't know Java, so I can't really comment on it much, but it
may be misusing the 'thread' word, but I somehow doubt it. I suspect
you're just mistaken about what Java is offering.

Threads are separate operating ..er, chains-of-instructions within a
single process... Notably with threads, they share the same address
space so you can easily share objects amongst threads, without any
copying and with no overhead ... Also notably with threads, this can be
dangerous, so you often end up wrapping lots of locks around those
shared objects and have to take extreme care to make sure nothing goes
haywire.

Subprocesses are different; they are a whole, separate process with its
own address space and no shared memory (unless you go out of your way to
do it manually). Heck, each subprocess can have any number of threads.
Anything you want to share between them you have to take special care to
set up and do -- multiprocessing exists to make this easier and make
subprocesses easier to use, like threads are.

They're very distinct. Threads are a lot more lightweight and start up a
lot faster, but doing multithreaded programming right with any sort of
shared objects is really, really, really hard to get right. Some say you
can't.

But, in Python, only one thread actually ever executes actual Python
code at any given time. This does not actually make threading useless as
some people claim; if you're making a lot of calls into C-code, for
instance, the lock gets released while said C-code runs and other Python
code can continue along. Its just not useful if your program is
CPU-bound and wants to take advantage of multiple cores. But there's
lots of other reasons to go concurrent.

But if you do need lots of CPU power, multiprocessing lets you chew up
multiple cores and does so /fairly/ easily. Communication between the
processes can be expensive depending on the types of objects you need to
pass back and forth, but it depends on how you're designing your app.

They're just different ways of achieving concurrency, and the two
primary ways Python provides. (Greenlets is another, available as a
third-party module; Twisted's asynch dispatching isn't really exactly
concurrency, but it does a better job then concurrency does for some
operations; someone's always working on coroutines in some fashion or
another, which is another kind of concurrency.)

Lots of different ways to go concurrent, depending on your needs.

--=20

   Stephen Hansen
   ... Also: Ixokai
   ... Mail: me+list/python (AT) ixokai (DOT) io
   ... Blog: http://meh.ixokai.io/


--------------enigD37D8E8F032C9B27D5BCB9DE
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.10 (Darwin)

iQEcBAEBAgAGBQJOYAbgAAoJEKcbwptVWx/lxA8IAK9jnUKHwhnxsAcN7Za8rBWk
OTLrWj68/C7ecJXbzWGHUeLYF2xSt5sq/2Cq9pau5Ac0AZkLzUPh0Uf4zIsLW/qE
dptQlHlkIr4E2h2ZnSPxbtMlDG/HWy/5xmmLp5V3JX4oStSvD7qqCKOFEFbRo1vS
IR1e7FJ5/YUCpRw7cu4upgTWpb0Pr0TQxbBLjjbR/BdQwBHvSwbNhD+0xT4fg61E
D3ku5FN2zCl6R/GAn5R6v08xhe3+OeZ/fmnIIjFLld8KWLQs8EyMPzL3ZpIFAN13
jV8SdQk9hOe6sa6PUyUXmhXriMqw8HZJvHYJBhHKPTLBM2FwguPRPWoyAhfloJM=
=W9+E
-----END PGP SIGNATURE-----

--------------enigD37D8E8F032C9B27D5BCB9DE--