Re: Efficient Threading

Path	csiph.com!usenet.pasdenom.info!dedibox.gegeweb.org!gegeweb.eu!nntpfeed.proxad.net!proxad.net!feeder1-2.proxad.net!news.tele.dk!news.tele.dk!small.news.tele.dk!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
Return-Path	<cameron@cskk.homeip.net>
X-Original-To	python-list@python.org
Delivered-To	python-list@mail.python.org
X-Spam-Status	OK 0.005
X-Spam-Evidence	'H': 0.99; 'S': 0.00; 'python,': 0.02; '(so': 0.07; 'pypy': 0.07; 'python': 0.11; '>in': 0.16; 'concurrent': 0.16; 'example).': 0.16; 'from:addr:cs': 0.16; 'from:addr:zip.com.au': 0.16; 'from:name:cameron simpson': 0.16; 'message-id:@cskk.homeip.net': 0.16; 'mine.': 0.16; 'pry': 0.16; 'received:211.29': 0.16; 'received:211.29.132': 0.16; 'received:cskk.homeip.net': 0.16; 'received:homeip.net': 0.16; 'received:optusnet.com.au': 0.16; 'received:syd.optusnet.com.au': 0.16; 'simpson': 0.16; 'wrote:': 0.18; 'library': 0.18; 'seems': 0.21; 'load': 0.23; 'header:User-Agent:1': 0.23; 'cheers,': 0.24; 'options': 0.25; 'header:In-Reply-To:1': 0.27; 'related': 0.29; 'libraries': 0.31; "i'd": 0.34; 'tool': 0.35; 'test': 0.35; 'but': 0.35; 'really': 0.36; 'received:com.au': 0.36; 'charset:us-ascii': 0.36; 'received:211': 0.38; 'whatever': 0.38; 'to:addr:python- list': 0.38; 'to:addr:python.org': 0.39; 'enough': 0.39; 'how': 0.40; 'most': 0.60; 'new': 0.61; 'content-disposition:inline': 0.62; 'skip:n 10': 0.64; 'account': 0.65; 'believe': 0.68; 'bothered': 0.68; 'choose.': 0.84; 'loose': 0.84; 'have.': 0.93; 'imagine': 0.93
Date	Sat, 15 Nov 2014 17:29:48 +1100
From	Cameron Simpson <cs@zip.com.au>
To	python-list@python.org
Subject	Re: Efficient Threading
MIME-Version	1.0
Content-Type	text/plain; charset=us-ascii; format=flowed
Content-Disposition	inline
In-Reply-To	<CABcP1UeoZ2JHcFsMMtKWY3WfEEH5mSGup4i5=KCzzUKga9bKMw@mail.gmail.com>
User-Agent	Mutt/1.5.23 (2014-03-12)
References	<CABcP1UeoZ2JHcFsMMtKWY3WfEEH5mSGup4i5=KCzzUKga9bKMw@mail.gmail.com>
X-Optus-CM-Score	0
X-Optus-CM-Analysis	v=2.1 cv=dMCfxopb c=1 sm=1 tr=0 a=YuQlxtEQCowy2cfE5kc7TA==:117 a=YuQlxtEQCowy2cfE5kc7TA==:17 a=ZtCCktOnAAAA:8 a=PO7r1zJSAAAA:8 a=J0QyKEt1u0cA:10 a=kj9zAlcOel0A:10 a=vrnE16BAAAAA:8 a=pGLkceISAAAA:8 a=ewt_Soum5ycpMXvlGWQA:9 a=CjuIK1q_8ugA:10
X-BeenThere	python-list@python.org
X-Mailman-Version	2.1.15
Precedence	list
List-Id	General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe	<https://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive	<http://mail.python.org/pipermail/python-list/>
List-Post	<mailto:python-list@python.org>
List-Help	<mailto:python-list-request@python.org?subject=help>
List-Subscribe	<https://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups	comp.lang.python
Message-ID	<mailman.15846.1416032993.18130.python-list@python.org> (permalink)
Lines	19
NNTP-Posting-Host	2001:888:2000:d::a6
X-Trace	1416032993 news.xs4all.nl 2940 [2001:888:2000:d::a6]:58262
X-Complaints-To	abuse@xs4all.nl
Xref	csiph.com comp.lang.python:80812

Show key headers only | View raw

On 14Nov2014 18:42, Empty Account <emptya45@gmail.com> wrote:
>I am thinking about writing a load test tool in Python, so I am interested
>in how I can create the most concurrent threads/processes with the fewest
>OS resources. I would imagine that I/O would need to be non-blocking.
>
>There are a number of options including standard library threading, gevent,
>stackless python, cython parallelism etc. Because I am new to Python, I am
>unsure on which libraries to choose. I am not really bothered on the tool
>chain, just as long as it is Python related (so I'd use PyPy for example).

The locust.io load test tool uses gevent and seems to like it. I do not know 
enough to make a recommendation myself, but I believe they use it for the same 
reasons you have.

Cheers,
Cameron Simpson <cs@zip.com.au>

Whatever is not nailed down is mine.  What I can pry loose is not nailed
down. - Collis P. Huntingdon

Back to comp.lang.python | Previous | Next | Find similar | Unroll thread

Thread

Re: Efficient Threading Cameron Simpson <cs@zip.com.au> - 2014-11-15 17:29 +1100

csiph-web