Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.lang.python > #10480 > unrolled thread

Any suggestion to start more threads at the same time?

Back to article view | Back to comp.lang.python

Contents

  Any suggestion to start more threads at the same time? smith jack <thinke365@gmail.com> - 2011-07-29 05:07 +0800
    Re: Any suggestion to start more threads at the same time? Irmen de Jong <irmen.NOSPAM@xs4all.nl> - 2011-07-29 01:35 +0200

#10480 — Any suggestion to start more threads at the same time?

I start many threads in order to make the work done, when the
concurrent number is set to 300, all thing just works fine, but when
the number is set to 350 or higher, error just comes out? what's wrong
? the error info is just as follows:   failed to start .

I am confused, does this have something to do with the operating
system, i am now using Linux, any suggestion to make the system to
support more python threads?

thank you :)

[toc] | [next] | [standalone]

#10488

On 28-7-2011 23:07, smith jack wrote:
> I start many threads in order to make the work done, when the
> concurrent number is set to 300, all thing just works fine, but when
> the number is set to 350 or higher, error just comes out? what's wrong
> ? the error info is just as follows:   failed to start .
> 
> I am confused, does this have something to do with the operating
> system, i am now using Linux, any suggestion to make the system to
> support more python threads?
> 
> thank you :)

I don't think that many threads are going to help you in any meaningful way. Especially
with Python's GIL. Can't you redesign your program to use a fixed number of threads such
as 1 per cpu core?

Or check out the multiprocessing module.

But yeah, I think your OS is preventing you from creating more threads (either due to
some artificial limit or due to lack of system memory).

Irmen

[toc] | [prev] | [standalone]

Back to top | Article view | comp.lang.python

csiph-web