Groups > comp.programming.threads > #2021

Data copying on NUMA

Newsgroups	comp.programming.threads
Subject	Data copying on NUMA
From	Paavo Helde <myfirstname@osa.pri.ee>
Organization	PKI
Message-ID	<XnsA287445E6980myfirstnameosapriee@216.196.109.131> (permalink)
Date	2013-11-28 16:25 -0600

Show all headers | View raw

On NUMA, as the acronym says, some memory is better accessible by a certain 
NUMA node than others. Now, let's say I have a deep dynamic-allocated data 
structure I want to use in a thread running in another NUMA node, how 
should I pass it there? Should I perform the copy in the other thread so 
that the new dynamic allocations take place in the target thread? Probably 
depends on the memory allocator, what would be the best choice for 
Linux/Windows?

This is not a theoretical question, actually we see a large scaling 
performance drop on NUMA and have to decide whether to go multi-process 
somehow or are there some ways to make multi-threaded apps to behave 
better. As far as I understand there is a hard limit of 64 worker threads 
per process on Windows, so probably we have to go multi-process anyway at 
some time point. Any insights or comments?

TIA
Paavo

Back to comp.programming.threads | Previous | Next — Next in thread | Find similar

Thread

Data copying on NUMA Paavo Helde <myfirstname@osa.pri.ee> - 2013-11-28 16:25 -0600
  Re: Data copying on NUMA Robert Wessel <robertwessel2@yahoo.com> - 2013-12-01 19:21 -0600
  Re: Data copying on NUMA andrew@cucumber.demon.co.uk (Andrew Gabriel) - 2013-12-07 10:34 +0000

csiph-web