Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]
Groups > comp.soft-sys.math.mathematica > #5596
| From | Rafael Reiter <mail@zonk.at> |
|---|---|
| Newsgroups | comp.soft-sys.math.mathematica |
| Subject | Re: ParallelMap in FindMinimum getting slower |
| Date | 2011-10-11 08:29 +0000 |
| Organization | Steven M. Christensen and Associates, Inc and MathTensor, Inc. |
| Message-ID | <j70up0$t1$1@smc.vnet.net> (permalink) |
| References | <201110070848.EAA07424@smc.vnet.net> <Pine.LNX.4.63.1110070439250.26775@wopr.wolfram.com> <4E8F12CA.1060405@zonk.at> <Pine.LNX.4.63.1110100217081.32138@wopr.wolfram.com> |
Using Block instead of Module solved the problem, thank you very much for your help! I'd never have guessed that! Rafael On 10.10.2011 09:24, Oliver Ruebenkoenig wrote: > On Fri, 7 Oct 2011, Rafael Reiter wrote: > >> Hi, >> >> find the file attached. You can just hit "Evaluate Notebook". >> I noticed in top that the used memory is also increasing all the >> time. I guess the distributed data gets bigger and bigger, but what >> is it? >> >> Rafael > > > I do not have the time to read you notebook in all detail. Here are > some random ideas: > > - Use $HistoryLength = 0 (also evaluated via ParallelEvaluate) > - Some of the data you pass around are not packed arrays: e.g. try > > > Bloch[nkx_, nky_] := Developer`ToPackedArray[N[BlochH /. kx -> nkx /. > ky -> nky]]; > > - Also the path data contains integer and reals. Perhaps that could be > avoided. > > - After //Chop use //N//Developer`ToPackedArray > > - Perhaps replace the Module with Block > > Hope this contains the right clue. > Oliver > >> >> On 07.10.2011 11:39, Oliver Ruebenkoenig wrote: >>> On Fri, 7 Oct 2011, Rafael Reiter wrote: >>> >>>> Hi everyone, >>>> >>>> I use ParallelMap with Mathematica on Linux to solve 100 eigenvalue >>>> problems on 4 kernels. This operation ist repeated very often by >>>> FindMinimum, and over the course of time the performance drops >>>> significantly. Using top, you can see that the CPU used by the master >>>> kernel increases, and the CPU used by the slave kernels decreases from >>>> 70 to appr. 20 percent. Has anyone else experienced this phenomenon? >>>> >>>> Best wishes, >>>> Rafael >>>> >>>> >>> >>> Can you send the example? >>> >>> Oliver >> >>
Back to comp.soft-sys.math.mathematica | Previous | Next | Find similar | Unroll thread
Re: ParallelMap in FindMinimum getting slower Rafael Reiter <mail@zonk.at> - 2011-10-11 08:29 +0000
csiph-web