Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > linux.kernel > #1178748

Re: [patch] Re: [PATCH RESEND] sched: prefer an idle cpu vs an idle sibling for BALANCE_WAKE

Path csiph.com!aioe.org!news.servidellagleba.it!bofh.it!news.nic.it!robomod
From Josef Bacik <jbacik@fb.com>
Newsgroups linux.kernel
Subject Re: [patch] Re: [PATCH RESEND] sched: prefer an idle cpu vs an idle sibling for BALANCE_WAKE
Date Tue, 07 Jul 2015 19:10:03 +0200
Message-ID <pJExB-8or-31@gated-at.bofh.it> (permalink)
References <puR3I-7wi-25@gated-at.bofh.it> <pv3ey-qO-15@gated-at.bofh.it> <pv3Rf-1sc-13@gated-at.bofh.it> <pApRa-4oZ-39@gated-at.bofh.it> <pCpWG-vm-19@gated-at.bofh.it> <pCwlt-1az-7@gated-at.bofh.it> <pCyZY-57I-9@gated-at.bofh.it> <pCzsZ-5UG-5@gated-at.bofh.it> <pHQMx-5Ls-3@gated-at.bofh.it> <pI2Xn-56Q-5@gated-at.bofh.it> <pINtf-tz-7@gated-at.bofh.it> <pINtf-tz-5@gated-at.bofh.it> <pJ6YV-42D-1@gated-at.bofh.it> <pJfIS-19A-21@gated-at.bofh.it> <pJjt8-3rS-3@gated-at.bofh.it> <pJkyR-45h-1@gated-at.bofh.it> <pJsmJ-KT-11@gated-at.bofh.it> <pJxFM-3Yh-25@gated-at.bofh.it>
X-Original-To Mike Galbraith <umgwanakikbuti@gmail.com>
Dkim-Signature v=1; a=rsa-sha256; c=relaxed/simple; d=fb.com; h=message-id : date : from : mime-version : to : cc : subject : references : in-reply-to : content-type : content-transfer-encoding; s=facebook; bh=IMD8vTHt3dvqd5h08+mbTM4wo4BCz3ZoVuRhy4K8Rfs=; b=gGipckPdipxDgTdLI8XDdPd5oN09K695kb+64FQgf9DnGv31qUJJXORwn5dFClpO7Rne b2rUhVr/msYewNR6d7RSc58k64Uz0PfrnVujV39dt757KjDxl7l98iq2HRiRen6M7wxa 1w7UBPO67cV26pKV6qKJRwF5ueWb8rVno5M=
User-Agent Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.7.0
MIME-Version 1.0
Content-Type text/plain; charset="utf-8"; format=flowed
Content-Transfer-Encoding 7bit
X-Originating-IP [192.168.52.123]
X-Proofpoint-Spam-Reason safe
X-Fb-Internal Safe
X-Proofpoint-Virus-Version vendor=fsecure engine=2.50.10432:5.14.151,1.0.33,0.0.0000 definitions=2015-07-07_06:2015-07-07,2015-07-07,1970-01-01 signatures=0
Sender robomod@news.nic.it
List-ID <linux-kernel.vger.kernel.org>
X-Mailing-List linux-kernel@vger.kernel.org
Approved robomod@news.nic.it
Lines 91
Organization linux.* mail to news gateway
X-Original-Cc Peter Zijlstra <peterz@infradead.org>, <riel@redhat.com>, <mingo@redhat.com>, <linux-kernel@vger.kernel.org>, <morten.rasmussen@arm.com>, kernel-team <Kernel-team@fb.com>
X-Original-Date Tue, 7 Jul 2015 13:06:08 -0400
X-Original-Message-ID <559C0700.6090009@fb.com>
X-Original-References <1432761736-22093-1-git-send-email-jbacik@fb.com> <20150528102127.GD3644@twins.programming.kicks-ass.net> <20150528110514.GR18673@twins.programming.kicks-ass.net> <1434087305.3674.26.camel@gmail.com> <5581B70D.2000800@fb.com> <1434588939.3444.25.camel@gmail.com> <55823F33.7040005@fb.com> <1434600765.3393.9.camel@gmail.com> <55957871.7080906@fb.com> <1435905658.6418.52.camel@gmail.com> <1436025462.17152.37.camel@gmail.com> <1436080661.22930.22.camel@gmail.com> <1436159590.5850.27.camel@gmail.com> <559A91F4.7000903@fb.com> <1436207790.2940.30.camel@gmail.com> <559AD9CE.4090309@fb.com> <1436241678.1836.29.camel@gmail.com> <1436262224.1836.74.camel@gmail.com>
X-Original-Sender linux-kernel-owner@vger.kernel.org
Xref aioe.org linux.kernel:1178748

Show key headers only | View raw


On 07/07/2015 05:43 AM, Mike Galbraith wrote:
> On Tue, 2015-07-07 at 06:01 +0200, Mike Galbraith wrote:
>> On Mon, 2015-07-06 at 15:41 -0400, Josef Bacik wrote:
>>
>>> So the NO_WAKE_WIDE_IDLE results are very good, almost the same as the
>>> baseline with a slight regression at lower RPS and a slight improvement
>>> at high RPS.
>>
>> Good.  I can likely drop the rest then (I like dinky, so do CPUs;).  I'm
>> not real keen on the feature unless your numbers are really good, and
>> odds are that ain't gonna happen.
>
> More extensive testing in pedantic-man mode increased my confidence of
> that enough to sign off and ship the dirt simple version.  Any further
> twiddles should grow their own wings if they want to fly anyway, the
> simplest form helps your real world load, as well as the not so real
> pgbench, my numbers for that below.
>
> virgin master, 2 socket box
> postgres@nessler:~> pgbench.sh
> clients 12      tps = 96233.854271     1.000
> clients 24      tps = 142234.686166    1.000
> clients 36      tps = 148433.534531    1.000
> clients 48      tps = 133105.634302    1.000
> clients 60      tps = 128903.080371    1.000
> clients 72      tps = 128591.821782    1.000
> clients 84      tps = 114445.967116    1.000
> clients 96      tps = 109803.557524    1.000    avg   125219.017   1.000
>
> V3 (KISS, below)
> postgres@nessler:~> pgbench.sh
> clients 12      tps = 120793.023637    1.255
> clients 24      tps = 144668.961468    1.017
> clients 36      tps = 156705.239251    1.055
> clients 48      tps = 152004.886893    1.141
> clients 60      tps = 138582.113864    1.075
> clients 72      tps = 136286.891104    1.059
> clients 84      tps = 137420.986043    1.200
> clients 96      tps = 135199.060242    1.231   avg   140207.645   1.119   1.000
>
> V2 NO_WAKE_WIDE_IDLE
> postgres@nessler:~> pgbench.sh
> clients 12      tps = 121821.966162    1.265
> clients 24      tps = 146446.388366    1.029
> clients 36      tps = 151373.362190    1.019
> clients 48      tps = 156806.730746    1.178
> clients 60      tps = 133933.491567    1.039
> clients 72      tps = 131460.489424    1.022
> clients 84      tps = 130859.340261    1.143
> clients 96      tps = 130787.476584    1.191   avg   137936.155   1.101   0.983
>
> V2 WAKE_WIDE_IDLE (crawl in a hole feature, you're dead)
> postgres@nessler:~> pgbench.sh
> clients 12      tps = 121297.791570
> clients 24      tps = 145939.488312
> clients 36      tps = 155336.090263
> clients 48      tps = 149018.245323
> clients 60      tps = 136730.079391
> clients 72      tps = 134886.116831
> clients 84      tps = 130493.283398
> clients 96      tps = 126043.336074
>
>
> sched: beef up wake_wide()
>
> Josef Bacik reported that Facebook sees better performance with their
> 1:N load (1 dispatch/node, N workers/node) when carrying an old patch
> to try very hard to wake to an idle CPU.  While looking at wake_wide(),
> I noticed that it doesn't pay attention to wakeup of the 1:N waker,
> returning 1 only when the 1:N waker is waking one of its minions.
>
> Correct that, and don't bother doing domain traversal when we know
> that all we need to do is check for an idle cpu.
>
> Signed-off-by: Mike Galbraith <umgwanakikbuti@gmail.com>

Ok you can add

Tested-by: Josef Bacik <jbacik@fb.com>

The new patch is the best across the board, there are no regressions and 
about a 5% improvement for the bulk of the run (25 percentile and up). 
Thanks for your help on this!

Josef

--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

Back to linux.kernel | Previous | Next — Previous in thread | Find similar | Unroll thread


Thread

Re: [PATCH RESEND] sched: prefer an idle cpu vs an idle sibling for  BALANCE_WAKE Mike Galbraith <umgwanakikbuti@gmail.com> - 2015-07-05 10:30 +0200
  [patch] Re: [PATCH RESEND] sched: prefer an idle cpu vs an idle  sibling for BALANCE_WAKE Mike Galbraith <umgwanakikbuti@gmail.com> - 2015-07-07 11:50 +0200
    Re: [patch] Re: [PATCH RESEND] sched: prefer an idle cpu vs an idle  sibling for BALANCE_WAKE Josef Bacik <jbacik@fb.com> - 2015-07-07 19:10 +0200

csiph-web