Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > linux.kernel > #1244993 > unrolled thread

Re: [lkp] [sched/fair] 98d8fd8126: -20.8% hackbench.throughput

Started byDietmar Eggemann <dietmar.eggemann@arm.com>
First post2015-10-12 20:50 +0200
Last post2015-10-14 03:50 +0200
Articles 2 — 2 participants

Back to article view | Back to linux.kernel

This discussion starts older than the indexed window; earlier articles aren't shown. The article labeled Started by below is the oldest one visible, not the original post.


Contents

  Re: [lkp] [sched/fair] 98d8fd8126: -20.8% hackbench.throughput Dietmar Eggemann <dietmar.eggemann@arm.com> - 2015-10-12 20:50 +0200
    Re: [lkp] [sched/fair] 98d8fd8126: -20.8% hackbench.throughput "Huang\, Ying" <ying.huang@linux.intel.com> - 2015-10-14 03:50 +0200

#1244993 — Re: [lkp] [sched/fair] 98d8fd8126: -20.8% hackbench.throughput

FromDietmar Eggemann <dietmar.eggemann@arm.com>
Date2015-10-12 20:50 +0200
SubjectRe: [lkp] [sched/fair] 98d8fd8126: -20.8% hackbench.throughput
Message-ID<qiQkx-7rT-7@gated-at.bofh.it>
Hi Ying,

On 24/09/15 03:00, kernel test robot wrote:
> FYI, we noticed the below changes on
> 
> https://git.kernel.org/pub/scm/linux/kernel/git/tip/tip.git sched/core
> commit 98d8fd8126676f7ba6e133e65b2ca4b17989d32c ("sched/fair: Initialize task load and utilization before placing task on rq")
> 
> 
> =========================================================================================
> tbox_group/testcase/rootfs/kconfig/compiler/nr_threads/mode/ipc:
>   lkp-ws02/hackbench/debian-x86_64-2015-02-07.cgz/x86_64-rhel/gcc-4.9/1600%/process/pipe
> 
> commit: 
>   231678b768da07d19ab5683a39eeb0c250631d02
>   98d8fd8126676f7ba6e133e65b2ca4b17989d32c
> 
> 231678b768da07d1 98d8fd8126676f7ba6e133e65b 
> ---------------- -------------------------- 
>          %stddev     %change         %stddev
>              \          |                \  
>     188818 ±  1%     -20.8%     149585 ±  1%  hackbench.throughput

[...]

> 
> lkp-ws02: Westmere-EP
> Memory: 16G
> 
> 
> 
> 
>                       hackbench.time.involuntary_context_switches
> 
>     3e+08 ++------------------------O---------------------------------------+
>           O  O         O   O     O                                          |
>   2.5e+08 ++     O                                                O  O   O  O
>           |         O                   O     O      O                      |
>           |                   O                   O     O   O               |
>     2e+08 ++                               O                                |
>           |                                                    O            |
>   1.5e+08 ++                                                                |
>           |                                                                 |
>     1e+08 ++                                                                |
>           |                                  .*...*..*..*...*..*            |
>           *..*...*..*..*...*..  .*..  ..*..*.                               |
>     5e+07 ++                  *.    *.                                      |
>           |                                                                 |
>         0 ++----------------------------------------------------------------+
> 
>                                   vmstat.system.in
> 
>   300000 ++-----------------------------------------------------------------+
>          |                O     O   O                                       |
>          O            O      O                                       O   O  |
>   250000 ++ O   O                                                 O         O
>          |         O                                                        |
>          |                             O      O  O   O  O  O                |
>   200000 ++                                O                   O            |
>          |                                                                  |
>   150000 ++                                                                 |
>          |                                                                  |
>          |                                                                  |
>   100000 ++                                                                 |
>          |           .*...                   .*..*...*..*..*...*            |
>          *..*...*..*.     *..  .*...  .*...*.                               |
>    50000 ++------------------*------*---------------------------------------+
> 
> 	[*] bisect-good sample
> 	[O] bisect-bad  sample
> 
> To reproduce:
> 
>         git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git
>         cd lkp-tests
>         bin/lkp install job.yaml  # job file is attached in this email
>         bin/lkp run     job.yaml

I try to recreate this on one of my Intel machines (Xeon CPU E5-2650 v2
@ 2.60GHz) w/ 16 logical cpus. We haven't seen anything near a 20%
performance degradation for hackbench when we were running our hackbench
tests on 5/6 core arm machines as well as on a IVB-EP (2*10*2) Intel
machine.

So I cloned the repo:

# git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg
/lkp-tests.git lkp-tests

and ran the hackbench example:

root # lkp install $LKP_SRC/jobs/hackbench.yaml

root # lkp split-job $LKP_SRC/jobs/hackbench.yaml

root # lkp run ./hackbench-50%-threads-socket.yaml

2015-10-12 19:27:20 /usr/bin/hackbench -g 8 --threads -l 60000
Running in threaded mode with 8 groups using 40 file descriptors each
(== 320 tasks)
Each sender will pass 60000 messages of 100 bytes
...
wait for background monitors: perf-profile uptime proc-vmstat proc-stat
meminfo slabinfo interrupts softirqs diskstats cpuidle turbostat sched_debug

root # lkp result hackbench

/result/hackbench/50%-threads-socket-50/$MACHINE/ubuntu/defconfig/gcc-4.8/3.16.0-50-generic/0/

But I can't get any statistics out of it?

root # lkp stat hackbench
runs sum average stddev% case

Thanks for your help in advance!

-- Dietmar

[...]

--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

[toc] | [next] | [standalone]


#1246245

From"Huang\, Ying" <ying.huang@linux.intel.com>
Date2015-10-14 03:50 +0200
Message-ID<qjjmy-8lg-9@gated-at.bofh.it>
In reply to#1244993
Dietmar Eggemann <dietmar.eggemann@arm.com> writes:

> Hi Ying,
>
> On 24/09/15 03:00, kernel test robot wrote:
>> FYI, we noticed the below changes on
>> 
>> https://git.kernel.org/pub/scm/linux/kernel/git/tip/tip.git sched/core
>> commit 98d8fd8126676f7ba6e133e65b2ca4b17989d32c ("sched/fair: Initialize task load and utilization before placing task on rq")
>> 
>> 
>> =========================================================================================
>> tbox_group/testcase/rootfs/kconfig/compiler/nr_threads/mode/ipc:
>>   lkp-ws02/hackbench/debian-x86_64-2015-02-07.cgz/x86_64-rhel/gcc-4.9/1600%/process/pipe
>> 
>> commit: 
>>   231678b768da07d19ab5683a39eeb0c250631d02
>>   98d8fd8126676f7ba6e133e65b2ca4b17989d32c
>> 
>> 231678b768da07d1 98d8fd8126676f7ba6e133e65b 
>> ---------------- -------------------------- 
>>          %stddev     %change         %stddev
>>              \          |                \  
>>     188818 ±  1%     -20.8%     149585 ±  1%  hackbench.throughput
>
> [...]
>
>> 
>> lkp-ws02: Westmere-EP
>> Memory: 16G
>> 
>> 
>> 
>> 
>>                       hackbench.time.involuntary_context_switches
>> 
>>     3e+08 ++------------------------O---------------------------------------+
>>           O  O         O   O     O                                          |
>>   2.5e+08 ++     O                                                O  O   O  O
>>           |         O                   O     O      O                      |
>>           |                   O                   O     O   O               |
>>     2e+08 ++                               O                                |
>>           |                                                    O            |
>>   1.5e+08 ++                                                                |
>>           |                                                                 |
>>     1e+08 ++                                                                |
>>           |                                  .*...*..*..*...*..*            |
>>           *..*...*..*..*...*..  .*..  ..*..*.                               |
>>     5e+07 ++                  *.    *.                                      |
>>           |                                                                 |
>>         0 ++----------------------------------------------------------------+
>> 
>>                                   vmstat.system.in
>> 
>>   300000 ++-----------------------------------------------------------------+
>>          |                O     O   O                                       |
>>          O            O      O                                       O   O  |
>>   250000 ++ O   O                                                 O         O
>>          |         O                                                        |
>>          |                             O      O  O   O  O  O                |
>>   200000 ++                                O                   O            |
>>          |                                                                  |
>>   150000 ++                                                                 |
>>          |                                                                  |
>>          |                                                                  |
>>   100000 ++                                                                 |
>>          |           .*...                   .*..*...*..*..*...*            |
>>          *..*...*..*.     *..  .*...  .*...*.                               |
>>    50000 ++------------------*------*---------------------------------------+
>> 
>> 	[*] bisect-good sample
>> 	[O] bisect-bad  sample
>> 
>> To reproduce:
>> 
>>         git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git
>>         cd lkp-tests
>>         bin/lkp install job.yaml  # job file is attached in this email
>>         bin/lkp run     job.yaml
>
> I try to recreate this on one of my Intel machines (Xeon CPU E5-2650 v2
> @ 2.60GHz) w/ 16 logical cpus. We haven't seen anything near a 20%
> performance degradation for hackbench when we were running our hackbench
> tests on 5/6 core arm machines as well as on a IVB-EP (2*10*2) Intel
> machine.
>
> So I cloned the repo:
>
> # git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg
> /lkp-tests.git lkp-tests
>
> and ran the hackbench example:
>
> root # lkp install $LKP_SRC/jobs/hackbench.yaml
>
> root # lkp split-job $LKP_SRC/jobs/hackbench.yaml
>
> root # lkp run ./hackbench-50%-threads-socket.yaml
>
> 2015-10-12 19:27:20 /usr/bin/hackbench -g 8 --threads -l 60000
> Running in threaded mode with 8 groups using 40 file descriptors each
> (== 320 tasks)
> Each sender will pass 60000 messages of 100 bytes
> ...
> wait for background monitors: perf-profile uptime proc-vmstat proc-stat
> meminfo slabinfo interrupts softirqs diskstats cpuidle turbostat sched_debug
>
> root # lkp result hackbench
>
> /result/hackbench/50%-threads-socket-50/$MACHINE/ubuntu/defconfig/gcc-4.8/3.16.0-50-generic/0/

There is a 'stats.json' file in this directory, where you can find your
test result.

> But I can't get any statistics out of it?
>
> root # lkp stat hackbench
> runs sum average stddev% case

You need to specify more option for 'lkp stat', please take a look at
'lkp stat -h' help message.

Best Regards,
Huang, Ying

> Thanks for your help in advance!
>
> -- Dietmar
>
> [...]
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

[toc] | [prev] | [standalone]


Back to top | Article view | linux.kernel


csiph-web