Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > linux.kernel > #1317055

Re: [PATCH] sched: Make schedstats a runtime tunable that is disabled by default

Show all headers | View raw

On Mon, Jan 25, 2016 at 03:59:44PM +0100, Peter Zijlstra wrote:
> On Mon, Jan 25, 2016 at 01:39:44PM +0000, Mel Gorman wrote:
> > On Mon, Jan 25, 2016 at 12:26:06PM +0100, Peter Zijlstra wrote:
> > > On Mon, Jan 25, 2016 at 10:05:31AM +0000, Mel Gorman wrote:
> > > > schedstats is very useful during debugging and performance tuning but it
> > > > incurs overhead. As such, even though it can be disabled at build time,
> > > > it is often enabled as the information is useful.  This patch adds a
> > > > kernel command-line and sysctl tunable to enable or disable schedstats on
> > > > demand. It is disabled by default as someone who knows they need it can
> > > > also learn to enable it when necessary.
> > > 
> > > So the reason its often enabled in distro configs is (IIRC) that it
> > > enables trace_sched_stat_{wait,sleep,iowait,blocked}().
> > > 
> > > I've not looked at the details of this patch, but I suspect this patch
> > > would make these tracepoints available but non-functional unless you
> > > poke the magic button.
> > > 
> > 
> > It's potentially slightly worse than that. The tracepoints are available,
> > functional but produce garbage unless the magic button is poked and do
> > a lot of useful work producing that garbage. I missed a few hunks that
> > are included below. With this, the tracepoints will exist but unless the
> > magic button is poked, they'll never fire. Considering the paths
> > affected, this will require retesting but if it's ok, would you be ok in
> > general with a patch like this that forces a button to be pushed if
> > the user is doing performance analysis?
> 
> Its rather unintuitive and error prone semantics :/
> 
> Ideally we'd auto-magically enable the magic knob if any of these
> affected tracepoints become active.

This would also be misleading. Once enabled, the stats start being
updated. An already sleeping process will not have wait_start set so the
trace information for wakeups will initially be completely bogus.

> Or alternatively fail to enable the
> tracepoints (which would then get us people going: 'WTF this used to
> work').
> 

Each option is at least visible to some extent so there would be a period
of time of wtf for analysing scheduler performance. I'm not sure there is
a way of failing to set a tracepoint but I'll check it out.

> One of the things on my TODO is look at how much of sched_stat is
> required for these tracepoints and see if we can enable just that
> (hopefully) little bit, while not doing the rest of the accounting.
> 

I don't think many are required but some of them are expensive to keep
track of. Look at enqueue_sleeper as an example of the amount of work
required just to have the tracepoint available.

-- 
Mel Gorman
SUSE Labs

Back to linux.kernel | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread

Thread

[PATCH] sched: Make schedstats a runtime tunable that is disabled by default Mel Gorman <mgorman@techsingularity.net> - 2016-01-25 11:10 +0100
  Re: [PATCH] sched: Make schedstats a runtime tunable that is  disabled by default Peter Zijlstra <peterz@infradead.org> - 2016-01-25 12:30 +0100
    Re: [PATCH] sched: Make schedstats a runtime tunable that is  disabled by default Mel Gorman <mgorman@techsingularity.net> - 2016-01-25 14:50 +0100
      Re: [PATCH] sched: Make schedstats a runtime tunable that is  disabled by default Peter Zijlstra <peterz@infradead.org> - 2016-01-25 16:00 +0100
        Re: [PATCH] sched: Make schedstats a runtime tunable that is  disabled by default Ingo Molnar <mingo@kernel.org> - 2016-01-25 16:50 +0100
          Re: [PATCH] sched: Make schedstats a runtime tunable that is  disabled by default Mel Gorman <mgorman@techsingularity.net> - 2016-01-25 18:10 +0100
            Re: [PATCH] sched: Make schedstats a runtime tunable that is  disabled by default Ingo Molnar <mingo@kernel.org> - 2016-01-25 19:50 +0100
              Re: [PATCH] sched: Make schedstats a runtime tunable that is  disabled by default Mel Gorman <mgorman@techsingularity.net> - 2016-01-25 21:20 +0100
                Re: [PATCH] sched: Make schedstats a runtime tunable that is  disabled by default Mel Gorman <mgorman@techsingularity.net> - 2016-01-25 21:50 +0100
                Re: [PATCH] sched: Make schedstats a runtime tunable that is  disabled by default Ingo Molnar <mingo@kernel.org> - 2016-01-26 09:20 +0100
        Re: [PATCH] sched: Make schedstats a runtime tunable that is  disabled by default Mel Gorman <mgorman@techsingularity.net> - 2016-01-25 18:10 +0100
  Re: [PATCH] sched: Make schedstats a runtime tunable that is  disabled by default Matt Fleming <matt@codeblueprint.co.uk> - 2016-01-25 16:30 +0100
    Re: [PATCH] sched: Make schedstats a runtime tunable that is  disabled by default Mel Gorman <mgorman@techsingularity.net> - 2016-01-25 17:50 +0100

csiph-web