Re: Severe performance regression w/ 4.4+ on Android due to cgroup locking changes

From	Peter Zijlstra <peterz@infradead.org>
Newsgroups	linux.kernel
Subject	Re: Severe performance regression w/ 4.4+ on Android due to cgroup locking changes
Date	2016-07-14 14:20 +0200
Message-ID	<rUNMu-19G-19@gated-at.bofh.it> (permalink)
References	(5 earlier) <rUzzP-8ue-3@gated-at.bofh.it> <rUzJv-7e-13@gated-at.bofh.it> <rUAvT-Hu-1@gated-at.bofh.it> <rUIMO-64Y-9@gated-at.bofh.it> <rUN07-BW-33@gated-at.bofh.it>
Organization	linux.* mail to news gateway

Show all headers | View raw

On Thu, Jul 14, 2016 at 07:20:46AM -0400, Tejun Heo wrote:
> On Thu, Jul 14, 2016 at 08:49:56AM +0200, Peter Zijlstra wrote:

> > So the immediate problem with lg style locks is that the 'local' lock
> > will not stay local since these are preemptible locks we can get
> > migrations etc..
> > 
> > All fixable, but still.
> 
> In this case, the locks are read-locked only across operations which
> change process hierarchy.  They'll occasionally get migrated while
> holding the lock for sure but not often enough to matter.

Means having to change the interface to pass along what 'local' is, like
srcu_read_lock().

> > So the main objection I have is that this isn't a fundamental fix, this
> > only cures things because Android only runs on small machines.
> >
> > If someone with a big computer tries to do the same things we're up some
> > creek without no paddle. There's just no way we can make a global writer
> > 'fast'.
> 
> How so?  As the number of cores increases, it'll get proportionally
> more expensive as the same operation is performed on more CPUs;
> however, the latency is dependent on the slowest one and it'll get
> higher more often with more number of CPUs but not drastically.

A global lock on 4 or 8 socket machines with all 200+ cpus trying to
use it really stinks.

Remember, they switch cgroups at really rather high rates here, because
of that binder stuff. I don't see how you can defend a global lock here
:/ Global locks only work when writers are extremely rare, and clearly
that premise is false.

Also note that since these are preemptible locks, you can get unbounded
priority inversions.

Thread

Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes John Stultz <john.stultz@linaro.org> - 2016-07-13 02:10 +0200
  Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Peter Zijlstra <peterz@infradead.org> - 2016-07-13 10:30 +0200
    Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes "Paul E. McKenney" <paulmck@linux.vnet.ibm.com> - 2016-07-13 16:50 +0200
      Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes "Paul E. McKenney" <paulmck@linux.vnet.ibm.com> - 2016-07-13 20:40 +0200
  Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Tejun Heo <tj@kernel.org> - 2016-07-13 20:30 +0200
    Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Tejun Heo <tj@kernel.org> - 2016-07-13 20:40 +0200
      Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Tejun Heo <tj@kernel.org> - 2016-07-13 22:20 +0200
        Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Peter Zijlstra <peterz@infradead.org> - 2016-07-13 22:30 +0200
          Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Tejun Heo <tj@kernel.org> - 2016-07-13 22:50 +0200
            Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Peter Zijlstra <peterz@infradead.org> - 2016-07-13 23:00 +0200
              Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Tejun Heo <tj@kernel.org> - 2016-07-13 23:10 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes "Paul E. McKenney" <paulmck@linux.vnet.ibm.com> - 2016-07-13 23:20 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes "Paul E. McKenney" <paulmck@linux.vnet.ibm.com> - 2016-07-13 23:50 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes John Stultz <john.stultz@linaro.org> - 2016-07-13 23:50 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes "Paul E. McKenney" <paulmck@linux.vnet.ibm.com> - 2016-07-14 00:20 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes John Stultz <john.stultz@linaro.org> - 2016-07-14 00:40 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes "Paul E. McKenney" <paulmck@linux.vnet.ibm.com> - 2016-07-14 01:10 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes "Paul E. McKenney" <paulmck@linux.vnet.ibm.com> - 2016-07-14 01:10 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Tejun Heo <tj@kernel.org> - 2016-07-14 13:40 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Peter Zijlstra <peterz@infradead.org> - 2016-07-14 14:10 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Tejun Heo <tj@kernel.org> - 2016-07-14 14:10 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Peter Zijlstra <peterz@infradead.org> - 2016-07-14 14:30 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Tejun Heo <tj@kernel.org> - 2016-07-14 17:10 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Tejun Heo <tj@kernel.org> - 2016-07-14 17:30 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Peter Zijlstra <peterz@infradead.org> - 2016-07-14 18:40 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Oleg Nesterov <oleg@redhat.com> - 2016-07-14 19:40 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes John Stultz <john.stultz@linaro.org> - 2016-07-14 19:00 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes John Stultz <john.stultz@linaro.org> - 2016-07-14 00:30 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Tejun Heo <tj@kernel.org> - 2016-07-14 00:10 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes "Paul E. McKenney" <paulmck@linux.vnet.ibm.com> - 2016-07-14 00:40 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Peter Zijlstra <peterz@infradead.org> - 2016-07-14 09:00 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Tejun Heo <tj@kernel.org> - 2016-07-14 13:30 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Peter Zijlstra <peterz@infradead.org> - 2016-07-14 14:20 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Tejun Heo <tj@kernel.org> - 2016-07-14 17:20 +0200
              Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Tejun Heo <tj@kernel.org> - 2016-07-13 23:10 +0200
              Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes "Paul E. McKenney" <paulmck@linux.vnet.ibm.com> - 2016-07-13 23:10 +0200
              Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Peter Zijlstra <peterz@infradead.org> - 2016-07-14 15:20 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Peter Zijlstra <peterz@infradead.org> - 2016-07-14 16:20 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Oleg Nesterov <oleg@redhat.com> - 2016-07-14 17:00 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Peter Zijlstra <peterz@infradead.org> - 2016-07-14 18:20 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Peter Zijlstra <peterz@infradead.org> - 2016-07-14 18:40 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Oleg Nesterov <oleg@redhat.com> - 2016-07-14 19:10 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes "Paul E. McKenney" <paulmck@linux.vnet.ibm.com> - 2016-07-14 18:30 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Peter Zijlstra <peterz@infradead.org> - 2016-07-14 18:50 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes "Paul E. McKenney" <paulmck@linux.vnet.ibm.com> - 2016-07-14 19:20 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes John Stultz <john.stultz@linaro.org> - 2016-07-14 18:50 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Peter Zijlstra <peterz@infradead.org> - 2016-07-14 18:50 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes John Stultz <john.stultz@linaro.org> - 2016-07-14 19:10 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Oleg Nesterov <oleg@redhat.com> - 2016-07-14 19:20 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes John Stultz <john.stultz@linaro.org> - 2016-07-14 19:40 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Oleg Nesterov <oleg@redhat.com> - 2016-07-14 19:50 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes John Stultz <john.stultz@linaro.org> - 2016-07-14 20:00 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Oleg Nesterov <oleg@redhat.com> - 2016-07-14 20:10 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Peter Zijlstra <peterz@infradead.org> - 2016-07-14 20:40 +0200
                Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Peter Zijlstra <peterz@infradead.org> - 2016-07-14 21:40 +0200
            Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes John Stultz <john.stultz@linaro.org> - 2016-07-13 23:00 +0200
          Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Peter Zijlstra <peterz@infradead.org> - 2016-07-13 23:00 +0200
            Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes "Paul E. McKenney" <paulmck@linux.vnet.ibm.com> - 2016-07-13 23:10 +0200
          Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes "Paul E. McKenney" <paulmck@linux.vnet.ibm.com> - 2016-07-13 23:00 +0200
            Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Dmitry Shmidt <dimitrysh@google.com> - 2016-07-13 23:10 +0200
              Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes "Paul E. McKenney" <paulmck@linux.vnet.ibm.com> - 2016-07-13 23:10 +0200
              Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes John Stultz <john.stultz@linaro.org> - 2016-07-13 23:10 +0200
      Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes John Stultz <john.stultz@linaro.org> - 2016-07-13 22:20 +0200
      Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Dmitry Shmidt <dimitrysh@google.com> - 2016-07-13 22:40 +0200
    Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Colin Cross <ccross@google.com> - 2016-07-13 22:50 +0200
      Re: Severe performance regression w/ 4.4+ on Android due to cgroup  locking changes Tejun Heo <tj@kernel.org> - 2016-07-13 23:00 +0200

csiph-web