Path: csiph.com!aioe.org!news.servidellagleba.it!bofh.it!news.nic.it!robomod
From: Peter Zijlstra <peterz@infradead.org>
Newsgroups: linux.kernel
Subject: Re: [RFC v5 9/9] sched/deadline: also reclaim bandwidth not used by  dl tasks
Date: Mon, 27 Mar 2017 16:10:02 +0200
Message-ID: <tpDvk-Li-5@gated-at.bofh.it>
References: <toh3P-72e-5@gated-at.bofh.it> <toh3P-72e-11@gated-at.bofh.it>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
User-Agent: NeoMutt/20170113 (1.7.2)
Sender: robomod@news.nic.it
Approved: robomod@news.nic.it
Lines: 27
Organization: linux.* mail to news gateway
Xref: csiph.com linux.kernel:1609864

On Fri, Mar 24, 2017 at 04:53:02AM +0100, luca abeni wrote:

> +static inline
> +void __dl_update(struct dl_bw *dl_b, s64 bw)
> +{
> +	struct root_domain *rd = container_of(dl_b, struct root_domain, dl_bw);
> +	int i;
> +
> +	RCU_LOCKDEP_WARN(!rcu_read_lock_sched_held(),
> +			 "sched RCU must be held");
> +	for_each_cpu_and(i, rd->span, cpu_active_mask) {
> +		struct rq *rq = cpu_rq(i);
> +
> +		rq->dl.extra_bw += bw;
> +	}

So this is unfortunate (and we already have one such instance).

It effectively does an for_each_online_cpu() with IRQs disabled, and on
SGI class hardware that takes _forever_.

This is also what I got stuck on trying to rewrite AC to use Tommaso's
recoverable thing. In the end I had to do a 2 stage try/commit variant.
Which ended up being a pain and I didn't finish.

I'm not saying this patch is bad, but this is something we need to thing
about.