Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > linux.kernel > #1739302

[RFC tip/locking/lockdep v3 00/14] lockdep: Support deadlock detection for recursive read locks

Path csiph.com!eternal-september.org!feeder.eternal-september.org!aioe.org!bofh.it!news.nic.it!robomod
From Boqun Feng <boqun.feng@gmail.com>
Newsgroups linux.kernel
Subject [RFC tip/locking/lockdep v3 00/14] lockdep: Support deadlock detection for recursive read locks
Date Tue, 26 Sep 2017 00:20:02 +0200
Message-ID <utJTj-47L-3@gated-at.bofh.it> (permalink)
Dkim-Signature v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id; bh=FROL45nUKc3FQd9MueG0yt20698zfUou60q3iSyTM2I=; b=Gn6pf7EmVUThedgqX2pPv9BrTLw9TUhwR5XhT3e5TFQpi0SOMazG7/JXVVyYmyZIQO GcLIsmTz7axYDfEor7ApHUmGNGRc3WvlSAlDZH0VDhX9n++/hZqwt842efasCej/W+GS ZgBPVlqG/XlaZg44cIcPuLu3GVtjScaDrHM23KD2SprUDyTlKd/YjulHHsnboIaXOBLZ 2PZPHQVLBoKCGmLFM06tkPhJQuwX8uwDu0e3+HVzb+IT9uj+3zQ9eW1SMoVQLcqasET5 BtmIqRk3bDWGe7jv2QCGMlfrAuYXe2eKvZp9KaZFNBEfwl1xO0nQg5xnVfJmGvknYnAa JTmQ==
X-Google-Dkim-Signature v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id; bh=FROL45nUKc3FQd9MueG0yt20698zfUou60q3iSyTM2I=; b=BLpXqpXcl5cXiDZ/0KWu+NdBskCUJ4YulwX7u8aQVqTmf0lHiIyzOdtN/d4ozE5WGc BvlnEl3eP/Roc8Kyppfy+PBWkyoZvNMThShRPENEAnVqOL0TjIqaRw+ID8RI3ihhYcJ9 torNPCUS9FRi8ONl4gSnR33Dn69TZs9QNivo+a9ifcJwEL4hrXtaZV/qGNZi/+HCaMOy SwJzIDI1upvGZzeSI3YCbCmaxeYO+oIG03DGbLJJKrhXb+7CTkLif0EfZJTIbsNZWa3K Wa7n28xD1oZQ1n9z5dCKDzSMGIpHFhiNd89KcS6KPMNwPE3yYnmHud8BCtXVPq7ZCVrX z8oQ==
X-Gm-Message-State AHPjjUgiJ4sJnA3yzwygbg0UWQKF929LLN0CAekJoorFu+ydUTuSNCd2 FMy/Wm8b0XvR2GtsjpgzLRWGHere
X-Google-SMTP-Source AOwi7QAAroaIRf0PB/a8Ehs26A/W0PjY57e5Xyjaqe8dNe5OMlEfAUHYyVEBPIjWhWoXRYAebmxcUQ==
X-Received by 10.99.114.19 with SMTP id n19mr8821559pgc.174.1506377890661; Mon, 25 Sep 2017 15:18:10 -0700 (PDT)
X-Mailer git-send-email 2.14.1
Sender robomod@news.nic.it
List-ID <linux-kernel.vger.kernel.org>
X-Mailing-List linux-kernel@vger.kernel.org
Approved robomod@news.nic.it
Lines 99
Organization linux.* mail to news gateway
X-Original-Cc Ingo Molnar <mingo@kernel.org>, Peter Zijlstra <peterz@infradead.org>, Gautham R Shenoy <ego@linux.vnet.ibm.com>, Byungchul Park <byungchul.park@lge.com>, Boqun Feng <boqun.feng@gmail.com>
X-Original-Date Tue, 26 Sep 2017 06:18:34 +0800
X-Original-Message-ID <20170925221848.6646-1-boqun.feng@gmail.com>
X-Original-Sender linux-kernel-owner@vger.kernel.org
Xref csiph.com linux.kernel:1739302

Show key headers only | View raw


Hi Ingo and Peter,

This is V3 for recursive read lock support in lockdep.

Changes since V2:

*	Add one revert patch for commit d82fed752942
	("locking/lockdep/selftests: Fix mixed read-write ABBA tests"),
	since we could handle recursive read lock correctly, so we don't
	need to fudge the test anymore.

*	More document and print-message changes for redefining
	LOCK*_STATE*.

*	Rewrite some commit logs to improve the explanation of the idea.

V1: https://marc.info/?l=linux-kernel&m=150393341825453
V2: https://marc.info/?l=linux-kernel&m=150468649417950


As Peter pointed out:

	https://marc.info/?l=linux-kernel&m=150349072023540

The lockdep current has a limit support for recursive read locks, the
deadlock case as follow could not be detected:

	read_lock(A);
				lock(B);
	lock(B);
				write_lock(A);

I got some inspiration from Gautham R Shenoy:

	https://lwn.net/Articles/332801/

, and came up with this series.

The basic idea is:

*	Add recursive read locks into the graph

*	Classify dependencies into --(RR)-->, --(NR)-->, --(RN)-->,
	--(NN)-->, where R stands for recursive read lock, N stands for
	other locks(i.e. non-recursive read locks and write locks).

*	Define strong dependency paths as the paths of dependencies
	don't have two adjacent dependencies as --(*R)--> and --(R*)-->.

*	Extend __bfs() to only traverse on strong dependency paths.

*	If __bfs() finds a strong dependency circle, then a deadlock is
	reported.

The whole series is based on current master branch of tip tree:

	a35205980288 ("Merge branch 'WIP.x86/fpu'")

, and I also put it at:

	git://git.kernel.org/pub/scm/linux/kernel/git/boqun/linux.git arr-rfc-v3

The whole series consists of 14 patches:

1.	Do a clean up on the return value of __bfs() and its friends.

2.	Make __bfs() able to visit every dependency until a match is
	found. The old version of __bfs() could only visit each lock
	class once, and this is insufficient if we are going to add
	recursive read locks into the dependency graph.

3.	Redefine LOCK*_STATE*, now LOCK*_STATE_RR stand for recursive
	read lock only and LOCK*_STATE stand for write lock and
	non-recursive read lock.

4-5	Extend __bfs() to be able to traverse the stong dependency
	patchs after recursive read locks added into the graph.

6-8	Adjust check_redundant(), check_noncircular() and
	check_irq_usage() with recursive read locks into consideration.

9.	Finally add recursive read locks into the dependency graph.

10-11	Adjust lock cache chain key generation with recursive read locks
	into consideration, and provide a test case.

12-13	Add more test cases.

14.	Revert commit d82fed752942 ("locking/lockdep/selftests: Fix
	mixed read-write ABBA tests"),

This series passed all the lockdep selftest cases(including those I
introduce). Will play more other tests, and in the meanwhile hope to
hear your thoughts about this.

Test and comments are welcome!

Regards,
Boqun

Back to linux.kernel | Previous | Next — Next in thread | Find similar | Unroll thread


Thread

[RFC tip/locking/lockdep v3 00/14] lockdep: Support deadlock detection for recursive read locks Boqun Feng <boqun.feng@gmail.com> - 2017-09-26 00:20 +0200
  [RFC tip/locking/lockdep v3 05/14] lockdep: Extend __bfs() to work with multiple kinds of dependencies Boqun Feng <boqun.feng@gmail.com> - 2017-09-26 00:20 +0200
  [RFC tip/locking/lockdep v3 12/14] lockdep/selftest: Unleash irq_read_recursion2 and add more Boqun Feng <boqun.feng@gmail.com> - 2017-09-26 00:20 +0200
  [RFC tip/locking/lockdep v3 02/14] lockdep: Make __bfs() visit every dependency until a match Boqun Feng <boqun.feng@gmail.com> - 2017-09-26 00:20 +0200
  [RFC tip/locking/lockdep v3 01/14] lockdep: Demagic the return value of BFS Boqun Feng <boqun.feng@gmail.com> - 2017-09-26 00:20 +0200
  [RFC tip/locking/lockdep v3 09/14] lockdep: Add recursive read locks into dependency graph Boqun Feng <boqun.feng@gmail.com> - 2017-09-26 00:20 +0200
  [RFC tip/locking/lockdep v3 04/14] lockdep: Introduce lock_list::dep Boqun Feng <boqun.feng@gmail.com> - 2017-09-26 00:20 +0200
  [RFC tip/locking/lockdep v3 06/14] lockdep: Support deadlock detection for recursive read in check_noncircular() Boqun Feng <boqun.feng@gmail.com> - 2017-09-26 00:20 +0200
  [RFC tip/locking/lockdep v3 14/14] Revert "locking/lockdep/selftests: Fix mixed read-write ABBA tests" Boqun Feng <boqun.feng@gmail.com> - 2017-09-26 00:20 +0200
  [RFC tip/locking/lockdep v3 10/14] lockdep/selftest: Add a R-L/L-W test case specific to chain cache behavior Boqun Feng <boqun.feng@gmail.com> - 2017-09-26 00:20 +0200

csiph-web