Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > linux.kernel > #1362167 > unrolled thread

[BUG] packet loss with PROVE_LOCKING, bisected to EDAC fix

Started byChris Bainbridge <chris.bainbridge@gmail.com>
First post2016-03-21 22:50 +0100
Last post2016-03-22 12:20 +0100
Articles 4 — 3 participants

Back to article view | Back to linux.kernel


Contents

  [BUG] packet loss with PROVE_LOCKING, bisected to EDAC fix Chris Bainbridge <chris.bainbridge@gmail.com> - 2016-03-21 22:50 +0100
    Re: [BUG] packet loss with PROVE_LOCKING, bisected to EDAC fix Borislav Petkov <bp@alien8.de> - 2016-03-22 06:40 +0100
      Re: [BUG] packet loss with PROVE_LOCKING, bisected to EDAC fix Peter Zijlstra <peterz@infradead.org> - 2016-03-22 09:20 +0100
      Re: [BUG] packet loss with PROVE_LOCKING, bisected to EDAC fix Borislav Petkov <bp@alien8.de> - 2016-03-22 12:20 +0100

#1362167 — [BUG] packet loss with PROVE_LOCKING, bisected to EDAC fix

FromChris Bainbridge <chris.bainbridge@gmail.com>
Date2016-03-21 22:50 +0100
Subject[BUG] packet loss with PROVE_LOCKING, bisected to EDAC fix
Message-ID<rffS2-34o-1@gated-at.bofh.it>
Hi,

I was testing something on an old server (Dell T105 opteron) and noticed
packet loss after updating the kernel from 3.10 to 4.5. The test was:

On Dell run: iperf -s
On another system: iperf3 -c dell -u -b 20M -l 1k -t 1000

This sends a 20mbit UDP stream to the Dell. It works fine normally (0%
packet loss), but when CONFIG_PROVE_LOCKING is enabled there is high
(35%) packet loss. (DEBUG_LOCKDEP also seems to cause packet loss)

The packet loss bisected back to:

commit 88d84ac97378c2f1d5fec9af1e8b7d9a662d6b00
Author: Borislav Petkov <bp@suse.de>
Date:   Fri Jul 19 12:28:25 2013 +0200

    EDAC: Fix lockdep splat

I have confirmed that the commit preceding this (v3.11-rc1) is fine and
that 88d84a introduced the bug.

[toc] | [next] | [standalone]


#1362333

FromBorislav Petkov <bp@alien8.de>
Date2016-03-22 06:40 +0100
Message-ID<rfncR-8nZ-1@gated-at.bofh.it>
In reply to#1362167
On Mon, Mar 21, 2016 at 09:42:09PM +0000, Chris Bainbridge wrote:
> Hi,
> 
> I was testing something on an old server (Dell T105 opteron) and noticed
> packet loss after updating the kernel from 3.10 to 4.5. The test was:
> 
> On Dell run: iperf -s
> On another system: iperf3 -c dell -u -b 20M -l 1k -t 1000
> 
> This sends a 20mbit UDP stream to the Dell. It works fine normally (0%
> packet loss), but when CONFIG_PROVE_LOCKING is enabled there is high
> (35%) packet loss. (DEBUG_LOCKDEP also seems to cause packet loss)
> 
> The packet loss bisected back to:
> 
> commit 88d84ac97378c2f1d5fec9af1e8b7d9a662d6b00
> Author: Borislav Petkov <bp@suse.de>
> Date:   Fri Jul 19 12:28:25 2013 +0200
> 
>     EDAC: Fix lockdep splat

Hmm, how would that cause a packet loss?!

> I have confirmed that the commit preceding this (v3.11-rc1) is fine and
> that 88d84a introduced the bug.

Did you revert this commit ontop of 4.5 and reproduce again? Do you see
the same packet loss?

What kind of hw is that target system, can you send full dmesg and
.config?

Thanks.

-- 
Regards/Gruss,
    Boris.

ECO tip #101: Trim your mails when you reply.

[toc] | [prev] | [next] | [standalone]


#1362415

FromPeter Zijlstra <peterz@infradead.org>
Date2016-03-22 09:20 +0100
Message-ID<rfpHI-1Fu-15@gated-at.bofh.it>
In reply to#1362333
On Tue, Mar 22, 2016 at 06:31:54AM +0100, Borislav Petkov wrote:
> On Mon, Mar 21, 2016 at 09:42:09PM +0000, Chris Bainbridge wrote:
> > Hi,
> > 
> > I was testing something on an old server (Dell T105 opteron) and noticed
> > packet loss after updating the kernel from 3.10 to 4.5. The test was:
> > 
> > On Dell run: iperf -s
> > On another system: iperf3 -c dell -u -b 20M -l 1k -t 1000
> > 
> > This sends a 20mbit UDP stream to the Dell. It works fine normally (0%
> > packet loss), but when CONFIG_PROVE_LOCKING is enabled there is high
> > (35%) packet loss. (DEBUG_LOCKDEP also seems to cause packet loss)
> > 
> > The packet loss bisected back to:
> > 
> > commit 88d84ac97378c2f1d5fec9af1e8b7d9a662d6b00
> > Author: Borislav Petkov <bp@suse.de>
> > Date:   Fri Jul 19 12:28:25 2013 +0200
> > 
> >     EDAC: Fix lockdep splat
> 
> Hmm, how would that cause a packet loss?!

The previous bug would disable lockdep and thereby avoid much of the
normal overhead associated with lockdep. I suspect the packet loss is a
result of increased overhead.

IOW, everything works as expected.

[toc] | [prev] | [next] | [standalone]


#1362595

FromBorislav Petkov <bp@alien8.de>
Date2016-03-22 12:20 +0100
Message-ID<rfsvU-3zw-27@gated-at.bofh.it>
In reply to#1362333
On Tue, Mar 22, 2016 at 09:16:56AM +0000, Chris Bainbridge wrote:
> Good question. The patch looks pretty innocuous but it is for a lockdep
> issue and the bug only appears when lockdep config options are enabled.
> Could it somehow have broken a lock used to synchronise packet rx?

How? EDAC and net don't have anything in common...

> Reverting over 4.5 does fix the packet loss issue.

Peter makes sense to me. If he's right, if you build a kernel with
CONFIG_EDAC=n and PROVE_LOCKING=y and do your test again, you should
be seeing that packet loss again... because EDAC with the fix won't be
there to disable lockdep.

-- 
Regards/Gruss,
    Boris.

ECO tip #101: Trim your mails when you reply.

[toc] | [prev] | [standalone]


Back to top | Article view | linux.kernel


csiph-web