Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > linux.debian.kernel > #87387

Bug#1104460: [regression 6.1.y] discard/TRIM through RAID10 blocking (was: Re: Bug#1104460: linux-image-6.1.0-34-powerpc64le: Discard broken) with RAID10: BUG: kernel tried to execute user page (0) - exploit attempt?

Path csiph.com!weretis.net!feeder8.news.weretis.net!fu-berlin.de!bofh.it!news.nic.it!robomod
From Antoine Beaupré <anarcat@debian.org>
Newsgroups linux.debian.bugs.dist, linux.debian.kernel
Subject Bug#1104460: [regression 6.1.y] discard/TRIM through RAID10 blocking (was: Re: Bug#1104460: linux-image-6.1.0-34-powerpc64le: Discard broken) with RAID10: BUG: kernel tried to execute user page (0) - exploit attempt?
Date Mon, 05 May 2025 23:10:01 +0200
Message-ID <KJbex-ZHv-9@gated-at.bofh.it> (permalink)
References <KHh4J-hmHh-5@gated-at.bofh.it> <KHi0N-hnio-1@gated-at.bofh.it> <KJ2Eh-U4I-1@gated-at.bofh.it> <KJ6yd-WJ1-3@gated-at.bofh.it> <KHh4J-hmHh-5@gated-at.bofh.it> <KJ6yd-WJ1-1@gated-at.bofh.it> <KHh4J-hmHh-5@gated-at.bofh.it> <KJ9cJ-Yd9-5@gated-at.bofh.it> <KJaLv-Zhc-1@gated-at.bofh.it> <KHh4J-hmHh-5@gated-at.bofh.it> <KJaLv-Zhc-1@gated-at.bofh.it>
X-Original-To Salvatore Bonaccorso <carnil@debian.org>, 1104460@bugs.debian.org
X-Mailbox-Line From debian-bugs-dist-request@lists.debian.org Mon May 5 21:03:15 2025
Old-Return-Path <debbugs@buxtehude.debian.org>
X-Spam-Flag NO
X-Spam-Score -4
Reply-To Antoine Beaupré <anarcat@debian.org>, 1104460@bugs.debian.org
Resent-To debian-bugs-dist@lists.debian.org
Resent-Cc Debian Kernel Team <debian-kernel@lists.debian.org>
X-Debian-Pr-Message followup 1104460
X-Debian-Pr-Package src:linux
X-Debian-Pr-Keywords upstream moreinfo
X-Debian-Pr-Source linux
Dmarc-Filter OpenDMARC Filter v1.4.2 marcos.anarc.at 88A4710E10E
Authentication-Results marcos.anarc.at; dmarc=none (p=none dis=none) header.from=debian.org
Authentication-Results marcos.anarc.at; spf=none smtp.mailfrom=debian.org
Organization Debian
MIME-Version 1.0
Content-Type text/plain; charset=utf-8
Content-Transfer-Encoding quoted-printable
X-Debian-Message from BTS
X-Mailing-List <debian-bugs-dist@lists.debian.org> archive/latest/1903462
List-ID <debian-bugs-dist.lists.debian.org>
List-URL <https://lists.debian.org/debian-bugs-dist/>
Approved robomod@news.nic.it
Lines 83
Sender robomod@news.nic.it
X-Original-Cc Moritz Mühlenhoff <jmm@inutil.org>, Yu Kuai <yukuai3@huawei.com>, Melvin Vermeeren <vermeeren@vermwa.re>, Greg Kroah-Hartman <gregkh@linuxfoundation.org>, Coly Li <colyli@kernel.org>, Sasha Levin <sashal@kernel.org>, stable <stable@vger.kernel.org>, regressions@lists.linux.dev
X-Original-Date Mon, 05 May 2025 16:59:15 -0400
X-Original-Message-ID <87zffqvknw.fsf@angela.anarc.at>
X-Original-References <174602441004.174814.6400502946223473449.reportbug@talos.vermwa.re> <aBJH6Nsh-7Zj55nN@eldamar.lan> <aBilQxLZ4MA4Tg8e@pisco.westfalen.local> <aBjEf5R7X9GaJg2T@eldamar.lan> <174602441004.174814.6400502946223473449.reportbug@talos.vermwa.re> <aBjhHUjtXRotZUVa@eldamar.lan> <174602441004.174814.6400502946223473449.reportbug@talos.vermwa.re> <875xiex56v.fsf@angela.anarc.at> <aBkhNwVVs_KwgQ1a@eldamar.lan> <174602441004.174814.6400502946223473449.reportbug@talos.vermwa.re> <aBkhNwVVs_KwgQ1a@eldamar.lan>
Xref csiph.com linux.debian.bugs.dist:1244893 linux.debian.kernel:87387

Cross-posted to 2 groups.

Show key headers only | View raw


On 2025-05-05 22:36:07, Salvatore Bonaccorso wrote:
> Hi Antoine,
>
> On Mon, May 05, 2025 at 02:50:32PM -0400, Antoine Beaupré wrote:
>> On 2025-05-05 18:02:37, Salvatore Bonaccorso wrote:
>> > On Mon, May 05, 2025 at 04:00:31PM +0200, Salvatore Bonaccorso wrote:
>> >> Hi Moritz,
>> >> 
>> >> On Mon, May 05, 2025 at 01:47:15PM +0200, Moritz Mühlenhoff wrote:
>> >> > Am Wed, Apr 30, 2025 at 05:55:20PM +0200 schrieb Salvatore Bonaccorso:
>> >> > > Hi
>> >> > > 
>> >> > > We got a regression report in Debian after the update from 6.1.133 to
>> >> > > 6.1.135. Melvin is reporting that discard/trimm trhough a RAID10 array
>> >> > > stalls idefintively. The full report is inlined below and originates
>> >> > > from https://bugs.debian.org/1104460 .
>> >> > 
>> >> > JFTR, we ran into the same problem with a few Wikimedia servers running
>> >> > 6.1.135 and RAID 10: The servers started to lock up once fstrim.service
>> >> > got started. Full oops messages are available at
>> >> > https://phabricator.wikimedia.org/P75746
>> >> 
>> >> Thanks for this aditional datapoints. Assuming you wont be able to
>> >> thest the other stable series where the commit d05af90d6218
>> >> ("md/raid10: fix missing discard IO accounting") went in, might you at
>> >> least be able to test the 6.1.y branch with the commit reverted again
>> >> and manually trigger the issue?
>> >> 
>> >> If needed I can provide a test Debian package of 6.1.135 (or 6.1.137)
>> >> with the patch reverted. 
>> >
>> > So one additional data point as several Debian users were reporting
>> > back beeing affected: One user did upgrade to 6.12.25 (where the
>> > commit was backported as well) and is not able to reproduce the issue
>> > there.
>> 
>> That would be me.
>> 
>> I can reproduce the issue as outlined by Moritz above fairly reliably in
>> 6.1.135 (debian package 6.1.0-34-amd64). The reproducer is simple, on a
>> RAID-10 host:
>> 
>>  1. reboot
>>  2. systemctl start fstrim.service
>> 
>> We're tracking the issue internally in:
>> 
>> https://gitlab.torproject.org/tpo/tpa/team/-/issues/42146
>> 
>> I've managed to workaround the issue by upgrading to the Debian package
>> from testing/unstable (6.12.25), as Salvatore indicated above. There,
>> fstrim doesn't cause any crash and completes successfully. In stable, it
>> just hangs there forever. The kernel doesn't completely panic and the
>> machine is otherwise somewhat still functional: my existing SSH
>> connection keeps working, for example, but new ones fail. And an `apt
>> install` of another kernel hangs forever.
>
> So likely at least in 6.1.y there are missing pre-requisites causing
> the behaviour.
>
> If you can test 6.1.135-1 with the commit
> 4a05f7ae33716d996c5ce56478a36a3ede1d76f2 reverted then you can fetch
> built packages at:
>
> https://people.debian.org/~carnil/tmp/linux/1104460/

I can confirm this kernel does not crash when running fstrim.service,
which seems to confirm the bisect.

A.

-- 
Drowning people
Sometimes die
Fighting their rescuers.
                        - Octavia Butler

Back to linux.debian.kernel | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread


Thread

Bug#1104460: [regression 6.1.y] discard/TRIM through RAID10 blocking (was: Re: Bug#1104460: linux-image-6.1.0-34-powerpc64le: Discard broken) with RAID10: BUG: kernel tried to execute user page (0) - exploit attempt? Salvatore Bonaccorso <carnil@debian.org> - 2025-04-30 18:00 +0200
  Bug#1104460: [regression 6.1.y] discard/TRIM through RAID10 blocking (was: Re: Bug#1104460: linux-image-6.1.0-34-powerpc64le: Discard broken) with RAID10: BUG: kernel tried to execute user page (0) - exploit attempt? Moritz Mühlenhoff <jmm@inutil.org> - 2025-05-05 14:00 +0200
    Bug#1104460: [regression 6.1.y] discard/TRIM through RAID10 blocking (was: Re: Bug#1104460: linux-image-6.1.0-34-powerpc64le: Discard broken) with RAID10: BUG: kernel tried to execute user page (0) - exploit attempt? Salvatore Bonaccorso <carnil@debian.org> - 2025-05-05 18:10 +0200
      Bug#1104460: [regression 6.1.y] discard/TRIM through RAID10 blocking (was: Re: Bug#1104460: linux-image-6.1.0-34-powerpc64le: Discard broken) with RAID10: BUG: kernel tried to execute user page (0) - exploit attempt? Antoine Beaupré <anarcat@debian.org> - 2025-05-05 21:00 +0200
        Bug#1104460: [regression 6.1.y] discard/TRIM through RAID10 blocking (was: Re: Bug#1104460: linux-image-6.1.0-34-powerpc64le: Discard broken) with RAID10: BUG: kernel tried to execute user page (0) - exploit attempt? Salvatore Bonaccorso <carnil@debian.org> - 2025-05-05 22:40 +0200
          Bug#1104460: [regression 6.1.y] discard/TRIM through RAID10 blocking (was: Re: Bug#1104460: linux-image-6.1.0-34-powerpc64le: Discard broken) with RAID10: BUG: kernel tried to execute user page (0) - exploit attempt? Antoine Beaupré <anarcat@debian.org> - 2025-05-05 23:10 +0200
            Bug#1104460: [regression 6.1.y] discard/TRIM through RAID10 blocking Yu Kuai <yukuai1@huaweicloud.com> - 2025-05-06 03:40 +0200
              Bug#1104460: [regression 6.1.y] discard/TRIM through RAID10 blocking Salvatore Bonaccorso <carnil@debian.org> - 2025-05-06 08:10 +0200
                Bug#1104460: [regression 6.1.y] discard/TRIM through RAID10 blocking Antoine Beaupré <anarcat@debian.org> - 2025-05-06 15:20 +0200
    Bug#1104460: [regression 6.1.y] discard/TRIM through RAID10 blocking (was: Re: Bug#1104460: linux-image-6.1.0-34-powerpc64le: Discard broken) with RAID10: BUG: kernel tried to execute user page (0) - exploit attempt? Moritz Mühlenhoff <jmm@inutil.org> - 2025-05-05 19:50 +0200
  Bug#1104460: [regression 6.1.y] discard/TRIM through RAID10 blocking Yu Kuai <yukuai1@huaweicloud.com> - 2025-05-06 03:30 +0200
  Bug#1104460: [regression 6.1.y] discard/TRIM through RAID10 blocking Yu Kuai <yukuai1@huaweicloud.com> - 2025-05-06 03:40 +0200
  Bug#1104460: [regression 6.1.y] discard/TRIM through RAID10 blocking (was: Re: Bug#1104460: linux-image-6.1.0-34-powerpc64le: Discard broken) with RAID10: BUG: kernel tried to execute user page (0) - exploit attempt? Melvin Vermeeren <vermeeren@vermwa.re> - 2025-05-06 17:30 +0200

csiph-web