Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > linux.kernel > #1540196 > unrolled thread

Re: 4.8.12, crash in ext4, __d_lookup_rcu

Back to article view | Back to linux.kernel

This discussion starts older than the indexed window; earlier articles aren't shown. The article labeled Started by below is the oldest one visible, not the original post.

Contents

  Re: 4.8.12, crash in ext4, __d_lookup_rcu Olaf Hering <olaf@aepfle.de> - 2016-12-12 10:10 +0100
    Re: 4.8.12, crash in ext4, __d_lookup_rcu Theodore Ts'o <tytso@mit.edu> - 2016-12-12 16:10 +0100
      Re: 4.8.12, crash in ext4, __d_lookup_rcu Olaf Hering <olaf@aepfle.de> - 2016-12-12 16:30 +0100
        Re: 4.8.12, crash in ext4, __d_lookup_rcu Olaf Hering <olaf@aepfle.de> - 2016-12-12 16:30 +0100

#1540196 — Re: 4.8.12, crash in ext4, __d_lookup_rcu

[Multipart message — attachments visible in raw view] — view raw

On Mon, Dec 12, Olaf Hering wrote:

> [197064.401309] RIP: 0010:[<ffffffffbe242ae7>]  [<ffffffffbe242ae7>] __d_lookup_rcu+0x67/0x180

... and umount is not happy after that, which I think is expected:


root@probook:~ # umount -v /BACKUP_OLH_1T ; dmsetup remove luks-feaf408d-3257-4850-b597-bbca1dc651df ; sync ; blockdev --rereadpt /dev/disk/by-id/ata-WDC_WD10EZRX-00D8PB0_WD-WCC4M1CCD07U
Dec 12 09:58:30 probook udisksd[2141]: Cleaning up mount point /BACKUP_OLH_1T (device 254:6 is not mounted)
Dec 12 09:58:33 probook kernel: BUG: Dentry ffffa2c50b703f00{i=295818f,n=cur}  still in use (15) [unmount of ext4 dm-6]
Dec 12 09:58:33 probook kernel: ------------[ cut here ]------------
Dec 12 09:58:33 probook kernel: WARNING: CPU: 2 PID: 24205 at /work/github/olafhering/linux/fs/dcache.c:1436 umount_check+0x72/0x80
Dec 12 09:58:33 probook kernel: Modules linked in: cdc_acm tun fuse ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ip_tables x_tables af_packet bridge stp llc msr nls_utf8 isofs loop dm_crypt algif_skcipher af_alg btrfs zlib_deflate xor raid6_pq uvcvideo videobuf2_vmalloc videobuf2_memops videobuf2_v4l2 videobuf2_core videodev snd_hda_codec_hdmi snd_hda_codec_idt snd_hda_codec_generic snd_hda_intel snd_hda_codec amdkfd amd_iommu_v2 snd_hda_core radeon ttm drm_kms_helper drm snd_hwdep fb_sys_fops sky2 snd_pcm syscopyarea tpm_infineon snd_timer sysfillrect sysimgblt i2c_algo_bit snd sp5100_tco i2c_piix4 acpi_cpufreq kvm_amd tpm_tis tpm_tis_core k10temp shpchp soundcore kvm hp_accel lis3lv02d sparse_keymap rfkill fjes tpm video joydev input_polldev irqbypass pcspkr thermal ac battery button wmi fan hid_generic
Dec 12 09:58:33 probook kernel:  usbhid ohci_pci serio_raw ehci_pci ohci_hcd ehci_hcd usbcore usb_common sdhci_pci sdhci mmc_core sg dm_multipath dm_mod scsi_dh_alua
Dec 12 09:58:33 probook kernel: CPU: 2 PID: 24205 Comm: umount Tainted: G      D         4.8.12-probook #15
Dec 12 09:58:33 probook kernel: Hardware name: Hewlett-Packard HP ProBook 6555b/1455, BIOS 68DTM Ver. F.21 06/14/2012
Dec 12 09:58:33 probook kernel:  0000000000000000 ffffa2c6f8663cf8 ffffffffbe3c0530 0000000000000000
Dec 12 09:58:33 probook kernel:  0000000000000000 ffffa2c6f8663d38 ffffffffbe08326b 0000059cf8663d10
Dec 12 09:58:33 probook kernel:  ffffa2c50b6eb8e0 ffffa2c50b703f00 ffffa2c50b703f58 ffffa2c50b6eb8e0
Dec 12 09:58:33 probook kernel: Call Trace:
Dec 12 09:58:33 probook kernel:  [<ffffffffbe3c0530>] dump_stack+0x63/0x83
Dec 12 09:58:33 probook kernel:  [<ffffffffbe08326b>] __warn+0xcb/0xf0
Dec 12 09:58:33 probook kernel:  [<ffffffffbe08335d>] warn_slowpath_null+0x1d/0x20
Dec 12 09:58:33 probook kernel:  [<ffffffffbe23fe72>] umount_check+0x72/0x80
Dec 12 09:58:33 probook kernel:  [<ffffffffbe23f990>] d_walk+0xd0/0x300
Dec 12 09:58:33 probook kernel:  [<ffffffffbe23fe00>] ? dentry_free+0x80/0x80
Dec 12 09:58:33 probook kernel:  [<ffffffffbe241636>] do_one_tree+0x26/0x40
Dec 12 09:58:33 probook kernel:  [<ffffffffbe24249d>] shrink_dcache_for_umount+0x2d/0x90
Dec 12 09:58:33 probook kernel:  [<ffffffffbe22ad4f>] generic_shutdown_super+0x1f/0x100
Dec 12 09:58:33 probook kernel:  [<ffffffffbe22b127>] kill_block_super+0x27/0x70
Dec 12 09:58:33 probook kernel:  [<ffffffffbe22b253>] deactivate_locked_super+0x43/0x70
Dec 12 09:58:33 probook kernel:  [<ffffffffbe22b72a>] deactivate_super+0x5a/0x60
Dec 12 09:58:33 probook kernel:  [<ffffffffbe249cef>] cleanup_mnt+0x3f/0x90
Dec 12 09:58:33 probook kernel:  [<ffffffffbe249d82>] __cleanup_mnt+0x12/0x20
Dec 12 09:58:33 probook kernel:  [<ffffffffbe0a0fe0>] task_work_run+0x80/0xa0
Dec 12 09:58:33 probook kernel:  [<ffffffffbe0032e2>] exit_to_usermode_loop+0xc2/0xd0
Dec 12 09:58:33 probook kernel:  [<ffffffffbe003abe>] syscall_return_slowpath+0x4e/0x60
Dec 12 09:58:33 probook kernel:  [<ffffffffbe70b9fe>] entry_SYSCALL_64_fastpath+0xa6/0xa8
Dec 12 09:58:33 probook kernel: ---[ end trace c55214155fae1a63 ]---
Segmentation fault
Dec 12 09:58:35 probook kernel: EXT4-fs (dm-6): sb orphan head is 25657346
Dec 12 09:58:35 probook kernel: sb_info orphan list:
Dec 12 09:58:35 probook kernel:   inode dm-6:25657346 at ffffa2c64f4b0a48: mode 40755, nlink 0, next 25657347
Dec 12 09:58:35 probook kernel:   inode dm-6:25657347 at ffffa2c655bac2a8: mode 40755, nlink 0, next 25657348
Dec 12 09:58:35 probook kernel:   inode dm-6:25657348 at ffffa2c63f5d7598: mode 40755, nlink 0, next 25658000
Dec 12 09:58:35 probook kernel:   inode dm-6:25658000 at ffffa2c6d1341368: mode 40755, nlink 0, next 25658006
Command failed
Dec 12 09:58:35 probook kernel:   inode dm-6:25658006 at ffffa2c6d13630e8: mode 40755, nlink 0, next 25658115
Dec 12 09:58:35 probook kernel:   inode dm-6:25658115 at ffffa2c552321718: mode 40755, nlink 0, next 43286668
Dec 12 09:58:35 probook kernel:   inode dm-6:43286668 at ffffa2c6d13d19c8: mode 40755, nlink 0, next 43319488
Dec 12 09:58:35 probook kernel:   inode dm-6:43319488 at ffffa2c60dd506d8: mode 40700, nlink 0, next 43352067
Dec 12 09:58:35 probook kernel:   inode dm-6:43352067 at ffffa2c608808a48: mode 40700, nlink 0, next 43352114
Dec 12 09:58:35 probook kernel:   inode dm-6:43352114 at ffffa2c608def6d8: mode 40755, nlink 0, next 43352455
Dec 12 09:58:35 probook kernel:   inode dm-6:43352455 at ffffa2c50b6ea5d8: mode 40755, nlink 0, next 43352463
Dec 12 09:58:35 probook kernel:   inode dm-6:43352463 at ffffa2c50b6c0698: mode 40755, nlink 0, next 0
Dec 12 09:58:35 probook kernel: ------------[ cut here ]------------
Dec 12 09:58:35 probook kernel: kernel BUG at /work/github/olafhering/linux/fs/ext4/super.c:875!
Dec 12 09:58:39 probook kernel: invalid opcode: 0000 [#2] PREEMPT SMP
Dec 12 09:58:39 probook kernel: Modules linked in: cdc_acm tun fuse ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ip_tables x_tables af_packet bridge stp llc msr nls_utf8 isofs loop dm_crypt algif_skcipher af_alg btrfs zlib_deflate xor raid6_pq uvcvideo videobuf2_vmalloc videobuf2_memops videobuf2_v4l2 videobuf2_core videodev snd_hda_codec_hdmi snd_hda_codec_idt snd_hda_codec_generic snd_hda_intel snd_hda_codec amdkfd amd_iommu_v2 snd_hda_core radeon ttm drm_kms_helper drm snd_hwdep fb_sys_fops sky2 snd_pcm syscopyarea tpm_infineon snd_timer sysfillrect sysimgblt i2c_algo_bit snd sp5100_tco i2c_piix4 acpi_cpufreq kvm_amd tpm_tis tpm_tis_core k10temp shpchp soundcore kvm hp_accel lis3lv02d sparse_keymap rfkill fjes tpm video joydev input_polldev irqbypass pcspkr thermal ac battery button wmi fan hid_generic
Dec 12 09:58:39 probook kernel:  usbhid ohci_pci serio_raw ehci_pci ohci_hcd ehci_hcd usbcore usb_common sdhci_pci sdhci mmc_core sg dm_multipath dm_mod scsi_dh_alua
Dec 12 09:58:39 probook kernel: CPU: 2 PID: 24205 Comm: umount Tainted: G      D W       4.8.12-probook #15
Dec 12 09:58:39 probook kernel: Hardware name: Hewlett-Packard HP ProBook 6555b/1455, BIOS 68DTM Ver. F.21 06/14/2012
Dec 12 09:58:39 probook kernel: task: ffffa2c70dac6300 task.stack: ffffa2c6f8660000
Dec 12 09:58:39 probook kernel: RIP: 0010:[<ffffffffbe2d8409>]  [<ffffffffbe2d8409>] ext4_put_super+0x2d9/0x350
Dec 12 09:58:40 probook kernel: RSP: 0018:ffffa2c6f8663de0  EFLAGS: 00010202
Dec 12 09:58:40 probook kernel: RAX: ffffa2c64f4b09e0 RBX: ffffa2c69db6c000 RCX: 0000000000000006
Dec 12 09:58:40 probook kernel: RDX: 0000000000000007 RSI: 0000000000000246 RDI: ffffa2c73fd0e180
Dec 12 09:58:40 probook kernel: RBP: ffffa2c6f8663e10 R08: 000000000000e82f R09: 0000000000000004
Dec 12 09:58:40 probook kernel: R10: 000800010001cf00 R11: 00000000000006f6 R12: ffffa2c69db6c200
Dec 12 09:58:40 probook kernel: R13: ffffa2c720e3a000 R14: ffffa2c69db6c200 R15: ffffffffbea492e0
Dec 12 09:58:40 probook kernel: FS:  00007f90a804c2c0(0000) GS:ffffa2c73fd00000(0000) knlGS:0000000000000000
Dec 12 09:58:40 probook kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Dec 12 09:58:40 probook kernel: CR2: 00007fa9884cc008 CR3: 0000000161f39000 CR4: 00000000000006e0
Dec 12 09:58:40 probook kernel: Stack:
Dec 12 09:58:40 probook kernel:  ffffa2c600000000 ffffa2c720e3a000 ffffffffbe840c40 ffffa2c70fadf038
Dec 12 09:58:40 probook kernel:  0000000000000000 ffffa2c70dac6a40 ffffa2c6f8663e30 ffffffffbe22ad9f
Dec 12 09:58:40 probook kernel:  0000000000000083 ffffa2c7242e20c0 ffffa2c6f8663e50 ffffffffbe22b127
Dec 12 09:58:40 probook kernel: Call Trace:
Dec 12 09:58:40 probook kernel:  [<ffffffffbe22ad9f>] generic_shutdown_super+0x6f/0x100
Dec 12 09:58:40 probook kernel:  [<ffffffffbe22b127>] kill_block_super+0x27/0x70
Dec 12 09:58:40 probook kernel:  [<ffffffffbe22b253>] deactivate_locked_super+0x43/0x70
Dec 12 09:58:40 probook kernel:  [<ffffffffbe22b72a>] deactivate_super+0x5a/0x60
Dec 12 09:58:40 probook kernel:  [<ffffffffbe249cef>] cleanup_mnt+0x3f/0x90
Dec 12 09:58:40 probook kernel:  [<ffffffffbe249d82>] __cleanup_mnt+0x12/0x20
Dec 12 09:58:40 probook kernel:  [<ffffffffbe0a0fe0>] task_work_run+0x80/0xa0
Dec 12 09:58:40 probook kernel:  [<ffffffffbe0032e2>] exit_to_usermode_loop+0xc2/0xd0
Dec 12 09:58:40 probook kernel:  [<ffffffffbe003abe>] syscall_return_slowpath+0x4e/0x60
Dec 12 09:58:40 probook kernel:  [<ffffffffbe70b9fe>] entry_SYSCALL_64_fastpath+0xa6/0xa8
Dec 12 09:58:40 probook kernel: Code: 8d 77 08 e8 fa 7b 09 00 48 8b bb 80 01 00 00 e8 fe c4 f2 ff 48 89 df e8 f6 c4 f2 ff 48 83 c4 08 5b 41 5c 41 5d 41 5e 41 5f 5d c3 <0f> 0b 48 c7 c1 a7 28 a5 be ba 45 03 00 00 48 c7 c6 78 fa 83 be
Dec 12 09:58:40 probook kernel: RIP  [<ffffffffbe2d8409>] ext4_put_super+0x2d9/0x350
Dec 12 09:58:40 probook kernel:  RSP <ffffa2c6f8663de0>
Dec 12 09:58:40 probook kernel: ---[ end trace c55214155fae1a64 ]---

[toc] | [next] | [standalone]

#1540367

What was going on at the time of the crash, and can you reproduce this?

There was a huge number of messages about ISO 9660 and accesses beyond
the end of the loop device, and I wonder if any of this might have
been connected to the crash.

				- Ted

[toc] | [prev] | [next] | [standalone]

#1540381

[Multipart message — attachments visible in raw view] — view raw

On Mon, Dec 12, Theodore Ts'o wrote:

> What was going on at the time of the crash, and can you reproduce this?

Its the 'rm -rf $dir/$oldbackup.N' at the end of each rsnapshot run.
I will try to reproduce it, see if it happens again during the hourly
rsnapshot runs. So far I have not seen it with 4.8.x, cant remember if
it already happend with earlier kernels.

> There was a huge number of messages about ISO 9660 and accesses beyond
> the end of the loop device, and I wonder if any of this might have
> been connected to the crash.

This was an ISO image with download in progress. Since the download was
slow I mounted what was already available, which was enough to make the
installer happy. But a few files are located at the end of the image,
and the loopN block device does not autogrow as more data became
available. The ISOs are on another drive than the backup disk. Not sure
if such an incomplete iso9660 filesystem can confuse the vfs layer?

Olaf

[toc] | [prev] | [next] | [standalone]

#1540386

[Multipart message — attachments visible in raw view] — view raw

On Mon, Dec 12, Olaf Hering wrote:

> On Mon, Dec 12, Theodore Ts'o wrote:
> 
> > What was going on at the time of the crash, and can you reproduce this?
> 
> Its the 'rm -rf $dir/$oldbackup.N' at the end of each rsnapshot run.

Also, the system was otherwise idle during the whole day.

Olaf

[toc] | [prev] | [standalone]

Back to top | Article view | linux.kernel

csiph-web