Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > linux.debian.user > #208628 > unrolled thread

virtual device both is and isn't a valid file system

Started byRoss Boylan <rossboylan@stanfordalumni.org>
First post2019-05-14 09:20 +0200
Last post2019-05-14 19:40 +0200
Articles 10 — 3 participants

Back to article view | Back to linux.debian.user

Contents

  virtual device both is and isn't a valid file system Ross Boylan <rossboylan@stanfordalumni.org> - 2019-05-14 09:20 +0200
    virtual device both is and isn't a valid file system [complete] Ross Boylan <rossboylan@stanfordalumni.org> - 2019-05-14 10:20 +0200
      Re: virtual device both is and isn't a valid file system [complete] Reco <recoverym4n@enotuniq.net> - 2019-05-14 10:30 +0200
        Re: virtual device both is and isn't a valid file system [complete] Curt <curty@free.fr> - 2019-05-14 15:30 +0200
          Re: virtual device both is and isn't a valid file system [complete] Reco <recoverym4n@enotuniq.net> - 2019-05-14 15:40 +0200
        Re: virtual device both is and isn't a valid file system [complete] Ross Boylan <rossboylan@stanfordalumni.org> - 2019-05-14 19:00 +0200
          Re: virtual device both is and isn't a valid file system [complete] Reco <recoverym4n@enotuniq.net> - 2019-05-14 19:20 +0200
          Re: virtual device both is and isn't a valid file system [complete] Ross Boylan <rossboylan@stanfordalumni.org> - 2019-05-14 19:30 +0200
            Re: virtual device both is and isn't a valid file system [complete] Reco <recoverym4n@enotuniq.net> - 2019-05-14 19:40 +0200
            Re: virtual device both is and isn't a valid file system [solved] Ross Boylan <rossboylan@stanfordalumni.org> - 2019-05-14 19:40 +0200

#208628 — virtual device both is and isn't a valid file system

FromRoss Boylan <rossboylan@stanfordalumni.org>
Date2019-05-14 09:20 +0200
Subjectvirtual device both is and isn't a valid file system
Message-ID<xXzTb-5xC-1@gated-at.bofh.it>
When I attempt to mount a block device, I get the error:
---------------------------------
root@barley:~/tempserver-check# date; mount /dev/stretch-vg/boot stretch_boot
Mon 13 May 2019 11:42:15 PM PDT
mount: /root/tempserver-check/stretch_boot: can't read superblock on
/dev/mapper/stretch--vg-boot.
---------------------------------------------
Same error if I add -t ext2, 3, or 4.

But when I check the block device, there don't seem to be any complaints:
================================
root@barley:~/tempserver-check# date; e2fsck -n /dev/stretch-vg/boot
Mon 13 May 2019 11:45:49 PM PDT
e2fsck 1.44.5 (15-Dec-2018)
/dev/stretch-vg/boot: clean, 345/97536 files, 116077/389120 blocks
==============================
See below for more info from dumpe2fs.  I suspect this is some problem
with my use of qemu-nbd.

The stack is pretty complex:
/dev/stretch-vg/boot is a logical volume
based on a "physical volume"
which is a partition of a virtual disk served up by qemu-nbd
which is based on a virtual disk file, stretch vdi
on a trivial RAID array (RAID1 with only one member)
whose only element is a partition
That partition was created by ddrescue from a disk that was failing;
all but one 4k sector were recovered.
FWIW this particular virtual machine seemed to be operating OK even
after the disk error.

File systems and devices were opened read only where possible.
My real target is some logical volumes that were encrypted, and so one
more layer.  But I figure if I can't handle an unencrypted partition
my chances of reading an encrypted one are slim.

Key commands, working from the bottom up:
mdadm -v --assemble --readonly /dev/md/media5 /dev/sdf2
Mon 13 May 2019 08:12:09 PM PDT
mdadm: looking for devices for /dev/md/media5
mdadm: /dev/sdf2 is identified as a member of /dev/md/media5, slot 0.
mdadm: added /dev/sdf2 to /dev/md/media5 as 0
mdadm: /dev/md/media5 has been started with 1 drive.

[toc] | [next] | [standalone]

#208630 — virtual device both is and isn't a valid file system [complete]

FromRoss Boylan <rossboylan@stanfordalumni.org>
Date2019-05-14 10:20 +0200
Subjectvirtual device both is and isn't a valid file system [complete]
Message-ID<xXAPf-65U-3@gated-at.bofh.it>
In reply to#208628
[Sorry: original sent before complete; ignore earlier message]

I am trying to read some files off of a virtual disk without running
the entire virtual machine.
(Running a VM would involve at least using a later version of the
VirtualBox, or a switch to KVM,
and I already have enough complexity).

When I attempt to mount a logical volume from that virtual disk, I get
the error:
---------------------------------
root@barley:~/tempserver-check# date; mount /dev/stretch-vg/boot stretch_boot
Mon 13 May 2019 11:42:15 PM PDT
mount: /root/tempserver-check/stretch_boot: can't read superblock on
/dev/mapper/stretch--vg-boot.
---------------------------------------------
Same error if I add -t ext2, 3, or 4.  The /dev/mapper entry is present.

But when I check the block device, there don't seem to be any complaints:
================================
root@barley:~/tempserver-check# date; e2fsck -n /dev/stretch-vg/boot
Mon 13 May 2019 11:45:49 PM PDT
e2fsck 1.44.5 (15-Dec-2018)
/dev/stretch-vg/boot: clean, 345/97536 files, 116077/389120 blocks
==============================
I also tried e2fsck using the /dev/mapper/... path. It was happy with that too.
See below for more info from dumpe2fs.  The only thing that struck me as odd
was the mount count of -1,  but I'm no extN expert.

I suspect this is some problem with my use of qemu-nbd.

Running on buster.  The virtual disks I'm trying to
read were created under wheezy with VBox 4.3.

Any ideas?

The stack is pretty complex:
/dev/stretch-vg/boot is an LVM logical volume
from a volume group (stretch-vg) based on an LVM "physical volume"
which is a partition (3) of a virtual disk served up by qemu-nbd
which is based on a virtual disk file, stretch vdi
which sits on a trivial RAID array (RAID1 with only one member) md/media5
whose only member is a partition sdf2
That partition was created by ddrescue from a disk that was failing;
all but one 4k sector were recovered.  The start and end sectors on
the new disk are the same
as the start and end sectors on the old one.

FWIW this particular virtual machine seemed to be operating OK even
after the disk error.

File systems and devices were opened read only where possible.
My real target is some logical volumes that are encrypted, and so involves one
more layer.  But I figure if I can't handle an unencrypted partition
my chances of reading an encrypted one are slim.

Thanks.
Ross Boylan

EVEN MORE DETAILED DETAILS
Key commands and results, working from the bottom of the previous
stack up.  dumpe2fs just before the last command:
mdadm -v --assemble --readonly /dev/md/media5 /dev/sdf2
Mon 13 May 2019 08:12:09 PM PDT
mdadm: looking for devices for /dev/md/media5
mdadm: /dev/sdf2 is identified as a member of /dev/md/media5, slot 0.
mdadm: added /dev/sdf2 to /dev/md/media5 as 0
mdadm: /dev/md/media5 has been started with 1 drive.
root@barley:~/tempserver-check# mount -r -t ext4 /dev/md/media5 spare
root@barley:~/tempserver-check# df spare
Filesystem      1K-blocks       Used Available Use% Mounted on
/dev/md127     3905540432 3781174980  46211380  99% /root/tempserver-check/spare
# hmm I don't think the original was that full.
# failed initial attempt to use qemu-nbd omitted.  I closed all
devices and unloaded the nbd module
#
root@barley:~/tempserver-check# date; modprobe -v nbd
Mon 13 May 2019 11:33:07 PM PDT
insmod /lib/modules/4.19.0-4-amd64/kernel/drivers/block/nbd.ko
root@barley:~/tempserver-check# date; qemu-nbd -v -r --fork -c
/dev/nbd3 spare/stretch/stretch.vdi
Mon 13 May 2019 11:36:36 PM PDT
root@barley:~/tempserver-check# parted /dev/nbd3 p
Model: Unknown (unknown)
Disk /dev/nbd3: 21.5GB
Sector size (logical/physical): 512B/512B
Partition Table: gpt
Disk Flags:

Number  Start   End     Size    File system  Name   Flags
 1      1049kB  200MB   199MB                       bios_grub
 2      200MB   1201MB  1000MB               spare
 3      1201MB  21.5GB  20.3GB               big    lvm
# pvdisplay of /dev/ndb3p3 looks good, as do other lvm indicators
# next command was probably unnecessary
root@barley:~/tempserver-check# lvchange -ay stretch-vg/boot
root@barley:~/tempserver-check# date; mount /dev/stretch-vg/boot stretch_boot
Mon 13 May 2019 11:42:15 PM PDT
mount: /root/tempserver-check/stretch_boot: can't read superblock on
/dev/mapper/stretch--vg-boot.
root@barley:~/tempserver-check# date; mount -t ext2
/dev/stretch-vg/boot stretch_boot
Mon 13 May 2019 11:42:36 PM PDT
mount: /root/tempserver-check/stretch_boot: wrong fs type, bad option,
bad superblock on /dev/mapper/stretch--vg-boot, missing codepage or
helper program, or other error.
root@barley:~/tempserver-check# date; mount -t ext3
/dev/stretch-vg/boot stretch_boot
Mon 13 May 2019 11:42:45 PM PDT
mount: /root/tempserver-check/stretch_boot: wrong fs type, bad option,
bad superblock on /dev/mapper/stretch--vg-boot, missing codepage or
helper program, or other error.
root@barley:~/tempserver-check# date; mount -t ext4
/dev/stretch-vg/boot stretch_boot
Mon 13 May 2019 11:42:51 PM PDT
mount: /root/tempserver-check/stretch_boot: can't read superblock on
/dev/mapper/stretch--vg-boot.
root@barley:~/tempserver-check# dumpe2fs -h /dev/stretch-vg/boot
dumpe2fs 1.44.5 (15-Dec-2018)
Filesystem volume name:   <none>
Last mounted on:          /boot
Filesystem UUID:          e288f277-27a6-4500-9631-e17c3b661c68
Filesystem magic number:  0xEF53
Filesystem revision #:    1 (dynamic)
Filesystem features:      has_journal ext_attr resize_inode dir_index
filetype extent 64bit flex_bg sparse_super large_file huge_file
dir_nlink extra_isize metadata_csum
Filesystem flags:         signed_directory_hash
Default mount options:    user_xattr acl
Filesystem state:         clean
Errors behavior:          Continue
Filesystem OS type:       Linux
Inode count:              97536
Block count:              389120
Reserved block count:     19456
Free blocks:              273043
Free inodes:              97191
First block:              1
Block size:               1024
Fragment size:            1024
Group descriptor size:    64
Reserved GDT blocks:      256
Blocks per group:         8192
Fragments per group:      8192
Inodes per group:         2032
Inode blocks per group:   254
Flex block group size:    16
Filesystem created:       Tue May  8 12:50:24 2018
Last mount time:          Tue May  7 08:42:06 2019
Last write time:          Wed May  8 02:32:53 2019
Mount count:              17
Maximum mount count:      -1
Last checked:             Thu Feb 21 07:09:31 2019
Check interval:           0 (<none>)
Lifetime writes:          802 MB
Reserved blocks uid:      0 (user root)
Reserved blocks gid:      0 (group root)
First inode:              11
Inode size:              128
Journal inode:            8
Default directory hash:   half_md4
Directory Hash Seed:      84ad0f32-1fe8-4b7a-8d1a-353028e247fa
Journal backup:           inode blocks
Checksum type:            crc32c
Checksum:                 0xd26b1d66
Journal features:         journal_64bit journal_checksum_v3
Journal size:             8M
Journal length:           8192
Journal sequence:         0x00000347
Journal start:            0
Journal checksum type:    crc32c
Journal checksum:         0xe13c80a9

root@barley:~/tempserver-check# date; e2fsck -n /dev/stretch-vg/boot
Mon 13 May 2019 11:45:49 PM PDT
e2fsck 1.44.5 (15-Dec-2018)
/dev/stretch-vg/boot: clean, 345/97536 files, 116077/389120 blocks

[toc] | [prev] | [next] | [standalone]

#208631 — Re: virtual device both is and isn't a valid file system [complete]

FromReco <recoverym4n@enotuniq.net>
Date2019-05-14 10:30 +0200
SubjectRe: virtual device both is and isn't a valid file system [complete]
Message-ID<xXAYV-695-5@gated-at.bofh.it>
In reply to#208630
	Hi.

> I am trying to read some files off of a virtual disk without running
> the entire virtual machine.

Can you post the output of (in that order):

strace -f mount /dev/stretch-vg/boot stretch_boot
dmesg | trail
e2fsck -fn /dev/stretch-vg/boot

Reco

[toc] | [prev] | [next] | [standalone]

#208637 — Re: virtual device both is and isn't a valid file system [complete]

FromCurt <curty@free.fr>
Date2019-05-14 15:30 +0200
SubjectRe: virtual device both is and isn't a valid file system [complete]
Message-ID<xXFFf-Dv-1@gated-at.bofh.it>
In reply to#208631
On 2019-05-14, Reco <recoverym4n@enotuniq.net> wrote:
> 	Hi.
>
>> I am trying to read some files off of a virtual disk without running
>> the entire virtual machine.
>
> Can you post the output of (in that order):
>
> strace -f mount /dev/stretch-vg/boot stretch_boot
> dmesg | trail

I looked for trail (it's not in my path!), but I guess you mean 'tail'.

> e2fsck -fn /dev/stretch-vg/boot
>
> Reco
>
>


-- 
“When he was dry, he believed it was alcohol he needed, but when he had a few
drinks in him, he knew it was something else, possibly a woman; and when he had
it all — cash, booze, and a wife — he couldn’t be distracted from the great
emptiness that was always falling through him and never hit the ground.” – Denis Johnson

[toc] | [prev] | [next] | [standalone]

#208638 — Re: virtual device both is and isn't a valid file system [complete]

FromReco <recoverym4n@enotuniq.net>
Date2019-05-14 15:40 +0200
SubjectRe: virtual device both is and isn't a valid file system [complete]
Message-ID<xXFOV-GD-3@gated-at.bofh.it>
In reply to#208637
	Hi.

On Tue, May 14, 2019 at 01:28:47PM -0000, Curt wrote:
> On 2019-05-14, Reco <recoverym4n@enotuniq.net> wrote:
> > 	Hi.
> >
> >> I am trying to read some files off of a virtual disk without running
> >> the entire virtual machine.
> >
> > Can you post the output of (in that order):
> >
> > strace -f mount /dev/stretch-vg/boot stretch_boot
> > dmesg | trail
> 
> I looked for trail (it's not in my path!), but I guess you mean 'tail'.

I did. Thanks for the correction.

Reco

[toc] | [prev] | [next] | [standalone]

#208645 — Re: virtual device both is and isn't a valid file system [complete]

FromRoss Boylan <rossboylan@stanfordalumni.org>
Date2019-05-14 19:00 +0200
SubjectRe: virtual device both is and isn't a valid file system [complete]
Message-ID<xXIWt-2t9-5@gated-at.bofh.it>
In reply to#208631
Here's the info:
root@barley:~/tempserver-check# date; strace -f mount
/dev/stretch-vg/boot stretch_boot
Tue 14 May 2019 09:33:01 AM PDT
execve("/usr/bin/mount", ["mount", "/dev/stretch-vg/boot",
"stretch_boot"], 0x7ffed2c87238 /* 26 vars */) = 0
brk(NULL)                               = 0x5575487e5000
access("/etc/ld.so.preload", R_OK)      = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, "/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=169946, ...}) = 0
mmap(NULL, 169946, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f058bb52000
close(3)                                = 0
openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libmount.so.1", O_RDONLY|O_CLOEXEC) = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\340\332\0\0\0\0\0\0"...,
832) = 832
fstat(3, {st_mode=S_IFREG|0644, st_size=383456, ...}) = 0
mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1,
0) = 0x7f058bb50000
mmap(NULL, 386344, PROT_READ, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f058baf1000
mprotect(0x7f058bafd000, 323584, PROT_NONE) = 0
mmap(0x7f058bafd000, 245760, PROT_READ|PROT_EXEC,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0xc000) = 0x7f058bafd000
mmap(0x7f058bb39000, 73728, PROT_READ,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x48000) = 0x7f058bb39000
mmap(0x7f058bb4c000, 16384, PROT_READ|PROT_WRITE,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x5a000) = 0x7f058bb4c000
close(3)                                = 0
openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libselinux.so.1",
O_RDONLY|O_CLOEXEC) = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0@k\0\0\0\0\0\0"...,
832) = 832
fstat(3, {st_mode=S_IFREG|0644, st_size=155296, ...}) = 0
mmap(NULL, 2259632, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3,
0) = 0x7f058b8c9000
mprotect(0x7f058b8ee000, 2093056, PROT_NONE) = 0
mmap(0x7f058baed000, 8192, PROT_READ|PROT_WRITE,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x24000) = 0x7f058baed000
mmap(0x7f058baef000, 6832, PROT_READ|PROT_WRITE,
MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f058baef000
close(3)                                = 0
openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libc.so.6", O_RDONLY|O_CLOEXEC) = 3
read(3, "\177ELF\2\1\1\3\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\260A\2\0\0\0\0\0"...,
832) = 832
fstat(3, {st_mode=S_IFREG|0755, st_size=1824496, ...}) = 0
mmap(NULL, 1837056, PROT_READ, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f058b708000
mprotect(0x7f058b72a000, 1658880, PROT_NONE) = 0
mmap(0x7f058b72a000, 1343488, PROT_READ|PROT_EXEC,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x22000) = 0x7f058b72a000
mmap(0x7f058b872000, 311296, PROT_READ,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x16a000) = 0x7f058b872000
mmap(0x7f058b8bf000, 24576, PROT_READ|PROT_WRITE,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1b6000) = 0x7f058b8bf000
mmap(0x7f058b8c5000, 14336, PROT_READ|PROT_WRITE,
MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f058b8c5000
close(3)                                = 0
openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libblkid.so.1", O_RDONLY|O_CLOEXEC) = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0P\257\0\0\0\0\0\0"...,
832) = 832
fstat(3, {st_mode=S_IFREG|0644, st_size=343008, ...}) = 0
mmap(NULL, 345896, PROT_READ, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f058b6b3000
mprotect(0x7f058b6bd000, 282624, PROT_NONE) = 0
mmap(0x7f058b6bd000, 212992, PROT_READ|PROT_EXEC,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0xa000) = 0x7f058b6bd000
mmap(0x7f058b6f1000, 65536, PROT_READ,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x3e000) = 0x7f058b6f1000
mmap(0x7f058b702000, 24576, PROT_READ|PROT_WRITE,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x4e000) = 0x7f058b702000
close(3)                                = 0
openat(AT_FDCWD, "/lib/x86_64-linux-gnu/librt.so.1", O_RDONLY|O_CLOEXEC) = 3
read(3, "\177ELF\2\1\1\3\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\260#\0\0\0\0\0\0"...,
832) = 832
fstat(3, {st_mode=S_IFREG|0644, st_size=35808, ...}) = 0
mmap(NULL, 39904, PROT_READ, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f058b6a9000
mmap(0x7f058b6ab000, 16384, PROT_READ|PROT_EXEC,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x7f058b6ab000
mmap(0x7f058b6af000, 8192, PROT_READ,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x6000) = 0x7f058b6af000
mmap(0x7f058b6b1000, 8192, PROT_READ|PROT_WRITE,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x7000) = 0x7f058b6b1000
close(3)                                = 0
openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libpcre.so.3", O_RDONLY|O_CLOEXEC) = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\340!\0\0\0\0\0\0"...,
832) = 832
fstat(3, {st_mode=S_IFREG|0644, st_size=468944, ...}) = 0
mmap(NULL, 471304, PROT_READ, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f058b635000
mmap(0x7f058b637000, 335872, PROT_READ|PROT_EXEC,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x7f058b637000
mmap(0x7f058b689000, 122880, PROT_READ,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x54000) = 0x7f058b689000
mmap(0x7f058b6a7000, 8192, PROT_READ|PROT_WRITE,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x71000) = 0x7f058b6a7000
close(3)                                = 0
openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libdl.so.2", O_RDONLY|O_CLOEXEC) = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0000\21\0\0\0\0\0\0"...,
832) = 832
fstat(3, {st_mode=S_IFREG|0644, st_size=14592, ...}) = 0
mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1,
0) = 0x7f058b633000
mmap(NULL, 16656, PROT_READ, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f058b62e000
mmap(0x7f058b62f000, 4096, PROT_READ|PROT_EXEC,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1000) = 0x7f058b62f000
mmap(0x7f058b630000, 4096, PROT_READ,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x7f058b630000
mmap(0x7f058b631000, 8192, PROT_READ|PROT_WRITE,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x7f058b631000
close(3)                                = 0
openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libuuid.so.1", O_RDONLY|O_CLOEXEC) = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0
#\0\0\0\0\0\0"..., 832) = 832
fstat(3, {st_mode=S_IFREG|0644, st_size=30776, ...}) = 0
mmap(NULL, 32792, PROT_READ, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f058b625000
mmap(0x7f058b627000, 16384, PROT_READ|PROT_EXEC,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x7f058b627000
mmap(0x7f058b62b000, 4096, PROT_READ,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x6000) = 0x7f058b62b000
mmap(0x7f058b62c000, 8192, PROT_READ|PROT_WRITE,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x6000) = 0x7f058b62c000
close(3)                                = 0
openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libpthread.so.0",
O_RDONLY|O_CLOEXEC) = 3
read(3, "\177ELF\2\1\1\3\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0@l\0\0\0\0\0\0"...,
832) = 832
fstat(3, {st_mode=S_IFREG|0755, st_size=146968, ...}) = 0
mmap(NULL, 132288, PROT_READ, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f058b604000
mmap(0x7f058b60a000, 61440, PROT_READ|PROT_EXEC,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x6000) = 0x7f058b60a000
mmap(0x7f058b619000, 24576, PROT_READ,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x15000) = 0x7f058b619000
mmap(0x7f058b61f000, 8192, PROT_READ|PROT_WRITE,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1a000) = 0x7f058b61f000
mmap(0x7f058b621000, 13504, PROT_READ|PROT_WRITE,
MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f058b621000
close(3)                                = 0
mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1,
0) = 0x7f058b602000
arch_prctl(ARCH_SET_FS, 0x7f058b603100) = 0
mprotect(0x7f058b8bf000, 16384, PROT_READ) = 0
mprotect(0x7f058b61f000, 4096, PROT_READ) = 0
mprotect(0x7f058b62c000, 4096, PROT_READ) = 0
mprotect(0x7f058b631000, 4096, PROT_READ) = 0
mprotect(0x7f058b6a7000, 4096, PROT_READ) = 0
mprotect(0x7f058b6b1000, 4096, PROT_READ) = 0
mprotect(0x7f058b702000, 20480, PROT_READ) = 0
mprotect(0x7f058baed000, 4096, PROT_READ) = 0
mprotect(0x7f058bb4c000, 12288, PROT_READ) = 0
mprotect(0x55754854b000, 4096, PROT_READ) = 0
mprotect(0x7f058bba3000, 4096, PROT_READ) = 0
munmap(0x7f058bb52000, 169946)          = 0
set_tid_address(0x7f058b6033d0)         = 4271
set_robust_list(0x7f058b6033e0, 24)     = 0
rt_sigaction(SIGRTMIN, {sa_handler=0x7f058b60a6b0, sa_mask=[],
sa_flags=SA_RESTORER|SA_SIGINFO, sa_restorer=0x7f058b616730}, NULL, 8)
= 0
rt_sigaction(SIGRT_1, {sa_handler=0x7f058b60a740, sa_mask=[],
sa_flags=SA_RESTORER|SA_RESTART|SA_SIGINFO,
sa_restorer=0x7f058b616730}, NULL, 8) = 0
rt_sigprocmask(SIG_UNBLOCK, [RTMIN RT_1], NULL, 8) = 0
prlimit64(0, RLIMIT_STACK, NULL, {rlim_cur=9788*1024,
rlim_max=RLIM64_INFINITY}) = 0
statfs("/sys/fs/selinux", 0x7ffd59cdfda0) = -1 ENOENT (No such file or
directory)
statfs("/selinux", 0x7ffd59cdfda0)      = -1 ENOENT (No such file or directory)
brk(NULL)                               = 0x5575487e5000
brk(0x557548806000)                     = 0x557548806000
openat(AT_FDCWD, "/proc/filesystems", O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0444, st_size=0, ...}) = 0
read(3, "nodev\tsysfs\nnodev\trootfs\nnodev\tr"..., 1024) = 354
read(3, "", 1024)                       = 0
close(3)                                = 0
access("/etc/selinux/config", F_OK)     = 0
openat(AT_FDCWD, "/usr/lib/locale/locale-archive", O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=5631424, ...}) = 0
mmap(NULL, 5631424, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f058b0a3000
close(3)                                = 0
getuid()                                = 0
geteuid()                               = 0
access("/sys/fs/smackfs", F_OK)         = -1 ENOENT (No such file or directory)
lstat("/dev", {st_mode=S_IFDIR|0755, st_size=5560, ...}) = 0
lstat("/dev/stretch-vg", {st_mode=S_IFDIR|0755, st_size=140, ...}) = 0
lstat("/dev/stretch-vg/boot", {st_mode=S_IFLNK|0777, st_size=8, ...}) = 0
readlink("/dev/stretch-vg/boot", "../dm-30", 4095) = 8
lstat("/dev/dm-30", {st_mode=S_IFBLK|0660, st_rdev=makedev(0xfd,
0x1e), ...}) = 0
stat("/dev/dm-30", {st_mode=S_IFBLK|0660, st_rdev=makedev(0xfd, 0x1e), ...}) = 0
openat(AT_FDCWD, "/sys/block/dm-30/dm/name", O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0444, st_size=4096, ...}) = 0
read(3, "stretch--vg-boot\n", 4096)     = 17
close(3)                                = 0
stat("/dev/mapper/stretch--vg-boot", {st_mode=S_IFBLK|0660,
st_rdev=makedev(0xfd, 0x1e), ...}) = 0
getcwd("/root/tempserver-check", 4096)  = 23
lstat("/root/tempserver-check/stretch_boot", {st_mode=S_IFDIR|0755,
st_size=4096, ...}) = 0
access("/dev/mapper/stretch--vg-boot", F_OK) = 0
openat(AT_FDCWD, "/dev/mapper/stretch--vg-boot", O_RDONLY|O_CLOEXEC) = 3
fadvise64(3, 0, 0, POSIX_FADV_RANDOM)   = 0
fstat(3, {st_mode=S_IFBLK|0660, st_rdev=makedev(0xfd, 0x1e), ...}) = 0
ioctl(3, BLKGETSIZE64, [398458880])     = 0
openat(AT_FDCWD, "/sys/dev/block/253:30", O_RDONLY|O_CLOEXEC) = 4
openat(4, "dm/uuid", O_RDONLY|O_CLOEXEC) = 5
read(5, "LVM-3dcV99ZH3Y7prfkBtGFmGKnAtnyQ"..., 8191) = 69
read(5, "", 8122)                       = 0
close(5)                                = 0
close(4)                                = 0
lseek(3, 398393344, SEEK_SET)           = 398393344
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
64) = 64
lseek(3, 398450688, SEEK_SET)           = 398450688
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
256) = 256
lseek(3, 0, SEEK_SET)                   = 0
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
256) = 256
lseek(3, 4096, SEEK_SET)                = 4096
read(3, "\1\0\4\0\21\0\4\0!\0\4\0\364\17\256\6\4\0\4\0\0\0\0\0\251[gm\255\6l\33"...,
256) = 256
lseek(3, 398458368, SEEK_SET)           = 398458368
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
512) = 512
lseek(3, 398327296, SEEK_SET)           = 398327296
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
512) = 512
openat(AT_FDCWD, "/sys/dev/block/253:30", O_RDONLY|O_CLOEXEC) = 4
faccessat(4, "partition", F_OK)         = -1 ENOENT (No such file or directory)
openat(4, "dm/uuid", O_RDONLY|O_CLOEXEC) = 5
read(5, "LVM-3dcV99ZH3Y7prfkBtGFmGKnAtnyQ"..., 8191) = 69
read(5, "", 8122)                       = 0
close(5)                                = 0
close(4)                                = 0
ioctl(3, BLKSSZGET, [512])              = 0
lseek(3, 398457856, SEEK_SET)           = 398457856
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
48) = 48
lseek(3, 398426624, SEEK_SET)           = 398426624
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 24) = 24
lseek(3, 398328320, SEEK_SET)           = 398328320
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 24) = 24
lseek(3, 398327808, SEEK_SET)           = 398327808
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 24) = 24
lseek(3, 398254592, SEEK_SET)           = 398254592
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 24) = 24
lseek(3, 398156288, SEEK_SET)           = 398156288
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 24) = 24
lseek(3, 398113280, SEEK_SET)           = 398113280
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 24) = 24
lseek(3, 398082560, SEEK_SET)           = 398082560
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 24) = 24
lseek(3, 397992448, SEEK_SET)           = 397992448
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 24) = 24
lseek(3, 397960192, SEEK_SET)           = 397960192
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 24) = 24
lseek(3, 397951488, SEEK_SET)           = 397951488
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 24) = 24
lseek(3, 397971968, SEEK_SET)           = 397971968
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 24) = 24
lseek(3, 396878336, SEEK_SET)           = 396878336
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 24) = 24
lseek(3, 398453248, SEEK_SET)           = 398453248
read(3, "\0\0\0\0", 4)                  = 4
lseek(3, 4096, SEEK_SET)                = 4096
read(3, "\1\0\4\0\21\0\4\0!\0\4\0\364\17\256\6\4\0\4\0\0\0\0\0\251[gm\255\6l\33"...,
1024) = 1024
lseek(3, 398454784, SEEK_SET)           = 398454784
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
4096) = 4096
lseek(3, 0, SEEK_SET)                   = 0
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
1024) = 1024
lseek(3, 1024, SEEK_SET)                = 1024
read(3, "\0}\1\0\0\360\5\0\0L\0\0\223*\4\0\247{\1\0\1\0\0\0\0\0\0\0\0\0\0\0"...,
1024) = 1024
lseek(3, 16384, SEEK_SET)               = 16384
read(3, "\20 \0\0\20`\0\0\20\240\0\0\20\340\0\0\20 \1\0\20
\3\0\20`\3\0\0\0\0\0"..., 512) = 512
lseek(3, 32768, SEEK_SET)               = 32768
read(3, "  \0\0 `\0\0 \240\0\0 \340\0\0  \1\0  \3\0 `\3\0\0\0\0\0"...,
512) = 512
lseek(3, 65536, SEEK_SET)               = 65536
read(3, "@ \0\0@`\0\0@\240\0\0@\340\0\0@ \1\0@ \3\0@`\3\0\0\0\0\0"...,
512) = 512
lseek(3, 131072, SEEK_SET)              = 131072
read(3, "\200 \0\0\200`\0\0\200\240\0\0\200\340\0\0\200 \1\0\200
\3\0\200`\3\0\0\0\0\0"..., 512) = 512
lseek(3, 262144, SEEK_SET)              = 262144
read(3, "\0!\0\0\0a\0\0\0\241\0\0\0\341\0\0\0!\1\0\0!\3\0\0a\3\0\0\0\0\0"...,
512) = 512
lseek(3, 524288, SEEK_SET)              = 524288
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
512) = 512
lseek(3, 1048576, SEEK_SET)             = 1048576
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
512) = 512
lseek(3, 2097152, SEEK_SET)             = 2097152
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
512) = 512
lseek(3, 4194304, SEEK_SET)             = 4194304
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
512) = 512
lseek(3, 1048576, SEEK_SET)             = 1048576
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
1024) = 1024
lseek(3, 3072, SEEK_SET)                = 3072
read(3, "\1\0\2\0\21\0\2\0!\0\2\0\0\20\360\7\0\0\5\0\0\0\0\0\355\267\0\0\360\7\262\32"...,
1024) = 1024
lseek(3, 7168, SEEK_SET)                = 7168
read(3, "\7 \0\0\7`\0\0\7\240\0\0\7\340\0\0\7 \1\0\7
\3\0\7`\3\0\0\0\0\0"..., 1024) = 1024
lseek(3, 15360, SEEK_SET)               = 15360
read(3, "\17 \0\0\17`\0\0\17\240\0\0\17\340\0\0\17 \1\0\17
\3\0\17`\3\0\0\0\0\0"..., 1024) = 1024
lseek(3, 31744, SEEK_SET)               = 31744
read(3, "\37 \0\0\37`\0\0\37\240\0\0\37\340\0\0\37 \1\0\37
\3\0\37`\3\0\0\0\0\0"..., 1024) = 1024
lseek(3, 64512, SEEK_SET)               = 64512
read(3, "? \0\0?`\0\0?\240\0\0?\340\0\0? \1\0? \3\0?`\3\0\0\0\0\0"...,
1024) = 1024
lseek(3, 0, SEEK_SET)                   = 0
mmap(NULL, 266240, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS,
-1, 0) = 0x7f058b062000
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
262144) = 262144
lseek(3, 262144, SEEK_SET)              = 262144
mmap(NULL, 266240, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS,
-1, 0) = 0x7f058b021000
read(3, "\0!\0\0\0a\0\0\0\241\0\0\0\341\0\0\0!\1\0\0!\3\0\0a\3\0\0\0\0\0"...,
262144) = 262144
lseek(3, 397934592, SEEK_SET)           = 397934592
mmap(NULL, 266240, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS,
-1, 0) = 0x7f058afe0000
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
262144) = 262144
lseek(3, 398196736, SEEK_SET)           = 398196736
mmap(NULL, 266240, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS,
-1, 0) = 0x7f058af9f000
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
262144) = 262144
lseek(3, 2097152, SEEK_SET)             = 2097152
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
1024) = 1024
close(3)                                = 0
munmap(0x7f058b062000, 266240)          = 0
munmap(0x7f058b021000, 266240)          = 0
munmap(0x7f058afe0000, 266240)          = 0
munmap(0x7f058af9f000, 266240)          = 0
stat("/sbin/mount.ext4", 0x7ffd59cddad0) = -1 ENOENT (No such file or directory)
stat("/sbin/fs.d/mount.ext4", 0x7ffd59cddad0) = -1 ENOENT (No such
file or directory)
stat("/sbin/fs/mount.ext4", 0x7ffd59cddad0) = -1 ENOENT (No such file
or directory)
getuid()                                = 0
geteuid()                               = 0
getgid()                                = 0
getegid()                               = 0
prctl(PR_GET_DUMPABLE)                  = 1 (SUID_DUMP_USER)
stat("/run", {st_mode=S_IFDIR|0755, st_size=1240, ...}) = 0
lstat("/run/mount/utab", 0x7ffd59cdec10) = -1 ENOENT (No such file or directory)
mkdir("/run/mount", 0755)               = -1 EEXIST (File exists)
stat("/run/mount/utab", 0x7ffd59cdeb00) = -1 ENOENT (No such file or directory)
stat("/run/mount", {st_mode=S_IFDIR|0755, st_size=40, ...}) = 0
geteuid()                               = 0
getegid()                               = 0
getuid()                                = 0
getgid()                                = 0
access("/run/mount", R_OK|W_OK)         = 0
mount("/dev/mapper/stretch--vg-boot",
"/root/tempserver-check/stretch_boot", "ext4", 0, NULL) = -1 EIO
(Input/output error)
openat(AT_FDCWD, "/usr/share/locale/locale.alias", O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=2995, ...}) = 0
read(3, "# Locale name alias data base.\n#"..., 4096) = 2995
read(3, "", 4096)                       = 0
close(3)                                = 0
openat(AT_FDCWD,
"/usr/share/locale/en_US.UTF-8/LC_MESSAGES/util-linux.mo", O_RDONLY) =
-1 ENOENT (No such file or directory)
openat(AT_FDCWD,
"/usr/share/locale/en_US.utf8/LC_MESSAGES/util-linux.mo", O_RDONLY) =
-1 ENOENT (No such file or directory)
openat(AT_FDCWD, "/usr/share/locale/en_US/LC_MESSAGES/util-linux.mo",
O_RDONLY) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD,
"/usr/share/locale/en.UTF-8/LC_MESSAGES/util-linux.mo", O_RDONLY) = -1
ENOENT (No such file or directory)
openat(AT_FDCWD,
"/usr/share/locale/en.utf8/LC_MESSAGES/util-linux.mo", O_RDONLY) = -1
ENOENT (No such file or directory)
openat(AT_FDCWD, "/usr/share/locale/en/LC_MESSAGES/util-linux.mo",
O_RDONLY) = -1 ENOENT (No such file or directory)
write(2, "mount: ", 7mount: )                  = 7
write(2, "/root/tempserver-check/stretch_b"...,
91/root/tempserver-check/stretch_boot: can't read superblock on
/dev/mapper/stretch--vg-boot.) = 91
write(2, "\n", 1
)                       = 1
close(1)                                = 0
close(2)                                = 0
exit_group(32)                          = ?
+++ exited with 32 +++
root@barley:~/tempserver-check# dmesg | tail
[39530.328790] EXT4-fs (dm-30): mount failed
[40566.133158] audit: type=1400 audit(1557817207.785:31):
apparmor="DENIED" operation="open" profile="/usr/sbin/cups-browsed"
name="/usr/share/cups/locale/" pid=23717 comm="cups-browsed"
requested_mask="r" denied_mask="r" fsuid=0 ouid=0
[40566.133186] audit: type=1400 audit(1557817207.785:32):
apparmor="DENIED" operation="open" profile="/usr/sbin/cups-browsed"
name="/usr/share/locale/" pid=23717 comm="cups-browsed"
requested_mask="r" denied_mask="r" fsuid=0 ouid=0
[60924.796860] perf: interrupt took too long (4974 > 4947), lowering
kernel.perf_event_max_sample_rate to 40000
[68155.285591] Process accounting resumed
[74940.130661] block nbd3: Write on read-only
[74940.130666] print_req_error: I/O error, dev nbd3, sector 22843394
[74940.130671] Buffer I/O error on dev dm-30, logical block 1, lost
sync page write
[74940.130677] EXT4-fs (dm-30): I/O error while writing superblock
[74940.130684] EXT4-fs (dm-30): mount failed
root@barley:~/tempserver-check# e2fsck -fn /dev/stretch-vg/boot
e2fsck 1.44.5 (15-Dec-2018)
Pass 1: Checking inodes, blocks, and sizes
Pass 2: Checking directory structure
Pass 3: Checking directory connectivity
Pass 4: Checking reference counts
Pass 5: Checking group summary information
/dev/stretch-vg/boot: 345/97536 files (0.3% non-contiguous),
116077/389120 blocks

[toc] | [prev] | [next] | [standalone]

#208647 — Re: virtual device both is and isn't a valid file system [complete]

FromReco <recoverym4n@enotuniq.net>
Date2019-05-14 19:20 +0200
SubjectRe: virtual device both is and isn't a valid file system [complete]
Message-ID<xXJfP-2Pj-5@gated-at.bofh.it>
In reply to#208645
	Hi.

On Tue, May 14, 2019 at 09:52:10AM -0700, Ross Boylan wrote:
> Here's the info:

Nothing interesting in the strace output, short of:

<strace output>:
...
mount("/dev/mapper/stretch--vg-boot",
"/root/tempserver-check/stretch_boot", "ext4", 0, NULL) = -1 EIO
(Input/output error)
...

The reason being - EIO return code is not documented in the mount(2).
Well, mount(1) said something about that 'other error' as a possible
reason of failure, but the clarity of the message is something that's
left to be desired here.


But this (when in doubt - always check dmesg. Userspace can and will
lie. Trust the kernel):

> root@barley:~/tempserver-check# dmesg | tail
...
> [74940.130661] block nbd3: Write on read-only
> [74940.130666] print_req_error: I/O error, dev nbd3, sector 22843394
> [74940.130671] Buffer I/O error on dev dm-30, logical block 1, lost
> sync page write
> [74940.130677] EXT4-fs (dm-30): I/O error while writing superblock
> [74940.130684] EXT4-fs (dm-30): mount failed

combined with this:

> root@barley:~/tempserver-check# e2fsck -fn /dev/stretch-vg/boot
> e2fsck 1.44.5 (15-Dec-2018)
> Pass 1: Checking inodes, blocks, and sizes
> Pass 2: Checking directory structure
> Pass 3: Checking directory connectivity
> Pass 4: Checking reference counts
> Pass 5: Checking group summary information
> /dev/stretch-vg/boot: 345/97536 files (0.3% non-contiguous),
> 116077/389120 blocks

and this (note -r here):

> qemu-nbd -v -r --fork -c ...

and this:

> mount /dev/stretch-vg/boot stretch_boot


Brings me to the following:

1) One cannot mount an ext* filesystem in read-write mode (it's the
default) unless an underlying block device is also in read-write mode.
Your PV is read-only, that's the source of your problem.

2) One can mount an ext* filesystem in read-only mode, assuming that
it's clean. Currently that's your case, so 

mount -r /dev/stretch-vg/boot stretch_boot

should work for you.

3) Both fsck (with -n option), and dump(1) should work here too.

4) But to escape the future confusion I suggest you to loose that '-r'
flag in qemu-nbd. And to backup that 'vdi' image beforehand, just in
case.

Reco

[toc] | [prev] | [next] | [standalone]

#208648 — Re: virtual device both is and isn't a valid file system [complete]

FromRoss Boylan <rossboylan@stanfordalumni.org>
Date2019-05-14 19:30 +0200
SubjectRe: virtual device both is and isn't a valid file system [complete]
Message-ID<xXJpv-2SO-5@gated-at.bofh.it>
In reply to#208645
Noticing the "write on read-only" error, and remembering it should be
read-only, I added that to the mount options.  Which still failed, but
differently:
root@barley:~/tempserver-check# date; strace -f mount -r
/dev/stretch-vg/boot stretch_boot
Tue 14 May 2019 10:07:05 AM PDT
execve("/usr/bin/mount", ["mount", "-r", "/dev/stretch-vg/boot",
"stretch_boot"], 0x7ffebd8055b0 /* 26 vars */) = 0
brk(NULL)                               = 0x55f1c537d000
access("/etc/ld.so.preload", R_OK)      = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, "/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=169946, ...}) = 0
mmap(NULL, 169946, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f292e2bf000
close(3)                                = 0
openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libmount.so.1", O_RDONLY|O_CLOEXEC) = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\340\332\0\0\0\0\0\0"...,
832) = 832
fstat(3, {st_mode=S_IFREG|0644, st_size=383456, ...}) = 0
mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1,
0) = 0x7f292e2bd000
mmap(NULL, 386344, PROT_READ, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f292e25e000
mprotect(0x7f292e26a000, 323584, PROT_NONE) = 0
mmap(0x7f292e26a000, 245760, PROT_READ|PROT_EXEC,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0xc000) = 0x7f292e26a000
mmap(0x7f292e2a6000, 73728, PROT_READ,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x48000) = 0x7f292e2a6000
mmap(0x7f292e2b9000, 16384, PROT_READ|PROT_WRITE,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x5a000) = 0x7f292e2b9000
close(3)                                = 0
openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libselinux.so.1",
O_RDONLY|O_CLOEXEC) = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0@k\0\0\0\0\0\0"...,
832) = 832
fstat(3, {st_mode=S_IFREG|0644, st_size=155296, ...}) = 0
mmap(NULL, 2259632, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3,
0) = 0x7f292e036000
mprotect(0x7f292e05b000, 2093056, PROT_NONE) = 0
mmap(0x7f292e25a000, 8192, PROT_READ|PROT_WRITE,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x24000) = 0x7f292e25a000
mmap(0x7f292e25c000, 6832, PROT_READ|PROT_WRITE,
MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f292e25c000
close(3)                                = 0
openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libc.so.6", O_RDONLY|O_CLOEXEC) = 3
read(3, "\177ELF\2\1\1\3\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\260A\2\0\0\0\0\0"...,
832) = 832
fstat(3, {st_mode=S_IFREG|0755, st_size=1824496, ...}) = 0
mmap(NULL, 1837056, PROT_READ, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f292de75000
mprotect(0x7f292de97000, 1658880, PROT_NONE) = 0
mmap(0x7f292de97000, 1343488, PROT_READ|PROT_EXEC,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x22000) = 0x7f292de97000
mmap(0x7f292dfdf000, 311296, PROT_READ,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x16a000) = 0x7f292dfdf000
mmap(0x7f292e02c000, 24576, PROT_READ|PROT_WRITE,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1b6000) = 0x7f292e02c000
mmap(0x7f292e032000, 14336, PROT_READ|PROT_WRITE,
MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f292e032000
close(3)                                = 0
openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libblkid.so.1", O_RDONLY|O_CLOEXEC) = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0P\257\0\0\0\0\0\0"...,
832) = 832
fstat(3, {st_mode=S_IFREG|0644, st_size=343008, ...}) = 0
mmap(NULL, 345896, PROT_READ, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f292de20000
mprotect(0x7f292de2a000, 282624, PROT_NONE) = 0
mmap(0x7f292de2a000, 212992, PROT_READ|PROT_EXEC,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0xa000) = 0x7f292de2a000
mmap(0x7f292de5e000, 65536, PROT_READ,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x3e000) = 0x7f292de5e000
mmap(0x7f292de6f000, 24576, PROT_READ|PROT_WRITE,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x4e000) = 0x7f292de6f000
close(3)                                = 0
openat(AT_FDCWD, "/lib/x86_64-linux-gnu/librt.so.1", O_RDONLY|O_CLOEXEC) = 3
read(3, "\177ELF\2\1\1\3\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\260#\0\0\0\0\0\0"...,
832) = 832
fstat(3, {st_mode=S_IFREG|0644, st_size=35808, ...}) = 0
mmap(NULL, 39904, PROT_READ, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f292de16000
mmap(0x7f292de18000, 16384, PROT_READ|PROT_EXEC,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x7f292de18000
mmap(0x7f292de1c000, 8192, PROT_READ,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x6000) = 0x7f292de1c000
mmap(0x7f292de1e000, 8192, PROT_READ|PROT_WRITE,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x7000) = 0x7f292de1e000
close(3)                                = 0
openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libpcre.so.3", O_RDONLY|O_CLOEXEC) = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\340!\0\0\0\0\0\0"...,
832) = 832
fstat(3, {st_mode=S_IFREG|0644, st_size=468944, ...}) = 0
mmap(NULL, 471304, PROT_READ, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f292dda2000
mmap(0x7f292dda4000, 335872, PROT_READ|PROT_EXEC,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x7f292dda4000
mmap(0x7f292ddf6000, 122880, PROT_READ,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x54000) = 0x7f292ddf6000
mmap(0x7f292de14000, 8192, PROT_READ|PROT_WRITE,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x71000) = 0x7f292de14000
close(3)                                = 0
openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libdl.so.2", O_RDONLY|O_CLOEXEC) = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0000\21\0\0\0\0\0\0"...,
832) = 832
fstat(3, {st_mode=S_IFREG|0644, st_size=14592, ...}) = 0
mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1,
0) = 0x7f292dda0000
mmap(NULL, 16656, PROT_READ, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f292dd9b000
mmap(0x7f292dd9c000, 4096, PROT_READ|PROT_EXEC,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1000) = 0x7f292dd9c000
mmap(0x7f292dd9d000, 4096, PROT_READ,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x7f292dd9d000
mmap(0x7f292dd9e000, 8192, PROT_READ|PROT_WRITE,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x7f292dd9e000
close(3)                                = 0
openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libuuid.so.1", O_RDONLY|O_CLOEXEC) = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0
#\0\0\0\0\0\0"..., 832) = 832
fstat(3, {st_mode=S_IFREG|0644, st_size=30776, ...}) = 0
mmap(NULL, 32792, PROT_READ, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f292dd92000
mmap(0x7f292dd94000, 16384, PROT_READ|PROT_EXEC,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x7f292dd94000
mmap(0x7f292dd98000, 4096, PROT_READ,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x6000) = 0x7f292dd98000
mmap(0x7f292dd99000, 8192, PROT_READ|PROT_WRITE,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x6000) = 0x7f292dd99000
close(3)                                = 0
openat(AT_FDCWD, "/lib/x86_64-linux-gnu/libpthread.so.0",
O_RDONLY|O_CLOEXEC) = 3
read(3, "\177ELF\2\1\1\3\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0@l\0\0\0\0\0\0"...,
832) = 832
fstat(3, {st_mode=S_IFREG|0755, st_size=146968, ...}) = 0
mmap(NULL, 132288, PROT_READ, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f292dd71000
mmap(0x7f292dd77000, 61440, PROT_READ|PROT_EXEC,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x6000) = 0x7f292dd77000
mmap(0x7f292dd86000, 24576, PROT_READ,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x15000) = 0x7f292dd86000
mmap(0x7f292dd8c000, 8192, PROT_READ|PROT_WRITE,
MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1a000) = 0x7f292dd8c000
mmap(0x7f292dd8e000, 13504, PROT_READ|PROT_WRITE,
MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f292dd8e000
close(3)                                = 0
mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1,
0) = 0x7f292dd6f000
arch_prctl(ARCH_SET_FS, 0x7f292dd70100) = 0
mprotect(0x7f292e02c000, 16384, PROT_READ) = 0
mprotect(0x7f292dd8c000, 4096, PROT_READ) = 0
mprotect(0x7f292dd99000, 4096, PROT_READ) = 0
mprotect(0x7f292dd9e000, 4096, PROT_READ) = 0
mprotect(0x7f292de14000, 4096, PROT_READ) = 0
mprotect(0x7f292de1e000, 4096, PROT_READ) = 0
mprotect(0x7f292de6f000, 20480, PROT_READ) = 0
mprotect(0x7f292e25a000, 4096, PROT_READ) = 0
mprotect(0x7f292e2b9000, 12288, PROT_READ) = 0
mprotect(0x55f1c3476000, 4096, PROT_READ) = 0
mprotect(0x7f292e310000, 4096, PROT_READ) = 0
munmap(0x7f292e2bf000, 169946)          = 0
set_tid_address(0x7f292dd703d0)         = 5197
set_robust_list(0x7f292dd703e0, 24)     = 0
rt_sigaction(SIGRTMIN, {sa_handler=0x7f292dd776b0, sa_mask=[],
sa_flags=SA_RESTORER|SA_SIGINFO, sa_restorer=0x7f292dd83730}, NULL, 8)
= 0
rt_sigaction(SIGRT_1, {sa_handler=0x7f292dd77740, sa_mask=[],
sa_flags=SA_RESTORER|SA_RESTART|SA_SIGINFO,
sa_restorer=0x7f292dd83730}, NULL, 8) = 0
rt_sigprocmask(SIG_UNBLOCK, [RTMIN RT_1], NULL, 8) = 0
prlimit64(0, RLIMIT_STACK, NULL, {rlim_cur=9788*1024,
rlim_max=RLIM64_INFINITY}) = 0
statfs("/sys/fs/selinux", 0x7ffdd9fc4220) = -1 ENOENT (No such file or
directory)
statfs("/selinux", 0x7ffdd9fc4220)      = -1 ENOENT (No such file or directory)
brk(NULL)                               = 0x55f1c537d000
brk(0x55f1c539e000)                     = 0x55f1c539e000
openat(AT_FDCWD, "/proc/filesystems", O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0444, st_size=0, ...}) = 0
read(3, "nodev\tsysfs\nnodev\trootfs\nnodev\tr"..., 1024) = 354
read(3, "", 1024)                       = 0
close(3)                                = 0
access("/etc/selinux/config", F_OK)     = 0
openat(AT_FDCWD, "/usr/lib/locale/locale-archive", O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=5631424, ...}) = 0
mmap(NULL, 5631424, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f292d810000
close(3)                                = 0
getuid()                                = 0
geteuid()                               = 0
access("/sys/fs/smackfs", F_OK)         = -1 ENOENT (No such file or directory)
lstat("/dev", {st_mode=S_IFDIR|0755, st_size=5560, ...}) = 0
lstat("/dev/stretch-vg", {st_mode=S_IFDIR|0755, st_size=140, ...}) = 0
lstat("/dev/stretch-vg/boot", {st_mode=S_IFLNK|0777, st_size=8, ...}) = 0
readlink("/dev/stretch-vg/boot", "../dm-30", 4095) = 8
lstat("/dev/dm-30", {st_mode=S_IFBLK|0660, st_rdev=makedev(0xfd,
0x1e), ...}) = 0
stat("/dev/dm-30", {st_mode=S_IFBLK|0660, st_rdev=makedev(0xfd, 0x1e), ...}) = 0
openat(AT_FDCWD, "/sys/block/dm-30/dm/name", O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0444, st_size=4096, ...}) = 0
read(3, "stretch--vg-boot\n", 4096)     = 17
close(3)                                = 0
stat("/dev/mapper/stretch--vg-boot", {st_mode=S_IFBLK|0660,
st_rdev=makedev(0xfd, 0x1e), ...}) = 0
getcwd("/root/tempserver-check", 4096)  = 23
lstat("/root/tempserver-check/stretch_boot", {st_mode=S_IFDIR|0755,
st_size=4096, ...}) = 0
access("/dev/mapper/stretch--vg-boot", F_OK) = 0
openat(AT_FDCWD, "/dev/mapper/stretch--vg-boot", O_RDONLY|O_CLOEXEC) = 3
fadvise64(3, 0, 0, POSIX_FADV_RANDOM)   = 0
fstat(3, {st_mode=S_IFBLK|0660, st_rdev=makedev(0xfd, 0x1e), ...}) = 0
ioctl(3, BLKGETSIZE64, [398458880])     = 0
openat(AT_FDCWD, "/sys/dev/block/253:30", O_RDONLY|O_CLOEXEC) = 4
openat(4, "dm/uuid", O_RDONLY|O_CLOEXEC) = 5
read(5, "LVM-3dcV99ZH3Y7prfkBtGFmGKnAtnyQ"..., 8191) = 69
read(5, "", 8122)                       = 0
close(5)                                = 0
close(4)                                = 0
lseek(3, 398393344, SEEK_SET)           = 398393344
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
64) = 64
lseek(3, 398450688, SEEK_SET)           = 398450688
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
256) = 256
lseek(3, 0, SEEK_SET)                   = 0
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
256) = 256
lseek(3, 4096, SEEK_SET)                = 4096
read(3, "\1\0\4\0\21\0\4\0!\0\4\0\364\17\256\6\4\0\4\0\0\0\0\0\251[gm\255\6l\33"...,
256) = 256
lseek(3, 398458368, SEEK_SET)           = 398458368
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
512) = 512
lseek(3, 398327296, SEEK_SET)           = 398327296
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
512) = 512
openat(AT_FDCWD, "/sys/dev/block/253:30", O_RDONLY|O_CLOEXEC) = 4
faccessat(4, "partition", F_OK)         = -1 ENOENT (No such file or directory)
openat(4, "dm/uuid", O_RDONLY|O_CLOEXEC) = 5
read(5, "LVM-3dcV99ZH3Y7prfkBtGFmGKnAtnyQ"..., 8191) = 69
read(5, "", 8122)                       = 0
close(5)                                = 0
close(4)                                = 0
ioctl(3, BLKSSZGET, [512])              = 0
lseek(3, 398457856, SEEK_SET)           = 398457856
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
48) = 48
lseek(3, 398426624, SEEK_SET)           = 398426624
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 24) = 24
lseek(3, 398328320, SEEK_SET)           = 398328320
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 24) = 24
lseek(3, 398327808, SEEK_SET)           = 398327808
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 24) = 24
lseek(3, 398254592, SEEK_SET)           = 398254592
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 24) = 24
lseek(3, 398156288, SEEK_SET)           = 398156288
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 24) = 24
lseek(3, 398113280, SEEK_SET)           = 398113280
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 24) = 24
lseek(3, 398082560, SEEK_SET)           = 398082560
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 24) = 24
lseek(3, 397992448, SEEK_SET)           = 397992448
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 24) = 24
lseek(3, 397960192, SEEK_SET)           = 397960192
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 24) = 24
lseek(3, 397951488, SEEK_SET)           = 397951488
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 24) = 24
lseek(3, 397971968, SEEK_SET)           = 397971968
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 24) = 24
lseek(3, 396878336, SEEK_SET)           = 396878336
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0", 24) = 24
lseek(3, 398453248, SEEK_SET)           = 398453248
read(3, "\0\0\0\0", 4)                  = 4
lseek(3, 4096, SEEK_SET)                = 4096
read(3, "\1\0\4\0\21\0\4\0!\0\4\0\364\17\256\6\4\0\4\0\0\0\0\0\251[gm\255\6l\33"...,
1024) = 1024
lseek(3, 398454784, SEEK_SET)           = 398454784
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
4096) = 4096
lseek(3, 0, SEEK_SET)                   = 0
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
1024) = 1024
lseek(3, 1024, SEEK_SET)                = 1024
read(3, "\0}\1\0\0\360\5\0\0L\0\0\223*\4\0\247{\1\0\1\0\0\0\0\0\0\0\0\0\0\0"...,
1024) = 1024
lseek(3, 16384, SEEK_SET)               = 16384
read(3, "\20 \0\0\20`\0\0\20\240\0\0\20\340\0\0\20 \1\0\20
\3\0\20`\3\0\0\0\0\0"..., 512) = 512
lseek(3, 32768, SEEK_SET)               = 32768
read(3, "  \0\0 `\0\0 \240\0\0 \340\0\0  \1\0  \3\0 `\3\0\0\0\0\0"...,
512) = 512
lseek(3, 65536, SEEK_SET)               = 65536
read(3, "@ \0\0@`\0\0@\240\0\0@\340\0\0@ \1\0@ \3\0@`\3\0\0\0\0\0"...,
512) = 512
lseek(3, 131072, SEEK_SET)              = 131072
read(3, "\200 \0\0\200`\0\0\200\240\0\0\200\340\0\0\200 \1\0\200
\3\0\200`\3\0\0\0\0\0"..., 512) = 512
lseek(3, 262144, SEEK_SET)              = 262144
read(3, "\0!\0\0\0a\0\0\0\241\0\0\0\341\0\0\0!\1\0\0!\3\0\0a\3\0\0\0\0\0"...,
512) = 512
lseek(3, 524288, SEEK_SET)              = 524288
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
512) = 512
lseek(3, 1048576, SEEK_SET)             = 1048576
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
512) = 512
lseek(3, 2097152, SEEK_SET)             = 2097152
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
512) = 512
lseek(3, 4194304, SEEK_SET)             = 4194304
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
512) = 512
lseek(3, 1048576, SEEK_SET)             = 1048576
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
1024) = 1024
lseek(3, 3072, SEEK_SET)                = 3072
read(3, "\1\0\2\0\21\0\2\0!\0\2\0\0\20\360\7\0\0\5\0\0\0\0\0\355\267\0\0\360\7\262\32"...,
1024) = 1024
lseek(3, 7168, SEEK_SET)                = 7168
read(3, "\7 \0\0\7`\0\0\7\240\0\0\7\340\0\0\7 \1\0\7
\3\0\7`\3\0\0\0\0\0"..., 1024) = 1024
lseek(3, 15360, SEEK_SET)               = 15360
read(3, "\17 \0\0\17`\0\0\17\240\0\0\17\340\0\0\17 \1\0\17
\3\0\17`\3\0\0\0\0\0"..., 1024) = 1024
lseek(3, 31744, SEEK_SET)               = 31744
read(3, "\37 \0\0\37`\0\0\37\240\0\0\37\340\0\0\37 \1\0\37
\3\0\37`\3\0\0\0\0\0"..., 1024) = 1024
lseek(3, 64512, SEEK_SET)               = 64512
read(3, "? \0\0?`\0\0?\240\0\0?\340\0\0? \1\0? \3\0?`\3\0\0\0\0\0"...,
1024) = 1024
lseek(3, 0, SEEK_SET)                   = 0
mmap(NULL, 266240, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS,
-1, 0) = 0x7f292d7cf000
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
262144) = 262144
lseek(3, 262144, SEEK_SET)              = 262144
mmap(NULL, 266240, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS,
-1, 0) = 0x7f292d78e000
read(3, "\0!\0\0\0a\0\0\0\241\0\0\0\341\0\0\0!\1\0\0!\3\0\0a\3\0\0\0\0\0"...,
262144) = 262144
lseek(3, 397934592, SEEK_SET)           = 397934592
mmap(NULL, 266240, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS,
-1, 0) = 0x7f292d74d000
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
262144) = 262144
lseek(3, 398196736, SEEK_SET)           = 398196736
mmap(NULL, 266240, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS,
-1, 0) = 0x7f292d70c000
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
262144) = 262144
lseek(3, 2097152, SEEK_SET)             = 2097152
read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
1024) = 1024
close(3)                                = 0
munmap(0x7f292d7cf000, 266240)          = 0
munmap(0x7f292d78e000, 266240)          = 0
munmap(0x7f292d74d000, 266240)          = 0
munmap(0x7f292d70c000, 266240)          = 0
stat("/sbin/mount.ext4", 0x7ffdd9fc1f50) = -1 ENOENT (No such file or directory)
stat("/sbin/fs.d/mount.ext4", 0x7ffdd9fc1f50) = -1 ENOENT (No such
file or directory)
stat("/sbin/fs/mount.ext4", 0x7ffdd9fc1f50) = -1 ENOENT (No such file
or directory)
getuid()                                = 0
geteuid()                               = 0
getgid()                                = 0
getegid()                               = 0
prctl(PR_GET_DUMPABLE)                  = 1 (SUID_DUMP_USER)
stat("/run", {st_mode=S_IFDIR|0755, st_size=1240, ...}) = 0
lstat("/run/mount/utab", 0x7ffdd9fc3090) = -1 ENOENT (No such file or directory)
mkdir("/run/mount", 0755)               = -1 EEXIST (File exists)
stat("/run/mount/utab", 0x7ffdd9fc2f80) = -1 ENOENT (No such file or directory)
stat("/run/mount", {st_mode=S_IFDIR|0755, st_size=40, ...}) = 0
geteuid()                               = 0
getegid()                               = 0
getuid()                                = 0
getgid()                                = 0
access("/run/mount", R_OK|W_OK)         = 0
mount("/dev/mapper/stretch--vg-boot",
"/root/tempserver-check/stretch_boot", "ext4", MS_RDONLY, NULL) = 0
close(1)                                = 0
close(2)                                = 0
exit_group(0)                           = ?
+++ exited with 0 +++
root@barley:~/tempserver-check# dmesg | tail
[40566.133158] audit: type=1400 audit(1557817207.785:31):
apparmor="DENIED" operation="open" profile="/usr/sbin/cups-browsed"
name="/usr/share/cups/locale/" pid=23717 comm="cups-browsed"
requested_mask="r" denied_mask="r" fsuid=0 ouid=0
[40566.133186] audit: type=1400 audit(1557817207.785:32):
apparmor="DENIED" operation="open" profile="/usr/sbin/cups-browsed"
name="/usr/share/locale/" pid=23717 comm="cups-browsed"
requested_mask="r" denied_mask="r" fsuid=0 ouid=0
[60924.796860] perf: interrupt took too long (4974 > 4947), lowering
kernel.perf_event_max_sample_rate to 40000
[68155.285591] Process accounting resumed
[74940.130661] block nbd3: Write on read-only
[74940.130666] print_req_error: I/O error, dev nbd3, sector 22843394
[74940.130671] Buffer I/O error on dev dm-30, logical block 1, lost
sync page write
[74940.130677] EXT4-fs (dm-30): I/O error while writing superblock
[74940.130684] EXT4-fs (dm-30): mount failed
[76983.987331] EXT4-fs (dm-30): mounted filesystem with ordered data
mode. Opts: (null)

The bad sector was at 7,724,531,336, 8 sectors long, using 512b
sectors and decimal numbers.
The partition sdf2 starts at sector 4096 and ends at 7814035455.  Even
with all the layers, that doesn't seem to be the one reporting the
error.  And on sdf2 reading that location should not be a hardware
error, just junk data.

Ross

[toc] | [prev] | [next] | [standalone]

#208649 — Re: virtual device both is and isn't a valid file system [complete]

FromReco <recoverym4n@enotuniq.net>
Date2019-05-14 19:40 +0200
SubjectRe: virtual device both is and isn't a valid file system [complete]
Message-ID<xXJzc-30j-3@gated-at.bofh.it>
In reply to#208648
	Hi.

On Tue, May 14, 2019 at 10:20:47AM -0700, Ross Boylan wrote:
> Noticing the "write on read-only" error, and remembering it should be
> read-only, I added that to the mount options.  Which still failed, but
> differently:
> root@barley:~/tempserver-check# date; strace -f mount -r
> /dev/stretch-vg/boot stretch_boot
> Tue 14 May 2019 10:07:05 AM PDT
...
> mount("/dev/mapper/stretch--vg-boot",
> "/root/tempserver-check/stretch_boot", "ext4", MS_RDONLY, NULL) = 0

I don't see a failure here.

> +++ exited with 0 +++
> root@barley:~/tempserver-check# dmesg | tail
...
> [76983.987331] EXT4-fs (dm-30): mounted filesystem with ordered data
> mode. Opts: (null)

Nor I do not see it here. It should be mounted.

> 
> The bad sector was at 7,724,531,336, 8 sectors long, using 512b
> sectors and decimal numbers.
> The partition sdf2 starts at sector 4096 and ends at 7814035455.  Even
> with all the layers, that doesn't seem to be the one reporting the
> error.  And on sdf2 reading that location should not be a hardware
> error, just junk data.

"Can't read superblock on ..." is a red herring here.
See my other e-mail.

Reco

[toc] | [prev] | [next] | [standalone]

#208650 — Re: virtual device both is and isn't a valid file system [solved]

FromRoss Boylan <rossboylan@stanfordalumni.org>
Date2019-05-14 19:40 +0200
SubjectRe: virtual device both is and isn't a valid file system [solved]
Message-ID<xXJzc-30j-7@gated-at.bofh.it>
In reply to#208648
On Tue, May 14, 2019 at 10:20 AM Ross Boylan
<rossboylan@stanfordalumni.org> wrote:
>
> Noticing the "write on read-only" error, and remembering it should be
> read-only, I added that to the mount options.  Which still failed, but
> differently:
Well, it failed differently in the sense that it succeeded :) Yay!
I was fooled by the errors in dmsg, which referred to previous
attempts.  As you predicted and I hoped, mounting with the read-only
option succeeded.

Reco, thanks so much for your help.

On to the next problem....

Ross

P.S. One reason I'm trying for read-only is that sdf2 is already the
backup from the failing drive.

[toc] | [prev] | [standalone]

Back to top | Article view | linux.debian.user

csiph-web