Groups > linux.debian.user > #190496

Re: Experiences with BTRFS -- is it mature enough for enterprise use?

From	Sven Hartge <sven@svenhartge.de>
Newsgroups	linux.debian.user
Subject	Re: Experiences with BTRFS -- is it mature enough for enterprise use?
Date	2017-12-31 23:50 +0100
Message-ID	<v2UAy-2fi-1@gated-at.bofh.it> (permalink)
References	(8 earlier) <v2dlT-7mc-1@gated-at.bofh.it> <v2xXj-49E-9@gated-at.bofh.it> <v2F8t-zD-1@gated-at.bofh.it> <v2PUe-7C7-3@gated-at.bofh.it> <v2TXQ-22h-5@gated-at.bofh.it>
Organization	Newsfeed am Wurmloch

Show all headers | View raw

David Christensen <dpchrist@holgerdanske.com> wrote:
> On 12/31/17 09:44, Sven Hartge wrote:
>> David Christensen <dpchrist@holgerdanske.com> wrote:
>>> On 12/30/17 14:38, Matthew Crews wrote:

>>>> The main issue I see with using BTRFS with MDADM is that you lose
>>>> the benefit of bit-rot repair. MDADM can't correct bit rot, but
>>>> BTRFS-Raid (and ZFS raid arrays) can, but only with native raid
>>>> configurations.
>> 
>>> AFAIK:
>> 
>>> 1.  mdadm RAID1 can fix bit rot, so long as one drive has a good
>>> block to fix the others.
 
>> Yes, but it can't fix silent bit-rot, where incorrect bytes are read
>> from the drive without the drive noticing. In that case the Kernel
>> has no way of knowing which bytes are the correct ones, you need some
>> sort of checksum for that.

> My bad -- the only way for md to detect bit-rot is via scrubbing:

>     $ man 4 md

>     SCRUBBING AND MISMATCHES
>     ...
>        If check was used, then no action is taken to handle the mismatch,  it
>        is  simply  recorded.   If  repair  was  used,  then a mismatch will be
>        repaired in the same way that resync repairs arrays.   For RAID5/RAID6
>        new parity blocks are written.  For RAID1/RAID10, all but one block are
>        overwritten with the content of that one block.


> I wonder how md picks "that one block"?

Only if one drives reports an error. Then data from the good block is
used to overwrite the bad block, hoping the drive remaps the sector and
everything is fine again.

If both devices report no error but differing data has been read,
MD-RAID1 can't know which block is good. 

MD-RAID5/6 could calculate all parity combinations and use the data a
majority agrees upon. (I don't know if it does it, though).

I tried looking at the Kernel RAID code, but I must admit: it is all
Esperanto to me, the code is far too low level for me to understand.

S°

-- 
Sigmentation fault. Core dumped.

Thread

Experiences with BTRFS -- is it mature enough for enterprise use? Rick Thomas <rbthomas@pobox.com> - 2017-12-26 20:50 +0100
  Re: Experiences with BTRFS -- is it mature enough for enterprise use? Eero Volotinen <eero.volotinen@iki.fi> - 2017-12-26 20:50 +0100
    Re: Experiences with BTRFS -- is it mature enough for enterprise use? Roberto C. Sánchez <roberto@debian.org> - 2017-12-26 23:30 +0100
      Re: Experiences with BTRFS -- is it mature enough for enterprise use? Sven Hartge <sven@svenhartge.de> - 2017-12-27 00:00 +0100
      Re: Experiences with BTRFS -- is it mature enough for enterprise use? Michael Stone <mstone@debian.org> - 2017-12-27 00:40 +0100
  Re: Experiences with BTRFS -- is it mature enough for enterprise use? Jan Vales <jan@jvales.net> - 2017-12-26 21:30 +0100
  Re: Experiences with BTRFS -- is it mature enough for enterprise use? Andy Smith <andy@strugglers.net> - 2017-12-26 22:40 +0100
  Re: Experiences with BTRFS -- is it mature enough for enterprise use? David Christensen <dpchrist@holgerdanske.com> - 2017-12-27 04:10 +0100
    Re: Experiences with BTRFS -- is it mature enough for enterprise use? Matthew Crews <mailinglists@mattcrews.com> - 2017-12-27 13:00 +0100
      Re: Experiences with BTRFS -- is it mature enough for enterprise use? Tom Dial <tddial@comcast.net> - 2017-12-27 23:10 +0100
        Re: Experiences with BTRFS -- is it mature enough for enterprise use? Rick Thomas <rick.thomas@pobox.com> - 2017-12-28 02:10 +0100
          Re: Experiences with BTRFS -- is it mature enough for enterprise use? deloptes <deloptes@gmail.com> - 2017-12-28 02:20 +0100
            Re: Experiences with BTRFS -- is it mature enough for enterprise use? Eero Volotinen <eero.volotinen@iki.fi> - 2017-12-28 07:10 +0100
              Re: Experiences with BTRFS -- is it mature enough for enterprise use? Dan Ritter <dsr@randomstring.org> - 2017-12-28 17:00 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Eero Volotinen <eero.volotinen@iki.fi> - 2017-12-28 18:30 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Glenn English <ghe2001@gmail.com> - 2017-12-28 20:40 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Matthew Crews <mailinglists@mattcrews.com> - 2017-12-28 20:50 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Andy Smith <andy@strugglers.net> - 2017-12-29 01:00 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Jan Vales <jan@jvales.net> - 2017-12-30 00:50 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Matthew Crews <mailinglists@mattcrews.com> - 2017-12-30 01:30 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Jan Vales <jan@jvales.net> - 2017-12-30 01:40 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Matthew Crews <mailinglists@mattcrews.com> - 2017-12-30 23:40 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? David Christensen <dpchrist@holgerdanske.com> - 2017-12-31 07:20 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Sven Hartge <sven@svenhartge.de> - 2017-12-31 18:50 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? David Christensen <dpchrist@holgerdanske.com> - 2017-12-31 23:10 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Sven Hartge <sven@svenhartge.de> - 2017-12-31 23:50 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? David Christensen <dpchrist@holgerdanske.com> - 2018-01-02 03:10 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? <tomas@tuxteam.de> - 2018-01-02 11:30 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? David Christensen <dpchrist@holgerdanske.com> - 2018-01-02 17:40 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? deloptes <deloptes@gmail.com> - 2018-01-02 19:10 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Pascal Hambourg <pascal@plouf.fr.eu.org> - 2018-01-02 20:10 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? deloptes <deloptes@gmail.com> - 2018-01-03 01:00 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Pascal Hambourg <pascal@plouf.fr.eu.org> - 2018-01-04 00:00 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? deloptes <deloptes@gmail.com> - 2018-01-04 09:00 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Pascal Hambourg <pascal@plouf.fr.eu.org> - 2018-01-04 20:20 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? deloptes <deloptes@gmail.com> - 2018-01-04 22:00 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? deloptes <deloptes@gmail.com> - 2018-01-04 12:00 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? David Christensen <dpchrist@holgerdanske.com> - 2018-01-03 00:10 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Darac Marjal <mailinglist@darac.org.uk> - 2018-01-03 00:50 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Gene Heskett <gheskett@shentel.net> - 2018-01-03 02:10 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Richard Hector <richard@walnut.gen.nz> - 2018-01-06 13:30 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? David Christensen <dpchrist@holgerdanske.com> - 2018-01-03 08:40 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Joel Wirāmu Pauling <joel@aenertia.net> - 2017-12-31 23:20 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Andy Smith <andy@strugglers.net> - 2018-01-03 04:40 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Pascal Hambourg <pascal@plouf.fr.eu.org> - 2017-12-30 10:30 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Dan Ritter <dsr@randomstring.org> - 2017-12-28 21:10 +0100
              Re: Experiences with BTRFS -- is it mature enough for enterprise use? deloptes <deloptes@gmail.com> - 2017-12-28 18:00 +0100
  Re: Experiences with BTRFS -- is it mature enough for enterprise use? Igor Cicimov <icicimov@gmail.com> - 2017-12-29 05:00 +0100

csiph-web