Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > linux.debian.user > #190327

Re: Experiences with BTRFS -- is it mature enough for enterprise use?

From Jan Vales <jan@jvales.net>
Newsgroups linux.debian.user
Subject Re: Experiences with BTRFS -- is it mature enough for enterprise use?
Date 2017-12-26 21:30 +0100
Message-ID <v141j-7Pj-1@gated-at.bofh.it> (permalink)
References <v13oB-7l8-3@gated-at.bofh.it>
Organization linux.* mail to news gateway

Show all headers | View raw


[Multipart message — attachments visible in raw view] - view raw

tl;dr:
save yourself the hassle and dont. go for md-raid5/6 + (luks +) XFS.

long version:

Just last week we migrated our soon to be production server (6 disks)
btrfs-raid10 to md-raid6+XFS, after btrfs managed to die twice in december.

So cool btrfs-raid/filesystem-level-raid sounds, so broken it seems atm :(
Not only did they not manage to use "common" definitions of raid - as
in: md-raid being de-facto-standard, they get to define certain aspects
of raid and others have to live by that ...

READ THEIR DOCS + MAILING LIST!

For example: when people talk about raid1 with say 4 disks, they expect
that all disks have the same contents... Therefore expecting that losing
3 disks means no data loss.
Well... btrfs decided to stick with some ancient definition of raid1
which is imho more like md-raid10, than md-raid1, as there are only 2
copies of data and you cant make btrfs to store more than 2 copies.
Therefore losing 2/4 disks -> btrfs irrecoverably broken.

btrfs-raid1 and btrfs-raid10 seem to be basically the same thing, with
some imho performance optimizations (not striping vs striping), which
should imho not even be user-settable as it makes no sense to go for
suboptimal performance, but then again, maybe i missed some of their
nearly inexistent documentation pointing out the good part of
btrfs-raid1 ...

Also btrfs-raid5/6 are broken and didnt even survive our in-vm-testing,
before getting a chance on bare-metal.


Also it seems way easier to go "full-raid-encryption" with luks + md-raid.
(Our intention is to be able to send in disks to get them replaced
without having to worry, that data could be easily extracted; there is
an usb-stick with the luks key sticking out of every machine...)

If you need some btrfs-features (snapshots <3), consider going
md-raid+luks+btrfs.
* Unsure if it still holds that btrfs will fail horribly if it sees its
uuid on more than one disk, possibly making the
full-disk-encryption-layer mandatory.

br,
Jan


On 12/26/17 20:37, Rick Thomas wrote:
> 
> Is btrfs mature enough to use in enterprise applications?
> 
> If you are using it, I’d like to hear from you about your experiences — good or bad.
> 
> My proposed application is for a small community radio station music library.
> We currently have about 5TB of data in a RAID10 using four 3TB drives, with ext4 over the RAID.  So we’re about 75% full, growing at the rate of about 1TB/year, so we’ll run out of space by the end of 2018.
> 
> I’m proposing to go to three 6TB drives in a btrfs/RAID5 configuration.  This would give us 12TB of usable data space and hold off til the end of 2024 before needing the next upgrade.
> 
> Will it work?  Would I be safer with ext4 over RAID5?
> 
> Thanks in advance!
> Rick
> 


-- 
lg
Jan Vales
--
I only read plaintext emails.

Someone @ irc://irc.fsinf.at:6667/tuwien
webIRC: https://frost.fsinf.at/iris/

Back to linux.debian.user | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread


Thread

Experiences with BTRFS -- is it mature enough for enterprise use? Rick Thomas <rbthomas@pobox.com> - 2017-12-26 20:50 +0100
  Re: Experiences with BTRFS -- is it mature enough for enterprise use? Eero Volotinen <eero.volotinen@iki.fi> - 2017-12-26 20:50 +0100
    Re: Experiences with BTRFS -- is it mature enough for enterprise use? Roberto C. Sánchez <roberto@debian.org> - 2017-12-26 23:30 +0100
      Re: Experiences with BTRFS -- is it mature enough for enterprise use? Sven Hartge <sven@svenhartge.de> - 2017-12-27 00:00 +0100
      Re: Experiences with BTRFS -- is it mature enough for enterprise use? Michael Stone <mstone@debian.org> - 2017-12-27 00:40 +0100
  Re: Experiences with BTRFS -- is it mature enough for enterprise use? Jan Vales <jan@jvales.net> - 2017-12-26 21:30 +0100
  Re: Experiences with BTRFS -- is it mature enough for enterprise use? Andy Smith <andy@strugglers.net> - 2017-12-26 22:40 +0100
  Re: Experiences with BTRFS -- is it mature enough for enterprise use? David Christensen <dpchrist@holgerdanske.com> - 2017-12-27 04:10 +0100
    Re: Experiences with BTRFS -- is it mature enough for enterprise use? Matthew Crews <mailinglists@mattcrews.com> - 2017-12-27 13:00 +0100
      Re: Experiences with BTRFS -- is it mature enough for enterprise use? Tom Dial <tddial@comcast.net> - 2017-12-27 23:10 +0100
        Re: Experiences with BTRFS -- is it mature enough for enterprise use? Rick Thomas <rick.thomas@pobox.com> - 2017-12-28 02:10 +0100
          Re: Experiences with BTRFS -- is it mature enough for enterprise use? deloptes <deloptes@gmail.com> - 2017-12-28 02:20 +0100
            Re: Experiences with BTRFS -- is it mature enough for enterprise use? Eero Volotinen <eero.volotinen@iki.fi> - 2017-12-28 07:10 +0100
              Re: Experiences with BTRFS -- is it mature enough for enterprise use? Dan Ritter <dsr@randomstring.org> - 2017-12-28 17:00 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Eero Volotinen <eero.volotinen@iki.fi> - 2017-12-28 18:30 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Glenn English <ghe2001@gmail.com> - 2017-12-28 20:40 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Matthew Crews <mailinglists@mattcrews.com> - 2017-12-28 20:50 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Andy Smith <andy@strugglers.net> - 2017-12-29 01:00 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Jan Vales <jan@jvales.net> - 2017-12-30 00:50 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Matthew Crews <mailinglists@mattcrews.com> - 2017-12-30 01:30 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Jan Vales <jan@jvales.net> - 2017-12-30 01:40 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Matthew Crews <mailinglists@mattcrews.com> - 2017-12-30 23:40 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? David Christensen <dpchrist@holgerdanske.com> - 2017-12-31 07:20 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Sven Hartge <sven@svenhartge.de> - 2017-12-31 18:50 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? David Christensen <dpchrist@holgerdanske.com> - 2017-12-31 23:10 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Sven Hartge <sven@svenhartge.de> - 2017-12-31 23:50 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? David Christensen <dpchrist@holgerdanske.com> - 2018-01-02 03:10 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? <tomas@tuxteam.de> - 2018-01-02 11:30 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? David Christensen <dpchrist@holgerdanske.com> - 2018-01-02 17:40 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? deloptes <deloptes@gmail.com> - 2018-01-02 19:10 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Pascal Hambourg <pascal@plouf.fr.eu.org> - 2018-01-02 20:10 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? deloptes <deloptes@gmail.com> - 2018-01-03 01:00 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Pascal Hambourg <pascal@plouf.fr.eu.org> - 2018-01-04 00:00 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? deloptes <deloptes@gmail.com> - 2018-01-04 09:00 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Pascal Hambourg <pascal@plouf.fr.eu.org> - 2018-01-04 20:20 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? deloptes <deloptes@gmail.com> - 2018-01-04 22:00 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? deloptes <deloptes@gmail.com> - 2018-01-04 12:00 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? David Christensen <dpchrist@holgerdanske.com> - 2018-01-03 00:10 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Darac Marjal <mailinglist@darac.org.uk> - 2018-01-03 00:50 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Gene Heskett <gheskett@shentel.net> - 2018-01-03 02:10 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Richard Hector <richard@walnut.gen.nz> - 2018-01-06 13:30 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? David Christensen <dpchrist@holgerdanske.com> - 2018-01-03 08:40 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Joel Wirāmu Pauling <joel@aenertia.net> - 2017-12-31 23:20 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Andy Smith <andy@strugglers.net> - 2018-01-03 04:40 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Pascal Hambourg <pascal@plouf.fr.eu.org> - 2017-12-30 10:30 +0100
                Re: Experiences with BTRFS -- is it mature enough for enterprise use? Dan Ritter <dsr@randomstring.org> - 2017-12-28 21:10 +0100
              Re: Experiences with BTRFS -- is it mature enough for enterprise use? deloptes <deloptes@gmail.com> - 2017-12-28 18:00 +0100
  Re: Experiences with BTRFS -- is it mature enough for enterprise use? Igor Cicimov <icicimov@gmail.com> - 2017-12-29 05:00 +0100

csiph-web