Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > linux.debian.user > #230252

Re: mdadm usage

Show all headers | View raw

[Multipart message — attachments visible in raw view] - view raw

deloptes writes:

> Andrei POPESCU wrote:
>
> >> Each LSI card has a 6 bay cage attached and I have raided 6x2TB WD RED
> >> spinning discs (for data) and 2x1TB WD RED spinning discs (for OS)
> >
> > 1TB for OS (assuming RAID1) seems... excessive to me. All my current
> > installations are in 10 GiB partitions with only a separate /home.
> >
> > Even if I'd go "wild" with several desktops installed (I'm only using
> > LXDE), LibreOffice, etc. I'd probably get away with 50 GiB or so. Check
> > the output of:
> >
> > du -hx --max-depth=1 /
> >
> This is true. the root partition is not big - the rest of the space I'll use
> for data, but I do not want to use smaller disk, because I will loose two
> bays and have the power consumption anyway. I think 1TB is good compromise.
> I leave some disk space as spare for LVM and LVM snapshot. I put there the
> OS and for example the NFS root/boot stuff or some QEMU machines.

Sounds OK to me :) From my point of view, I would work towards reducing the  
total number of disks, given that spinning disks of 8 TB capacity and SSDs  
of 4 TB capacity are readily available today. YMMV

> >> I somehow can not convince myself that I need to replace any of these
> >> with SSDs.
> >> I don't want the cheapest but also not unnecessary expensive drives, I
> >> just find it hard to evaluate which drives are reliable.
> >
> > The reliability matters much less with RAID1. By the way, the "I" in
> > RAID stands for "inexpensive" ;)

[...]

> I am too old for blind experimenting. This is why I'm asking if someone has
> experience with SSD in RAID with consumer grade disks. The once I see are
> installed in servers are not available on the consumer market.

If I understood it corretly, you initially asked about NAS-grade-SSDs. I  
believe that is quite "special" a purpose, because I tend to hink of NAS as  
slow but large storage spaces where SSDs are indeed rare.

I have had good experience with the following two "consumer-grade" SSDs in  
an mdadm RAID 1 (taking the I for inexpensive literally :) ). Both have  
about 8000 hours of operation according to SMART and when in use they ran  
about 12h/day (i.e. normally not 24/7):

 * Samsung 850 EVO 2TB
 * Crucial MX300 2TB

At the time, these were the cheapest SSDs I could get with 2TB. Despite  
their performance being "medicore" (for SSDs, that is), there were no  
problems with RAID operation whatsoever.

For my new system, I got two Intel DC P4510. These were actually available  
to me as a "consumer" despite them being (old) "datacenter" SSDs. They run  
much faster, but most of the time one does not notice the difference. My  
typical workload that benefits from the "faster" SSDs is installing packages  
and updates in multiple VMs and containers (e.g. 4--6 VMs and two  
containers) at once. Apart from the potential difficulties in getting to  
purchase such SSDs, they are also more difficult to put into systems due to  
different connectors: Server SSDs use either SAS or (in case of the DC  
P4510): U.2.

> >> I saw there are 1TB WD RED SSDs targeting NAS for about €120,-
> >> WESTERN DIGITAL WD RED SA500 NAS 1TB SATA (WDS100T1R0A)
> >
> > The speed gain of SSD vs. spinning discs for the OS is hard to describe.
> > Think jet aircraft vs. car.

[...]

> Yes, but as mentioned the LSI I use in the server are SATA2 so it will stick
> to bandwidth throughput of 300MB/s - does it make sense to replace the good
> WD RED spinning disks with SSD?
> I already heard one good argument.

How much do you rely on random access to the actual data? As others have  
already posted, putting an OS onto the SSD is an exceptional performance  
gain for all OS-startup related tasks including "running program x for the  
first time" or OS upgrades (apt-get operations in general). If, however, you  
are considering to use the SSD mostly for "data", it highly depends on what  
type of data you have:

 * If it is os-style data like VMs, containers, compiler toolchains, chroots
   etc. then there will be a significant performance improvement, because
   these all benefit from reduced latency of access.

 * If it is media like music, pictures etc. served over a typical network
   protocl, the performance of HDDs may be entirely sufficient. Some
   media-related tasks like "downscale 10000 images from 700x700 to 500x500"
   may also benefit from the SSD if files are small enough that the access
   time becomes relevant.

 * Additionally, if you have a small set of data that you are accessing all
   of the time and the OS manages to cache this into RAM, you will only
   benefit from the SSD performance upon first access. On systems that run
   24/7, the benefit of SSDs is gerater in database-style continouously
   random-access-intensive applications rather than typical file access
   patterns.

As others have noted, the performance gain of SSDs is largely independent of  
connector. You can get an improvement even on old connectors and to some  
extent also on old systems. Unless you are thinking of using IDE SSDs  
(special-purpose devices which are mostly _not_ used for performance),  
everything should be fine in that regard :)

HTH
Linux-Fan

Back to linux.debian.user | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread

Thread

mdadm usage "Thomas A. Anderson" <thomas.anderson@little-beak.com> - 2020-12-29 08:10 +0100
  Re: mdadm usage Reco <recoverym4n@enotuniq.net> - 2020-12-29 08:30 +0100
    Re: mdadm usage deloptes <deloptes@gmail.com> - 2020-12-29 09:40 +0100
  Re: mdadm usage Felix Miata <mrmazda@earthlink.net> - 2020-12-29 08:50 +0100
    Re: mdadm usage basti <mailinglist@unix-solution.de> - 2020-12-29 09:40 +0100
      Re: mdadm usage "Thomas A. Anderson" <thomas.anderson@little-beak.com> - 2020-12-29 21:40 +0100
        Re: mdadm usage Linux-Fan <Ma_Sys.ma@web.de> - 2020-12-30 00:00 +0100
        Re: mdadm usage deloptes <deloptes@gmail.com> - 2020-12-30 02:00 +0100
          Re: mdadm usage Michael Stone <mstone@debian.org> - 2020-12-30 02:30 +0100
            Re: mdadm usage deloptes <deloptes@gmail.com> - 2020-12-30 09:20 +0100
            Re: mdadm usage Jesper Dybdal <jd-debian-user@dybdal.dk> - 2020-12-30 14:40 +0100
              Re: mdadm usage Andy Smith <andy@strugglers.net> - 2020-12-30 15:00 +0100
                Re: mdadm usage Jesper Dybdal <jd-debian-user@dybdal.dk> - 2021-01-02 14:40 +0100
              mdadm usage Nicholas Geovanis <nickgeovanis@gmail.com> - 2020-12-30 15:10 +0100
                Re: mdadm usage Nicholas Geovanis <nickgeovanis@gmail.com> - 2020-12-30 15:10 +0100
                Re: mdadm usage deloptes <deloptes@gmail.com> - 2020-12-30 21:50 +0100
                Re: mdadm usage Michael Stone <mstone@debian.org> - 2020-12-30 22:40 +0100
                Re: mdadm usage deloptes <deloptes@gmail.com> - 2020-12-30 23:20 +0100
                Re: mdadm usage Andy Smith <andy@strugglers.net> - 2020-12-31 00:30 +0100
                Re: mdadm usage rhkramer@gmail.com - 2020-12-31 13:30 +0100
                Re: mdadm usage Michael Stone <mstone@debian.org> - 2020-12-31 15:20 +0100
                Re: mdadm usage Andy Smith <andy@strugglers.net> - 2020-12-31 15:30 +0100
                Re: mdadm usage Reco <recoverym4n@enotuniq.net> - 2020-12-31 15:50 +0100
                Re: mdadm usage Andy Smith <andy@strugglers.net> - 2020-12-31 16:10 +0100
                Re: mdadm usage Reco <recoverym4n@enotuniq.net> - 2020-12-31 16:20 +0100
                Re: mdadm usage Andy Smith <andy@strugglers.net> - 2020-12-31 16:40 +0100
                Re: mdadm usage deloptes <deloptes@gmail.com> - 2021-01-01 23:10 +0100
                Re: mdadm usage Andrei POPESCU <andreimpopescu@gmail.com> - 2021-01-02 09:40 +0100
                Re: mdadm usage deloptes <deloptes@gmail.com> - 2021-01-02 10:10 +0100
                Re: mdadm usage Andrei POPESCU <andreimpopescu@gmail.com> - 2021-01-02 11:30 +0100
                Re: mdadm usage Linux-Fan <Ma_Sys.ma@web.de> - 2021-01-02 14:50 +0100
                Re: mdadm usage deloptes <deloptes@gmail.com> - 2021-01-02 16:40 +0100
                Re: mdadm usage Linux-Fan <Ma_Sys.ma@web.de> - 2021-01-02 18:10 +0100
                Re: mdadm usage The Wanderer <wanderer@fastmail.fm> - 2021-01-02 10:40 +0100
                Re: mdadm usage Andrei POPESCU <andreimpopescu@gmail.com> - 2021-01-02 12:00 +0100
                Re: mdadm usage The Wanderer <wanderer@fastmail.fm> - 2021-01-02 12:30 +0100
                Re: mdadm usage Andrei POPESCU <andreimpopescu@gmail.com> - 2021-01-02 12:50 +0100
                Re: mdadm usage Andrei POPESCU <andreimpopescu@gmail.com> - 2021-01-02 13:10 +0100
                Re: mdadm usage The Wanderer <wanderer@fastmail.fm> - 2021-01-02 14:20 +0100
                Re: mdadm usage The Wanderer <wanderer@fastmail.fm> - 2021-01-02 14:10 +0100
                Re: mdadm usage deloptes <deloptes@gmail.com> - 2021-01-02 12:50 +0100
          Re: mdadm usage "Thomas A. Anderson" <thomas.anderson@little-beak.com> - 2020-12-30 11:50 +0100
            Re: mdadm usage "Alexander V. Makartsev" <avbetev@gmail.com> - 2020-12-30 13:30 +0100
            Re: mdadm usage Dan Ritter <dsr@randomstring.org> - 2020-12-30 13:30 +0100
            Re: mdadm usage Andy Smith <andy@strugglers.net> - 2020-12-30 15:00 +0100
            Re: mdadm usage deloptes <deloptes@gmail.com> - 2020-12-30 22:10 +0100
              Re: mdadm usage Nicholas Geovanis <nickgeovanis@gmail.com> - 2020-12-31 00:00 +0100
        Re: mdadm usage Andrei POPESCU <andreimpopescu@gmail.com> - 2020-12-30 09:10 +0100
      Re: mdadm usage Dan Ritter <dsr@randomstring.org> - 2020-12-30 04:00 +0100
  Re: mdadm usage Andy Smith <andy@strugglers.net> - 2020-12-29 14:20 +0100
    Re: mdadm usage mick crane <mick.crane@gmail.com> - 2020-12-29 16:40 +0100
      Re: mdadm usage "Alexander V. Makartsev" <avbetev@gmail.com> - 2020-12-29 20:40 +0100
      Re: mdadm usage Andy Smith <andy@strugglers.net> - 2020-12-30 14:40 +0100
        Re: mdadm usage The Wanderer <wanderer@fastmail.fm> - 2020-12-30 14:50 +0100
        Re: mdadm usage mick crane <mick.crane@gmail.com> - 2020-12-30 18:00 +0100
          Re: mdadm usage Andrei POPESCU <andreimpopescu@gmail.com> - 2020-12-30 19:40 +0100

csiph-web