Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > linux.debian.user > #243584

Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD

From Jorge P. de Morais Neto <jorge+list@disroot.org>
Newsgroups linux.debian.user
Subject Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD
Date 2022-01-02 17:40 +0100
Message-ID <DBc3M-5qD-19@gated-at.bofh.it> (permalink)
References <Ds67g-4Z6-7@gated-at.bofh.it> <Ds6Ai-58M-3@gated-at.bofh.it> <DsaXf-7O5-1@gated-at.bofh.it> <Dse4P-1bb-9@gated-at.bofh.it>
Organization linux.* mail to news gateway

Show all headers | View raw


Hi Piotr!  Happy 2022!

Em [2021-12-08 qua 22:54:29+0000], piorunz escreveu:

> On 08/12/2021 19:35, Jorge P. de Morais Neto wrote:

>> - Why `compress-force' instead of simply `compress'?
>
> I've read very extensive discussion about that and came to conclusion
> that compress-force is better.  It's checking every chunk of file for
> compressibility.  "compress", on the other hand, checks only first
> sectors, then drops compression if no compressible data is detected.
> Imagine your qcow file, first 1 GB is not compressible, so "compress"
> option will drop compression of that file right away.  But remaining 20GB
> are zeros because you haven't filled that yet.  With compress-force, you
> compress these zeros to nothing.  File takes 1GB of space.  You don't have
> that on ext4, or btrfs "compress" only option.

Have you revised after kernel Linux 4.15?  The btrfs(5) manpage says:

           Since kernel 4.15, a set of heuristic algorithms have been
           improved by using frequency sampling, repeated pattern
           detection and Shannon entropy calculation to avoid that.

Therefore, it looks like after kernel Linux 4.15 the compress option (or
compress=ALG:LEVEL), instead of compress-force, became more interesting.

I am currently using compress-force=zstd:12 for the SSD and
compress=zstd:12 for both HDD (internal SATA and external USB3)¹.
Despite the strong compression level, performance is pretty good.  Yet,
when the system settles, I intend to reduce compression level to 9 or 6
(as you earlier recommended).  This should make performance even better,
while saving a lot of space because most data was compressed at
level 12.

And I may also change compress-force to compress, even for the SSD,
because I run kernel 5.10 which is later than 4.15.  I may ask the
linux-btrfs mailing list first.  I have subscribed to it.  Are you there
too?

Regards

* Footnotes

¹ Both HDD have compress (rather than compress-force) because most of
their files are already compressed---pictures, videos, music, compressed
archives etc.

-- 
- Many people hate injustice but few check the facts; this causes more
  injustice.  Ask me about <https://stallmansupport.org>
- I am Brazilian.  I hope my English is correct and I welcome feedback.
- https://www.defectivebydesign.org
- https://www.gnu.org

Back to linux.debian.user | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread


Thread

Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD "Jorge P. de Morais Neto" <jorge+list@disroot.org> - 2021-12-08 15:30 +0100
  Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD piorunz <piorunz@gmx.com> - 2021-12-08 16:00 +0100
    Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD Jorge P. de Morais Neto <jorge+list@disroot.org> - 2021-12-08 20:40 +0100
      Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD piorunz <piorunz@gmx.com> - 2021-12-09 00:00 +0100
        Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD Jorge P. de Morais Neto <jorge+list@disroot.org> - 2022-01-02 17:40 +0100
          Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD piorunz <piorunz@gmx.com> - 2022-01-03 00:40 +0100
            Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD Jorge P. de Morais Neto <jorge+list@disroot.org> - 2022-01-03 12:50 +0100
              Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD Michael Stone <mstone@debian.org> - 2022-01-03 16:20 +0100
                Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD Dan Ritter <dsr@randomstring.org> - 2022-01-03 17:00 +0100
                Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD Michael Stone <mstone@debian.org> - 2022-01-03 19:30 +0100
                Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD Jorge P. de Morais Neto <jorge+list@disroot.org> - 2022-01-04 01:00 +0100
                Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD Michael Stone <mstone@debian.org> - 2022-01-04 19:20 +0100
      Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD piorunz <piorunz@gmx.com> - 2021-12-09 14:30 +0100
  Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD "Alexander V. Makartsev" <avbetev@gmail.com> - 2021-12-09 01:20 +0100
    Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD Andy Smith <andy@strugglers.net> - 2021-12-09 02:10 +0100
      Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD Jorge P. de Morais Neto <jorge+list@disroot.org> - 2021-12-15 15:50 +0100
        Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD Andy Smith <andy@strugglers.net> - 2021-12-16 04:30 +0100
    Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD piorunz <piorunz@gmx.com> - 2021-12-09 11:30 +0100
      Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD "Alexander V. Makartsev" <avbetev@gmail.com> - 2021-12-09 16:30 +0100
        Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD piorunz <piorunz@gmx.com> - 2021-12-09 17:20 +0100
          Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD piorunz <piorunz@gmx.com> - 2021-12-09 18:30 +0100
    Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD Jorge P. de Morais Neto <jorge+list@disroot.org> - 2021-12-15 15:40 +0100
  Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD David Christensen <dpchrist@holgerdanske.com> - 2021-12-09 07:10 +0100
    Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD Jorge P. de Morais Neto <jorge+list@disroot.org> - 2021-12-14 18:50 +0100
      Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD David Christensen <dpchrist@holgerdanske.com> - 2021-12-15 03:50 +0100
        Re: Why MBR partitioning (was: Reasonably simple setup for 1...) Felix Miata <mrmazda@earthlink.net> - 2021-12-15 04:00 +0100
          Re: Why MBR partitioning (was: Reasonably simple setup for 1...) David Christensen <dpchrist@holgerdanske.com> - 2021-12-15 05:20 +0100
          Re: Why MBR partitioning (was: Reasonably simple setup for 1...) "Thomas Schmitt" <scdbackup@gmx.net> - 2021-12-15 09:10 +0100
  Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD Anssi Saari <as@sci.fi> - 2021-12-09 10:40 +0100
    Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD Dan Ritter <dsr@randomstring.org> - 2021-12-09 13:10 +0100
    Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD Jorge P. de Morais Neto <jorge+list@disroot.org> - 2021-12-14 18:40 +0100
      Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD Andrei POPESCU <andreimpopescu@gmail.com> - 2021-12-15 21:30 +0100
  Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD "hdv@gmail" <hdv.jadev@gmail.com> - 2021-12-09 15:10 +0100
    Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD Dan Ritter <dsr@randomstring.org> - 2021-12-09 16:10 +0100
      Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD "hdv@gmail" <hdv.jadev@gmail.com> - 2021-12-09 16:50 +0100
        Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD Curt <curty@free.fr> - 2021-12-09 18:30 +0100
          Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD David Wright <deblis@lionunicorn.co.uk> - 2021-12-10 06:00 +0100
            Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD Darac Marjal <mailinglist@darac.org.uk> - 2021-12-10 10:30 +0100
      Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD Stefan Monnier <monnier@iro.umontreal.ca> - 2021-12-10 05:10 +0100
      Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD Andrei POPESCU <andreimpopescu@gmail.com> - 2021-12-10 10:40 +0100
        Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD Dan Ritter <dsr@randomstring.org> - 2021-12-10 13:40 +0100
          Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD Andrei POPESCU <andreimpopescu@gmail.com> - 2021-12-10 14:00 +0100
            Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD Dan Ritter <dsr@randomstring.org> - 2021-12-10 15:10 +0100
              Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD Charles Curley <charlescurley@charlescurley.com> - 2021-12-11 02:10 +0100
                Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD "Andrew M.A. Cater" <amacater@einval.com> - 2021-12-11 12:30 +0100
          Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD Darac Marjal <mailinglist@darac.org.uk> - 2021-12-10 14:20 +0100
    Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD Jorge P. de Morais Neto <jorge+list@disroot.org> - 2021-12-15 16:00 +0100
      Re: Reasonably simple setup for 1TB HDD and 250GB M.2 NVMe SSD "hdv@gmail" <hdv.jadev@gmail.com> - 2021-12-15 16:30 +0100

csiph-web