Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.os.linux.misc > #27899

Re: Question re alt.comp.os.linux

From "Carlos E.R." <robin_listas@es.invalid>
Newsgroups comp.os.linux.misc, alt.os.linux
Subject Re: Question re alt.comp.os.linux
Date 2019-08-22 00:53 +0200
Message-ID <dku03g-2l2.ln1@Telcontar.valinor> (permalink)
References <ko8e2g-8h1.ln1@Telcontar.valinor> <qjf989$53a$1@dont-email.me> <3q3u2g-59c.ln1@Telcontar.valinor> <qjjstk$e6$1@dont-email.me> <eli$1908211453@qaz.wtf>

Cross-posted to 2 groups.

Show all headers | View raw

On 21/08/2019 20.53, Eli the Bearded wrote:
> In comp.os.linux.misc, The Natural Philosopher  <tnp@invalid.invalid> wrote:
>> On 20/08/2019 22:03, Carlos E.R. wrote:
>>> Once I tested several filesystems types by creating a million small
>>> files in a single directory. Only two passed: reiserfs brilliantly, and
>>> xfs (I think this got full at 800000 or so). btrfs crashed itself and
>>> crashed the machine, and before that it got veeeery slow.
> 
> Seems to me ext4 works decently at that, as well as the Netapp native
> one. I've had real world programs that have tested filesystems like
> this.

Ext3/4 has a limited number of inodes, so a limited number of files.

> One of them I had to switch from ext3 to xfs because while ext3 could
> handle the filecount, it couldn't handle the subdirectory count.  (This
> was a Perforce server, about 2012. Perforce uses subdirectories for what
> it calls "views"; in git terms perhaps a "checkout" corresponds. Some of
> my users used a lot of views during code automation work.)
> 
> Another one was an opensource program to create mosaics from a
> collection of images. It created thumbnails of all the source images,
> the thumbnails would then be stitched together to crete the mosaic. But
> it put all of the thumbnails in one directory. As I noticed *after* I
> ran some 300k images through it.

Those are the things on which reiserfs worked brilliantly. Pity that its
main developer committed a crime and development stalled. XFS works
quite well because it doesn't have a fixed number of inodes, as the EXT
family, so it is the practical alternative. Btrfs... I don't know.

> 
>> I'll remember that if I ever want to do something as staggeringingly 
>> unhelpful as that
> 
> Real world involves dealing with programs at scales the original
> designers perhaps had not considered.
> 
>> MySQL was designed for that..
> 
> Mysql is a piece of crap, and I'd trust a filesystem to return better
> errors when things fail.

Quite...

And of course, you can easily access a filesystem from a script.

-- 
Cheers, Carlos.

Back to comp.os.linux.misc | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread

Thread

Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-14 22:49 +0200
  Re: Question re alt.comp.os.linux Andreas Kohlbach <ank@spamfence.net> - 2019-08-14 17:30 -0400
    Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-15 00:17 +0200
      Re: Question re alt.comp.os.linux Andreas Kohlbach <ank@spamfence.net> - 2019-08-14 18:30 -0400
        Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-15 12:49 +0200
          Re: Question re alt.comp.os.linux wimpunk <wimpunk+news@gmail.com> - 2019-08-19 16:21 +0200
            Re: Question re alt.comp.os.linux The Natural Philosopher <tnp@invalid.invalid> - 2019-08-19 16:27 +0100
              Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-19 23:10 +0200
                Re: Question re alt.comp.os.linux dillinger <dillinger@invalid.not> - 2019-08-19 23:50 +0200
                Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-20 22:58 +0200
                Re: Question re alt.comp.os.linux dillinger <dillinger@invalid.not> - 2019-08-21 16:37 +0200
                Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-22 00:57 +0200
                Re: Question re alt.comp.os.linux dillinger <dillinger@invalid.not> - 2019-08-22 07:37 +0200
                Re: Question re alt.comp.os.linux Grant Taylor <gtaylor@tnetconsulting.net> - 2019-08-21 21:37 -0600
                Re: Question re alt.comp.os.linux dillinger <dillinger@invalid.not> - 2019-08-22 07:35 +0200
                Re: Question re alt.comp.os.linux Mike Easter <MikeE@ster.invalid> - 2019-08-19 15:26 -0700
                Re: Question re alt.comp.os.linux Paul <nospam@needed.invalid> - 2019-08-19 18:52 -0400
                Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-20 23:03 +0200
                Re: Question re alt.comp.os.linux Paul <nospam@needed.invalid> - 2019-08-20 17:55 -0400
                Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-21 11:32 +0200
                Re: Question re alt.comp.os.linux Paul <nospam@needed.invalid> - 2019-08-21 07:13 -0400
                Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-22 00:44 +0200
                Re: Question re alt.comp.os.linux Paul <nospam@needed.invalid> - 2019-08-21 07:42 -0400
                Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-22 00:28 +0200
                Re: Question re alt.comp.os.linux William Unruh <unruh@invalid.ca> - 2019-08-21 15:43 +0000
                Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-22 00:30 +0200
                Re: Question re alt.comp.os.linux The Natural Philosopher <tnp@invalid.invalid> - 2019-08-21 17:53 +0100
                Re: Question re alt.comp.os.linux Eli the Bearded <*@eli.users.panix.com> - 2019-08-21 18:53 +0000
                Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-22 00:53 +0200
                Re: Question re alt.comp.os.linux Eli the Bearded <*@eli.users.panix.com> - 2019-08-22 02:33 +0000
                Re: Question re alt.comp.os.linux Wildman <best_lay@yahoo.com> - 2019-08-21 22:24 -0500
                Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-24 09:42 +0200
                Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-22 00:48 +0200
                Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-20 22:58 +0200
  Re: Question re alt.comp.os.linux "David W. Hodgins" <dwhodgins@nomail.afraid.org> - 2019-08-14 17:56 -0400
  Re: Question re alt.comp.os.linux Mike Easter <MikeE@ster.invalid> - 2019-08-14 15:23 -0700
    Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-15 12:52 +0200
      Re: Question re alt.comp.os.linux Mike Easter <MikeE@ster.invalid> - 2019-08-15 07:14 -0700
      Re: Question re alt.comp.os.linux dillinger <dillinger@invalid.not> - 2019-08-15 17:33 +0200
        Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-15 17:57 +0200
          Re: Question re alt.comp.os.linux jrg <jeff.g.group@att.net> - 2019-08-15 10:24 -0700
            Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-15 19:40 +0200
              Re: Question re alt.comp.os.linux John-Paul Stewart <jpstewart@sympatico.ca> - 2019-08-15 15:09 -0400
                Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-15 21:33 +0200
                Re: Question re alt.comp.os.linux John-Paul Stewart <jpstewart@sympatico.ca> - 2019-08-15 16:03 -0400
                Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-15 22:17 +0200
            Re: Question re alt.comp.os.linux Grant Taylor <gtaylor@tnetconsulting.net> - 2019-08-15 12:53 -0600
              Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-15 21:33 +0200
          Re: Question re alt.comp.os.linux Andreas Kohlbach <ank@spamfence.net> - 2019-08-15 15:42 -0400
  Re: Question re alt.comp.os.linux Grant Taylor <gtaylor@tnetconsulting.net> - 2019-08-14 19:33 -0600
  Re: Question re alt.comp.os.linux Paul <nospam@needed.invalid> - 2019-08-14 23:52 -0400
  Re: Question re alt.comp.os.linux Chris Elvidge <chris@mshome.net> - 2019-08-15 11:35 +0200
  Re: Question re alt.comp.os.linux Peter 'Shaggy' Haywood <phaywood@alphalink.com.au> - 2019-08-31 02:15 +1000
    Re: Question re alt.comp.os.linux "David W. Hodgins" <dwhodgins@nomail.afraid.org> - 2019-08-30 20:24 -0400
    Re: Question re alt.comp.os.linux William Unruh <unruh@invalid.ca> - 2019-08-31 03:54 +0000
      Re: Question re alt.comp.os.linux "David W. Hodgins" <dwhodgins@nomail.afraid.org> - 2019-08-31 00:03 -0400
        Re: Question re alt.comp.os.linux Peter 'Shaggy' Haywood <phaywood@alphalink.com.au> - 2019-09-02 13:37 +1000
          Re: Question re alt.comp.os.linux "David W. Hodgins" <dwhodgins@nomail.afraid.org> - 2019-09-02 19:54 -0400
            Re: Question re alt.comp.os.linux Peter 'Shaggy' Haywood <phaywood@alphalink.com.au> - 2019-09-04 19:37 +1000
      Re: Question re alt.comp.os.linux Peter 'Shaggy' Haywood <phaywood@alphalink.com.au> - 2019-09-02 13:34 +1000

csiph-web