Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]
Groups > comp.os.linux.misc > #27894
| From | Eli the Bearded <*@eli.users.panix.com> |
|---|---|
| Newsgroups | comp.os.linux.misc, alt.os.linux |
| Subject | Re: Question re alt.comp.os.linux |
| Date | 2019-08-21 18:53 +0000 |
| Organization | Some absurd concept |
| Message-ID | <eli$1908211453@qaz.wtf> (permalink) |
| References | <ko8e2g-8h1.ln1@Telcontar.valinor> <qjf989$53a$1@dont-email.me> <3q3u2g-59c.ln1@Telcontar.valinor> <qjjstk$e6$1@dont-email.me> |
Cross-posted to 2 groups.
In comp.os.linux.misc, The Natural Philosopher <tnp@invalid.invalid> wrote: > On 20/08/2019 22:03, Carlos E.R. wrote: >> Once I tested several filesystems types by creating a million small >> files in a single directory. Only two passed: reiserfs brilliantly, and >> xfs (I think this got full at 800000 or so). btrfs crashed itself and >> crashed the machine, and before that it got veeeery slow. Seems to me ext4 works decently at that, as well as the Netapp native one. I've had real world programs that have tested filesystems like this. One of them I had to switch from ext3 to xfs because while ext3 could handle the filecount, it couldn't handle the subdirectory count. (This was a Perforce server, about 2012. Perforce uses subdirectories for what it calls "views"; in git terms perhaps a "checkout" corresponds. Some of my users used a lot of views during code automation work.) Another one was an opensource program to create mosaics from a collection of images. It created thumbnails of all the source images, the thumbnails would then be stitched together to crete the mosaic. But it put all of the thumbnails in one directory. As I noticed *after* I ran some 300k images through it. > I'll remember that if I ever want to do something as staggeringingly > unhelpful as that Real world involves dealing with programs at scales the original designers perhaps had not considered. > MySQL was designed for that.. Mysql is a piece of crap, and I'd trust a filesystem to return better errors when things fail. Elijah ------ had access to a huge set of media images at the time
Back to comp.os.linux.misc | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread
Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-14 22:49 +0200
Re: Question re alt.comp.os.linux Andreas Kohlbach <ank@spamfence.net> - 2019-08-14 17:30 -0400
Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-15 00:17 +0200
Re: Question re alt.comp.os.linux Andreas Kohlbach <ank@spamfence.net> - 2019-08-14 18:30 -0400
Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-15 12:49 +0200
Re: Question re alt.comp.os.linux wimpunk <wimpunk+news@gmail.com> - 2019-08-19 16:21 +0200
Re: Question re alt.comp.os.linux The Natural Philosopher <tnp@invalid.invalid> - 2019-08-19 16:27 +0100
Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-19 23:10 +0200
Re: Question re alt.comp.os.linux dillinger <dillinger@invalid.not> - 2019-08-19 23:50 +0200
Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-20 22:58 +0200
Re: Question re alt.comp.os.linux dillinger <dillinger@invalid.not> - 2019-08-21 16:37 +0200
Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-22 00:57 +0200
Re: Question re alt.comp.os.linux dillinger <dillinger@invalid.not> - 2019-08-22 07:37 +0200
Re: Question re alt.comp.os.linux Grant Taylor <gtaylor@tnetconsulting.net> - 2019-08-21 21:37 -0600
Re: Question re alt.comp.os.linux dillinger <dillinger@invalid.not> - 2019-08-22 07:35 +0200
Re: Question re alt.comp.os.linux Mike Easter <MikeE@ster.invalid> - 2019-08-19 15:26 -0700
Re: Question re alt.comp.os.linux Paul <nospam@needed.invalid> - 2019-08-19 18:52 -0400
Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-20 23:03 +0200
Re: Question re alt.comp.os.linux Paul <nospam@needed.invalid> - 2019-08-20 17:55 -0400
Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-21 11:32 +0200
Re: Question re alt.comp.os.linux Paul <nospam@needed.invalid> - 2019-08-21 07:13 -0400
Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-22 00:44 +0200
Re: Question re alt.comp.os.linux Paul <nospam@needed.invalid> - 2019-08-21 07:42 -0400
Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-22 00:28 +0200
Re: Question re alt.comp.os.linux William Unruh <unruh@invalid.ca> - 2019-08-21 15:43 +0000
Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-22 00:30 +0200
Re: Question re alt.comp.os.linux The Natural Philosopher <tnp@invalid.invalid> - 2019-08-21 17:53 +0100
Re: Question re alt.comp.os.linux Eli the Bearded <*@eli.users.panix.com> - 2019-08-21 18:53 +0000
Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-22 00:53 +0200
Re: Question re alt.comp.os.linux Eli the Bearded <*@eli.users.panix.com> - 2019-08-22 02:33 +0000
Re: Question re alt.comp.os.linux Wildman <best_lay@yahoo.com> - 2019-08-21 22:24 -0500
Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-24 09:42 +0200
Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-22 00:48 +0200
Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-20 22:58 +0200
Re: Question re alt.comp.os.linux "David W. Hodgins" <dwhodgins@nomail.afraid.org> - 2019-08-14 17:56 -0400
Re: Question re alt.comp.os.linux Mike Easter <MikeE@ster.invalid> - 2019-08-14 15:23 -0700
Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-15 12:52 +0200
Re: Question re alt.comp.os.linux Mike Easter <MikeE@ster.invalid> - 2019-08-15 07:14 -0700
Re: Question re alt.comp.os.linux dillinger <dillinger@invalid.not> - 2019-08-15 17:33 +0200
Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-15 17:57 +0200
Re: Question re alt.comp.os.linux jrg <jeff.g.group@att.net> - 2019-08-15 10:24 -0700
Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-15 19:40 +0200
Re: Question re alt.comp.os.linux John-Paul Stewart <jpstewart@sympatico.ca> - 2019-08-15 15:09 -0400
Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-15 21:33 +0200
Re: Question re alt.comp.os.linux John-Paul Stewart <jpstewart@sympatico.ca> - 2019-08-15 16:03 -0400
Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-15 22:17 +0200
Re: Question re alt.comp.os.linux Grant Taylor <gtaylor@tnetconsulting.net> - 2019-08-15 12:53 -0600
Re: Question re alt.comp.os.linux "Carlos E.R." <robin_listas@es.invalid> - 2019-08-15 21:33 +0200
Re: Question re alt.comp.os.linux Andreas Kohlbach <ank@spamfence.net> - 2019-08-15 15:42 -0400
Re: Question re alt.comp.os.linux Grant Taylor <gtaylor@tnetconsulting.net> - 2019-08-14 19:33 -0600
Re: Question re alt.comp.os.linux Paul <nospam@needed.invalid> - 2019-08-14 23:52 -0400
Re: Question re alt.comp.os.linux Chris Elvidge <chris@mshome.net> - 2019-08-15 11:35 +0200
Re: Question re alt.comp.os.linux Peter 'Shaggy' Haywood <phaywood@alphalink.com.au> - 2019-08-31 02:15 +1000
Re: Question re alt.comp.os.linux "David W. Hodgins" <dwhodgins@nomail.afraid.org> - 2019-08-30 20:24 -0400
Re: Question re alt.comp.os.linux William Unruh <unruh@invalid.ca> - 2019-08-31 03:54 +0000
Re: Question re alt.comp.os.linux "David W. Hodgins" <dwhodgins@nomail.afraid.org> - 2019-08-31 00:03 -0400
Re: Question re alt.comp.os.linux Peter 'Shaggy' Haywood <phaywood@alphalink.com.au> - 2019-09-02 13:37 +1000
Re: Question re alt.comp.os.linux "David W. Hodgins" <dwhodgins@nomail.afraid.org> - 2019-09-02 19:54 -0400
Re: Question re alt.comp.os.linux Peter 'Shaggy' Haywood <phaywood@alphalink.com.au> - 2019-09-04 19:37 +1000
Re: Question re alt.comp.os.linux Peter 'Shaggy' Haywood <phaywood@alphalink.com.au> - 2019-09-02 13:34 +1000
csiph-web