Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > gnu.bash.bug > #16445 > unrolled thread

Re: [PATCH 5.1] zread: read files in 4k chunks

Back to article view | Back to gnu.bash.bug

This discussion starts older than the indexed window; earlier articles aren't shown. The article labeled Started by below is the oldest one visible, not the original post.

Contents

  Re: [PATCH 5.1] zread: read files in 4k chunks L A Walsh <bash@tlinx.org> - 2020-06-23 12:29 -0700

#16445 — Re: [PATCH 5.1] zread: read files in 4k chunks

The 'stat(2)' system call returns an optimal i/o size for files since some
files in addition to being on disks with a 4k sector size (making 128bytes
a slow choice for reads, and a real slow choice for writes), also can be on
a RAID with it's own optimal i/o size.

I think the 'stat(1)' prog shows the same value with "%o": "stat -c%o" .
65536


On Mon, Jun 22, 2020 at 1:19 PM Jason A. Donenfeld <Jason@zx2c4.com> wrote:

> On Mon, Jun 22, 2020 at 2:16 PM Ilkka Virta <itvirta@iki.fi> wrote:
> >
> > On 22.6. 19.35, Chet Ramey wrote:
> > > On 6/22/20 1:53 AM, Jason A. Donenfeld wrote:
> > >> Currently a static sized buffer is used for reading files. At the
> moment
> > >> it is extremely small, making parsing of large files extremely slow.
> > >> Increase this to 4k for improved performance.
> > >
> > > I bumped it up to 1024 initially for testing.
> >
> > It always struck me as odd that Bash used such a small read of 128
> > bytes. Most of the GNU utils I've looked at on Debian use 8192, and a
> > simple test program seems to indicate glibc's stdio reads 4096 bytes at
> > one read() call.
>
> Plus most other shells people use...
>
>

[toc] | [standalone]

Back to top | Article view | gnu.bash.bug

csiph-web