Path: csiph.com!newsfeed.hal-mli.net!feeder3.hal-mli.net!newsfeed.hal-mli.net!feeder1.hal-mli.net!news.stack.nl!newsfeed.xs4all.nl!newsfeed1.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
Return-Path: <driscoll@cs.wisc.edu>
X-Original-To: python-list@python.org
Delivered-To: python-list@mail.python.org
X-Spam-Status: OK 0.003
X-Spam-Evidence: '*H*': 0.99; '*S*': 0.00; 'present,': 0.07; 'inclusion': 0.09; 'iterate': 0.09; 'subject:files': 0.09; 'sure)': 0.09; 'url:github': 0.09; 'cc:addr:python-list': 0.10; 'library': 0.15; 'file,': 0.15; '(also': 0.16; 'aiming': 0.16; 'benjamin': 0.16; 'cc:name:python list': 0.16; 'filename:fname piece:signature': 0.16; 'guessing': 0.16; 'instance)': 0.16; 'wrote:': 0.17; 'directory.': 0.17; 'discussion': 0.20; 'thanks.': 0.21; '(on': 0.22; "i'd": 0.22; "haven't": 0.23; 'cc:2**1': 0.24; 'linux': 0.24; 'cc:addr:python.org': 0.25; 'header:In-Reply-To:1': 0.25; 'header:User-Agent:1': 0.26; 'creating': 0.26; 'wrote': 0.26; 'am,': 0.27; 'cc:addr:gmail.com': 0.27; 'guess': 0.27; 'separate': 0.27; 'library.': 0.27; 'lines': 0.28; 'noticed': 0.28; 'record': 0.28; 'efficiently': 0.29; 'remotely': 0.29; 'probably': 0.29; "i'm": 0.29; 'switch': 0.32; 'could': 0.32; 'directory,': 0.33; 'anyone': 0.33; 'entry': 0.33; 'mine': 0.35; 'similar': 0.35; 'something': 0.35; 'there': 0.35; 'but': 0.36; 'wanted': 0.36; 'useful': 0.36; 'too': 0.36; 'far': 0.37; 'subject:: ': 0.38; 'files': 0.38; 'most': 0.61; 'information': 0.63; 'more': 0.63; 'subject': 0.66; 'sounds': 0.71; 'happier': 0.84; 'oscar': 0.84; 'python-dev': 0.84; 'subject:over': 0.84
Date: Mon, 17 Dec 2012 12:40:49 -0600
From: Evan Driscoll <driscoll@cs.wisc.edu>
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:10.0.11) Gecko/20121116 Thunderbird/10.0.11
MIME-Version: 1.0
To: Oscar Benjamin <oscar.j.benjamin@gmail.com>
Subject: Re: Re: Iterating over files of a huge directory
References: <c2b15410-12e0-4645-a77f-9944bfd674a8@googlegroups.com> <CAHVvXxRpG8HDbboCPTuuhMNhZYjewScQW8um1Wz9e90Uv5mQag@mail.gmail.com>
In-Reply-To: <CAHVvXxRpG8HDbboCPTuuhMNhZYjewScQW8um1Wz9e90Uv5mQag@mail.gmail.com>
X-Enigmail-Version: 1.4
Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig7824E167F18BEE7D49EB6E9F"
Cc: Gilles Lenfant <gilles.lenfant@gmail.com>, Python List <python-list@python.org>
X-BeenThere: python-list@python.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe: <http://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive: <http://mail.python.org/pipermail/python-list/>
List-Post: <mailto:python-list@python.org>
List-Help: <mailto:python-list-request@python.org?subject=help>
List-Subscribe: <http://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups: comp.lang.python
Message-ID: <mailman.983.1355769683.29569.python-list@python.org>
Lines: 52
NNTP-Posting-Host: 2001:888:2000:d::a6
X-Trace: 1355769683 news.xs4all.nl 6874 [2001:888:2000:d::a6]:35552
X-Complaints-To: abuse@xs4all.nl
Xref: csiph.com comp.lang.python:35005

This is an OpenPGP/MIME signed message (RFC 2440 and 3156)
--------------enig7824E167F18BEE7D49EB6E9F
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

On 12/17/2012 09:52 AM, Oscar Benjamin wrote:
> In the last couple of months there has been a lot of discussion (on
> python-list or python-dev - not sure) about creating a library to more
> efficiently iterate over the files in a directory. The result so far
> is this library on github:
> https://github.com/benhoyt/betterwalk

This is very useful to know about; thanks.

I actually wrote something very similar on my own (I wanted to get
information about whether each directory entry was a file, directory,
symlink, etc. without separate stat() calls). I'm guessing that the
library you linked is more mature than mine (I only have a Linux
implementation at present, for instance) so I'm happy to see that I
could probably switch to something better... and even happier that it
sounds like it's aiming for inclusion in the standard library.


(Also just for the record and anyone looking for other posts, I'd guess
said discussion was on Python-dev. I don't look at even remotely
everything on python-list (there's just too much), but I do skim most
subject lines and I haven't noticed any discussion on it before now.)

Evan




--------------enig7824E167F18BEE7D49EB6E9F
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.14 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iQEcBAEBAgAGBQJQz2c3AAoJEAOzoR8eZTzgPf0H/AjEzoD2b78DX7Xb9R7LHUfY
woWEfivsWkjkdA23/5BrAgDGgXKvu/zhi4UCl0MaXSIJHLA1av2x+Li+wSgjLPm9
8WE7B/sOcMY2qEH04FyBCgAZgpWv4JHOnFdDtarZG8et5AeDm1R2jqrPKGzlD4SI
EIQtgM1nNpqFLw1fnnGqlm3Bj2aJjinVIS1Mn5WQyePkSW0RtBNzz/7rxaQAMhEp
vJWyOmiCrHmOSIsaj4IzfQTeegTSvvN20crELVbwM7TMtQoepRPZyCCkWC3Ir3JG
UYwPY0KoM27me/k7pbtphbIB5xGBrMTHSTV35EAV/Z5VyYBy24f6DmsCaBButPA=
=pEvG
-----END PGP SIGNATURE-----

--------------enig7824E167F18BEE7D49EB6E9F--