Path: csiph.com!usenet.pasdenom.info!nntpfeed.proxad.net!proxad.net!feeder1-1.proxad.net!217.73.144.45.MISMATCH!feeder2.ecngs.de!ecngs!feeder.ecngs.de!border1.nntp.ams1.giganews.com!nntp.giganews.com!newsfeed.xs4all.nl!newsfeed2a.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
From: David Aldrich <David.Aldrich@EMEA.NEC.COM>
To: Peter Otten <__peter__@web.de>, "python-list@python.org" <python-list@python.org>
Subject: RE: What sort of data structure to use?
Thread-Topic: What sort of data structure to use?
Thread-Index: AdCd1fo44gG/MTjASoWMlKddMLloTQAFoBIWAAA3wGA=
Date: Wed, 3 Jun 2015 11:07:50 +0000
References: <41302A7145AC054FA7A96CFD03835A0A0B97DECA@EX10MBX02.EU.NEC.COM> <mkmmm3$ott$1@ger.gmane.org>
In-Reply-To: <mkmmm3$ott$1@ger.gmane.org>
Accept-Language: en-GB, en-US
Content-Language: en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
Precedence: list
Newsgroups: comp.lang.python
Message-ID: <mailman.101.1433333945.13271.python-list@python.org>
Lines: 89
NNTP-Posting-Host: 2001:888:2000:d::a6
Xref: csiph.com comp.lang.python:91949

Thanks very much for all the answers given to my question. They help me to =
think about the problem pythonically.

Best regards

David

> -----Original Message-----
> From: Python-list [mailto:python-list-
> bounces+david.aldrich=3Demea.nec.com@python.org] On Behalf Of Peter
> Otten
> Sent: 03 June 2015 11:59
> To: python-list@python.org
> Subject: Re: What sort of data structure to use?
>=20
> David Aldrich wrote:
>=20
> > Hi
> >
> > I have written a Python utility that performs a certain activity on
> > some predefined sets of files.  Here is the outline of what I have writ=
ten:
> >
> > # File Set A
> > pathA =3D 'pathA'
> > fileListA =3D ['fileA1.txt', 'fileA2.txt']
> >
> > # File Set B
> > pathB =3D 'pathB'
> > fileListB =3D ['fileB1.txt', 'fileB2.txt', 'fileB3.txt']
> >
> > myFunc1(pathA, fileListA)
> > myFunc2(pathA, fileListA)
> >
> > myFunc1(pathB, fileListB)
> > myFunc2(pathB, fileListB)
> >
> > I want to add more file sets, so I really want to add the sets to a
> > list and iterate over the list, calling myFunc1 & myFunc2 for each item=
.
> >
> > My question is: what sort of data structure could I use to organise
> > this, given that I want to associate a set of files with each path and
> > that, for each set, there is an arbitrary number of files?
>=20
> I'd start simple and put (path, files) pairs into a list:
>=20
> path_files_pairs =3D [
>     ("pathA", ["fileA1.txt", "fileA2.txt", ...]),
>     ("pathB", ["fileB1.txt", ...]),
> ]
>=20
> for path, files in path_files_pairs:
>     func1(path, files)
>     func2(path, files)
>=20
> You can always add complications later:
>=20
> import glob
> import os
>=20
> class VirtualFileset:
>     def __init__(self, folder, pattern):
>         self.folder =3D folder
>         self.pattern =3D pattern
>     def __iter__(self):
>         yield self.folder
>         yield glob.glob(os.path.join(self.folder, self.pattern))
>=20
> path_files_pairs =3D [
>     ("pathA", ["fileA1.txt", "fileA2.txt", ...]),
>     ("pathB", ["fileB1.txt", ...]),
>     VirtualFileset("pathC", "*.py"), # all python files in directory "pat=
hC"
> ]
>=20
> for path, files in path_files_pairs:
>     func1(path, files)
>     func2(path, files)
>=20
>=20
> --
> https://mail.python.org/mailman/listinfo/python-list
>=20
>=20
>  Click
> https://www.mailcontrol.com/sr/51ZWmSF1P47GX2PQPOmvUmaGI8Tu3yGr
> Vrr5Tv1xM3UP2MNyoKSTyt0rIsjE4onM5MUvmWbo6fT3KeH4!zzvzA=3D=3D  to
> report this email as spam.