Path: csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!feeder.erje.net!eu.feeder.erje.net!feeds.phibee-telecom.net!newsfeed.xs4all.nl!newsfeed4.news.xs4all.nl!xs4all!post.news.xs4all.nl!not-for-mail Return-Path: X-Original-To: python-list@python.org Delivered-To: python-list@mail.python.org X-Spam-Status: OK 0.002 X-Spam-Evidence: '*H*': 1.00; '*S*': 0.00; 'subject:not': 0.03; 'subject:Python': 0.06; 'mentioned,': 0.07; 'subject: -- ': 0.07; 'currently,': 0.09; 'filename': 0.09; 'pgp': 0.09; 'skip:# 30': 0.09; 'subject:files': 0.09; 'works.': 0.09; 'cc:addr:python- list': 0.11; 'suggest': 0.14; 'posted': 0.15; '"with"': 0.16; 'processes.': 0.16; 'skip:q 70': 0.16; '\xa0would': 0.16; 'thursday,': 0.16; 'wrote:': 0.18; 'thu,': 0.19; '>>>': 0.22; 'example': 0.22; 'cc:addr:python.org': 0.22; 'convenient': 0.24; 'sorry,': 0.24; 'text,': 0.24; 'fine': 0.24; 'looks': 0.24; 'cc:2**0': 0.24; 'cc:no real name:2**0': 0.24; 'this:': 0.26; 'van': 0.27; 'header:In-Reply-To:1': 0.27; 'function': 0.29; "doesn't": 0.30; 'statement': 0.30; 'message-id:@mail.gmail.com': 0.30; 'work.': 0.31; 'code': 0.31; "skip:' 10": 0.31; 'you?': 0.31; '>>>>': 0.31; 'large.': 0.31; 'writes:': 0.31; 'file': 0.32; 'probably': 0.32; 'stuff': 0.32; 'quite': 0.32; 'received:74.125.82': 0.34; 'problem': 0.35; 'something': 0.35; 'received:google.com': 0.35; 'there': 0.35; 'should': 0.36; 'list': 0.37; 'skip:& 10': 0.38; 'skip:[ 10': 0.38; 'issue': 0.38; 'pm,': 0.38; 'received:74.125': 0.39; 'remove': 0.60; 'most': 0.60; 'providing': 0.61; 'here:': 0.62; 'complete': 0.62; 'more': 0.64; 'skip:f 50': 0.65; 'reply': 0.66; 'obvious': 0.74; 'batchelder': 0.84; 'isaac': 0.84; 'subject:skip:M 10': 0.84; '2013': 0.98 X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-type; bh=UfxSR4Z7UkuSb8HUptw+ptaYGA2TPixjJDQY5prM/xs=; b=ctkWPjfhlNXkL1YpeXEayeZKs87nR77/IasKBG3PEoIi4lsGkhCbQzqXGOOai/Ftch f7gKCvuJF7P9yrnvpTUshZdfVBmHfJrpiMUHBs+TpqnPPo+/VUESSxWl4TYVOX6Play2 /oPORaYq417jm6ockBJsCPJr59DdjxKHaLMjb3WXOWOgkR7IXRbf9jUG4JeRgM8zI9z5 IXMJifrUIllfJ2A5ALMzp7Sr0JYZjetd46/1wCogl2IZKlfrU2BO8yykx13ymLBdM801 EqmBn148uwMwfrww4JvdIf4sfYiXhMs7kZCmeuL09s2dOxnugbQEKri37IDmi3uF5wlb RgOw== X-Gm-Message-State: ALoCoQklEFRxw3tEWZl8fjMTKGHRdtHp4n126/2PCO8ES0B3K9U0ptwDPZZpAYDLxDJrhU/J22r+ X-Received: by 10.180.90.197 with SMTP id by5mr8979298wib.43.1381430998988; Thu, 10 Oct 2013 11:49:58 -0700 (PDT) MIME-Version: 1.0 X-Originating-IP: [146.186.247.30] In-Reply-To: <5256F4C1.4050700@nedbatchelder.com> References: <73f03f7c-6a0a-449c-af60-ab204844d578@googlegroups.com> <5256F4C1.4050700@nedbatchelder.com> From: Isaac Gerg Date: Thu, 10 Oct 2013 14:49:38 -0400 Subject: Re: Python 3.2 | WIndows 7 -- Multiprocessing and files not closing To: Ned Batchelder Content-Type: multipart/alternative; boundary=f46d0438eb6dfa036804e86777a2 Cc: python-list@python.org X-BeenThere: python-list@python.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: General discussion list for the Python programming language List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Newsgroups: comp.lang.python Message-ID: Lines: 189 NNTP-Posting-Host: 2001:888:2000:d::a6 X-Trace: 1381431340 news.xs4all.nl 15987 [2001:888:2000:d::a6]:42549 X-Complaints-To: abuse@xs4all.nl Xref: csiph.com comp.lang.python:56600 --f46d0438eb6dfa036804e86777a2 Content-Type: text/plain; charset=ISO-8859-1 On Thu, Oct 10, 2013 at 2:41 PM, Ned Batchelder wrote: > On 10/10/13 12:44 PM, Isaac Gerg wrote: > >> Sorry, I am just providing pseudo code since I the code i have is quite >> large. >> >> As I mentioned, the code works fine when I remove the multirpcessing >> stuff so the filename is not the issue (though you are right in your >> correction). >> >> Someone with the same problem posted a smaller, more complete example >> here: >> >> http://stackoverflow.com/**questions/948119/preventing-** >> file-handle-inheritance-in-**multiprocessing-lib >> >> None of the solutions posted work. >> > > (BTW: it's better form to reply beneath the original text, not above it.) > > None of the solutions try the obvious thing of closing the file before > spawning more processes. Would that work for you? A "with" statement is a > convenient way to do this: > > with open(filename,'r') as f: > data = f.read() > > The file is closed automatically when the with statement ends. > > --Ned. > > >> On Thursday, October 10, 2013 12:38:19 PM UTC-4, Piet van Oostrum wrote: >> >>> Isaac Gerg writes: >>> >>> >>> >>> I have a function that looks like the following: >>>> >>> >>> >>> That doesn't look like a function >>> >>> >>> >>> #-----------------------------**---- >>>> filename = 'c:\testfile.h5' >>>> >>> >>> >>> Your filename is most probably wrong. It should be something like: >>> >>> >>> >>> filename = 'c:/testfile.h5' >>> >>> filename = 'c:\\testfile.h5' >>> >>> filename = r'c:\testfile.h5' >>> >>> -- >>> >>> Piet van Oostrum >>> >>> WWW: http://pietvanoostrum.com/ >>> >>> PGP key: [8DAE142BE17999C4] >>> >> > I will try what you suggest and see if it works. Additionally, is there a place on the web to view this conversation and reply? Currently, I am only able to access this list through email. --f46d0438eb6dfa036804e86777a2 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable



On Thu, Oct 10, 2013 at 2:41 PM, Ned Batchelder &= lt;ned@nedbatche= lder.com> wrote:
On 10/10/13 12:44 PM, Isaac Gerg wrote:
Sorry, I am just providing pseudo code since I the code i have is quite lar= ge.

As I mentioned, the code works fine when I remove the multirpcessing stuff = so the filename is not the issue (though you are right in your correction).=

Someone with the same problem posted a smaller, more complete example here:=

http://stackoverflow= .com/questions/948119/preventing-file-handle-inheritance-in-<= u>multiprocessing-lib

None of the solutions posted work.

(BTW: it's better form to reply beneath the original text, not above it= .)

None of the solutions try the obvious thing of closing the file before spaw= ning more processes. =A0Would that work for you? =A0A "with" stat= ement is a convenient way to do this:

=A0 =A0 with open(filename,'r') as f:
=A0 =A0 =A0 =A0 data =3D f.read()

The file is closed automatically when the with statement ends.

--Ned.


On Thursday, October 10, 2013 12:38:19 PM UTC-4, Piet van Oostrum wrote:
Isaac Gerg <= isaac.gerg@gergltd.com> writes:



I have a function that looks like the following:


That doesn't look like a function



#---------------------------------
filename =3D 'c:\testfile.h5'


Your filename is most probably wrong. It should be something like:



filename =3D 'c:/testfile.h5'

filename =3D 'c:\\testfile.h5'

filename =3D r'c:\testfile.h5'

--

Piet van Oostrum <piet@vanoostrum.org>

WWW: http://pietva= noostrum.com/

PGP key: [8DAE142BE17999C4]


I will try what you= suggest and see if it works.

Additionally, is there a place on the web to view t= his conversation and reply? =A0Currently, I am only able to access this lis= t through email.
--f46d0438eb6dfa036804e86777a2--