Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.lang.python > #49159

Re: Question about pickle

From Peter Otten <__peter__@web.de>
Subject Re: Question about pickle
Date 2013-06-25 15:47 +0200
Organization None
References <CANjxQ6wWvT6zmn46oC=eQS0+dqtvkRpn2nKzdbmisLfm34LZPg@mail.gmail.com>
Newsgroups comp.lang.python
Message-ID <mailman.3828.1372168083.3114.python-list@python.org> (permalink)

Show all headers | View raw


Phu Sam wrote:

> I have a method that opens a file, lock it, pickle.load the file into a
> dictionary.
> I then modify the status of a record, then pickle.dump the dictionary back
> to the file.
> 
> The problem is that the pickle.dump never works. The file never gets
> updated.
> 
> def updateStatus(self, fp, stn, status):
>           f = open(fp, 'rw+')
>           fcntl.flock(f.fileno(),fcntl.LOCK_EX | fcntl.LOCK_NB)
> 
>           tb = pickle.load(f)
> 
>           self.modifyDict(tb, stn, status)

            f.seek(0)

>           pickle.dump(tb, f)
> 
>           fcntl.flock(f.fileno(),fcntl.LOCK_UN)
>           f.close()
> 
> 
> What could be the problem here?

pickle.load() moves the file position to the end of the (first) pickle.
pickle.dump() writes the modified dict starting at the current position. You 
end up with two versions of the dict, but you'll only ever read the first.

The fix is to go back to the start of the file with f.seek().

> What mode should I use to open the file to allow both pickle.load and
> pickle.dump?

Assuming that the file already exists when updateStatus() is invoked for the 
first time: "r+b".

I usually open the file twice, once for reading and then for writing, but I 
guess that would interfere with locking.

Back to comp.lang.python | Previous | Next | Find similar | Unroll thread


Thread

Re: Question about pickle Peter Otten <__peter__@web.de> - 2013-06-25 15:47 +0200

csiph-web