Path: csiph.com!x330-a1.tempe.blueboxinc.net!usenet.pasdenom.info!aioe.org!feeder.news-service.com!newsfeed.xs4all.nl!newsfeed6.news.xs4all.nl!newsgate.cistron.nl!newsgate.news.xs4all.nl!194.109.133.84.MISMATCH!newsfeed.xs4all.nl!newsfeed5.news.xs4all.nl!xs4all!post.news.xs4all.nl!not-for-mail
DomainKey-Signature: a=rsa-sha1; c=nofws; d=rebertia.com; s=google; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type :content-transfer-encoding; b=Iq9YaEryHaVVDavyLGWxCkHkYYJNTi2Ko7Y7gchtuyKKb7fA64hAb4ayY2geNYkNqh cUW+OqHNYKvnMFgQQ5FxvCrjfZO460T5AyjxcSzzk0YmB9dhcs2X++JcmM6G66XI5t2G P9kensac+xOd+fMlXPmCOokXxTEMHEAEgXZUI=
MIME-Version: 1.0
Sender: chris@rebertia.com
In-Reply-To: <61890800-f81a-4a1e-8905-a0237407f016@a21g2000prj.googlegroups.com>
References: <61890800-f81a-4a1e-8905-a0237407f016@a21g2000prj.googlegroups.com>
Date: Tue, 19 Apr 2011 12:21:57 -0700
Subject: Re: Pickling over a socket
From: Chris Rebert <clp2@rebertia.com>
To: Roger Alexander <rtalexander@mac.com>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
Cc: python-list@python.org
Precedence: list
Newsgroups: comp.lang.python
Message-ID: <mailman.579.1303240920.9059.python-list@python.org>
Lines: 91
NNTP-Posting-Host: 82.94.164.166
Xref: x330-a1.tempe.blueboxinc.net comp.lang.python:3583

On Tue, Apr 19, 2011 at 11:53 AM, Roger Alexander <rtalexander@mac.com> wro=
te:
> Hi,
>
> I'm trying to understand how to pickle Python objects over a TCP
> socket.
>
> In the example below (based on code from Foundations of Python Network
> Programming), a client creates a dictionary (lines 34-38) and uses
> pickle.dump at line 42 to write the pickled object using file handle
> make from a socket. The server de-pickles with pickle.load =C2=A0(line 24=
),
> again using a file handle made from a socket.
>
> When I run the program, the following output is produced:
>
> =C2=A0 =C2=A0Listening at ('127.0.0.1', 1060)
> =C2=A0 =C2=A0Accepted connection from ('127.0.0.1', 49938)
> =C2=A0 =C2=A0Traceback (most recent call last):
> =C2=A0 =C2=A0File "pickles.py", line 24, in <module>
> =C2=A0 =C2=A0 =C2=A0 =C2=A0d =3D pickle.load( s_fh )
> =C2=A0 =C2=A0File "/usr/local/lib/python2.7/pickle.py", line 1378, in loa=
d
> =C2=A0 =C2=A0 =C2=A0 =C2=A0return Unpickler(file).load()
> =C2=A0 =C2=A0File "/usr/local/lib/python2.7/pickle.py", line 857, in load
> =C2=A0 =C2=A0 =C2=A0 =C2=A0key =3D read(1)
> =C2=A0 =C2=A0File "/usr/local/lib/python2.7/socket.py", line 380, in read
> =C2=A0 =C2=A0 =C2=A0 =C2=A0data =3D self._sock.recv(left)
> =C2=A0 =C2=A0socket.error: [Errno 107] Transport endpoint is not connecte=
d
>
> I'm at a loss, can anyone provide any guidance?
>
> Thanks,
>
> Roger Alexander
>
> =C2=A01 =C2=A0import pickle
> =C2=A02 =C2=A0import socket, sys
> =C2=A03
> =C2=A04 =C2=A0s =3D socket.socket(socket.AF_INET, socket.SOCK_STREAM)
> =C2=A05
> =C2=A06 =C2=A0HOST =3D sys.argv.pop() if len(sys.argv) =3D=3D 3 else '127=
.0.0.1'
> =C2=A07 =C2=A0PORT =3D 1060
> =C2=A08
> =C2=A09 =C2=A0if sys.argv[1:] =3D=3D ['server']:
> 10
> 11 =C2=A0 =C2=A0 =C2=A0s.setsockopt(socket.SOL_SOCKET, socket.SO_REUSEADD=
R, 1)
> 12 =C2=A0 =C2=A0 =C2=A0s.bind((HOST, PORT))
> 13 =C2=A0 =C2=A0 =C2=A0s.listen(1)
> 14
> 15 =C2=A0 =C2=A0 =C2=A0print 'Listening at', s.getsockname()
> 16
> 17 =C2=A0 =C2=A0 =C2=A0sc, sockname =3D s.accept()
> 18
> 19 =C2=A0 =C2=A0 =C2=A0print 'Accepted connection from', sockname
> 20
> 21 =C2=A0 =C2=A0 =C2=A0sc.shutdown(socket.SHUT_WR)

[Haven't done any network programming, so please excuse the naivete of
this suggestion.]

Have you tried removing line #21 and/or #32?

http://docs.python.org/library/socket.html#socket.socket.shutdown :
"socket.shutdown(how) - Shut down one or both halves of the
connection. [...] Depending on the platform, shutting down one half of
the connection can also close the opposite half"

Cheers,
Chris
--
http://blog.rebertia.com

> 22 =C2=A0 =C2=A0 =C2=A0sf =3D s.makefile( "rb" )
> 23
> 24 =C2=A0 =C2=A0 =C2=A0d =3D pickle.load(sf)
> 25
> 26 =C2=A0 =C2=A0 =C2=A0sc.close()
> 27 =C2=A0 =C2=A0 =C2=A0s.close()
> 28
> 29 =C2=A0elif sys.argv[1:] =3D=3D ['client']:
> 30
> 31 =C2=A0 =C2=A0 =C2=A0s.connect((HOST, PORT))
> 32 =C2=A0 =C2=A0 =C2=A0s.shutdown(socket.SHUT_RD)
<snip>
> 42 =C2=A0 =C2=A0 =C2=A0pickle.dump( d, sf, pickle.HIGHEST_PROTOCOL )
> 43
> 44 =C2=A0 =C2=A0 =C2=A0s.close()