multiprocessing pipes with custom pickler

X-Received	by 10.224.42.141 with SMTP id s13mr13692676qae.3.1371577643889; Tue, 18 Jun 2013 10:47:23 -0700 (PDT)
X-Received	by 10.50.40.104 with SMTP id w8mr712154igk.1.1371577643747; Tue, 18 Jun 2013 10:47:23 -0700 (PDT)
Path	csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!news.glorb.com!j2no656447qak.0!news-out.google.com!y6ni3493qax.0!nntp.google.com!j2no656443qak.0!postnews.google.com!glegroupsg2000goo.googlegroups.com!not-for-mail
Newsgroups	comp.lang.python
Date	Tue, 18 Jun 2013 10:47:23 -0700 (PDT)
Complaints-To	groups-abuse@google.com
Injection-Info	glegroupsg2000goo.googlegroups.com; posting-host=71.6.85.242; posting-account=WlGYkAoAAADVhKf_1Nhh8RSlYLt0v1vA
NNTP-Posting-Host	71.6.85.242
User-Agent	G2/1.0
MIME-Version	1.0
Message-ID	<39c00c39-e3a4-405b-98f5-4a67300b3ced@googlegroups.com> (permalink)
Subject	multiprocessing pipes with custom pickler
From	skunkwerk <skunkwerk@gmail.com>
Injection-Date	Tue, 18 Jun 2013 17:47:23 +0000
Content-Type	text/plain; charset=ISO-8859-1
Xref	csiph.com comp.lang.python:48649

Show key headers only | View raw

Hi,
   I need inter-process communication in Python, and was looking at the documentation here:
http://docs.python.org/2/library/multiprocessing.html

I am using a custom pickler, though, in order to deal with some objects that are not serialize-able through the built-in pickler.  Is there any way to tell the pipe's send method to use my pickler?

I could also just send my already-pickled binary data using the existing send method, but pickling/unpickling twice seems like a hack.

Maybe the send_bytes method would be the best option, if it doesn't pickle the data?

thanks for the help,
imran

Back to comp.lang.python | Previous | Next | Find similar | Unroll thread

Thread

multiprocessing pipes with custom pickler skunkwerk <skunkwerk@gmail.com> - 2013-06-18 10:47 -0700

csiph-web