Path: csiph.com!usenet.pasdenom.info!gegeweb.org!de-l.enfer-du-nord.net!feeder2.enfer-du-nord.net!cs.uu.nl!news.stack.nl!newsfeed.xs4all.nl!newsfeed1.news.xs4all.nl!xs4all!post.news.xs4all.nl!not-for-mail
Return-Path: <animus.partum.universum@gmail.com>
X-Original-To: python-list@python.org
Delivered-To: python-list@mail.python.org
X-Spam-Status: OK 0.000
X-Spam-Evidence: '*H*': 1.00; '*S*': 0.00; 'string.': 0.04; 'importerror:': 0.05; 'function:': 0.09; 'saved.': 0.09; 'subject:module': 0.09; 'to:addr:comp.lang.python': 0.09; 'useless': 0.09; 'cc:addr:python-list': 0.10; '2.7': 0.13; '2.7:': 0.16; 'dump': 0.16; 'useless.': 0.16; '>>>': 0.18; 'load': 0.19; 'module': 0.19; "skip:' 40": 0.22; 'cc:2**0': 0.23; 'installed': 0.23; 'cc:no real name:2**0': 0.24; 'cc:addr:python.org': 0.25; 'header:In-Reply-To:1': 0.25; 'header:User-Agent:1': 0.26; 'module.': 0.27; 'see,': 0.27; 'actual': 0.28; 'probably': 0.29; 'received:google.com': 0.34; 'received:209.85': 0.35; "wasn't": 0.36; 'skip:p 20': 0.36; 'received:209': 0.37; 'subject:: ': 0.38; 'object': 0.38; 'gen': 0.84
Newsgroups: comp.lang.python
Date: Thu, 27 Dec 2012 04:05:02 -0800 (PST)
In-Reply-To: <mailman.1339.1356607732.29569.python-list@python.org>
Complaints-To: groups-abuse@google.com
Injection-Info: glegroupsg2000goo.googlegroups.com; posting-host=192.114.23.209; posting-account=XABbbQoAAACN47daumcsGLb_To0NYlHn
References: <ee10f0f7-7713-4879-82a1-ec5804767af6@googlegroups.com> <mailman.1339.1356607732.29569.python-list@python.org>
User-Agent: G2/1.0
X-Google-Web-Client: true
X-Google-IP: 192.114.23.209
MIME-Version: 1.0
Subject: Re: pickle module doens't work
From: Omer Korat <animus.partum.universum@gmail.com>
To: comp.lang.python@googlegroups.com
Content-Type: text/plain; charset=ISO-8859-1
Cc: python-list@python.org
X-BeenThere: python-list@python.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe: <http://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive: <http://mail.python.org/pipermail/python-list/>
List-Post: <mailto:python-list@python.org>
List-Help: <mailto:python-list-request@python.org?subject=help>
List-Subscribe: <http://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Message-ID: <mailman.1340.1356609912.29569.python-list@python.org>
Lines: 20
NNTP-Posting-Host: 2001:888:2000:d::a6
X-Trace: 1356609912 news.xs4all.nl 6943 [2001:888:2000:d::a6]:53601
X-Complaints-To: abuse@xs4all.nl
Xref: csiph.com comp.lang.python:35612

You're probably right in general, for me the 3.3 and 2.7 pickles definitely don't work the same:

3.3:
>>> type(pickle.dumps(1))
<type 'bytes'>

2.7:
>>> type(pickle.dumps(1, pickle.HIGHEST_PROTOCOL))
<type 'str'>


As you can see, in 2.7 when I try to dump something, I get useless string. Look what I gen when I dump an NLTK object such as the sent_tokenize function:

'\x80\x02cnltk.tokenize\nsent_tokenize\ng\x00'

Now, this is useless. If I try to load it on a platform without NLTK installed on it, I get:

ImportError: No module named 'nltk'

So it means the actual sent_tokenizer wasn't saved. Just it's module.