Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.lang.python.announce > #1835

ANN: WordSegment 0.5.2 Released

Path csiph.com!eternal-september.org!feeder.eternal-september.org!border1.nntp.ams1.giganews.com!nntp.giganews.com!newsfeed.xs4all.nl!newsfeed7.news.xs4all.nl!news.tele.dk!news.tele.dk!small.news.tele.dk!newsgate.cistron.nl!newsgate.news.xs4all.nl!nzpost1.xs4all.net!not-for-mail
Return-Path <grant.jenks@gmail.com>
X-Original-To python-announce-list@python.org
Delivered-To python-announce-list@mail.python.org
X-Spam-Status OK 0.018
X-Spam-Evidence '*H*': 0.96; '*S*': 0.00; 'url:pypi': 0.03; 'subject:ANN': 0.07; 'api': 0.09; 'derived': 0.09; 'url:github': 0.09; 'bug': 0.10; '0.5.2': 0.16; 'fix:': 0.16; 'url:issues': 0.16; 'input': 0.18; 'language': 0.19; 'converted': 0.22; 'decorator': 0.22; 'chapter': 0.23; 'implemented': 0.24; 'written': 0.24; 'module': 0.25; 'message-id:@mail.gmail.com': 0.27; 'download:': 0.29; '-----': 0.29; 'tutorial': 0.29; 'code': 0.30; 'url:python': 0.33; 'server': 0.34; 'received:google.com': 0.35; 'text': 0.35; 'licensed': 0.35; 'replaced': 0.35; 'url:org': 0.36; 'subject:: ': 0.37; 'release': 0.37; 'version': 0.38; 'files': 0.38; 'google': 0.39; 'skip:- 20': 0.39; 'data': 0.39; 'to:addr:python.org': 0.40; 'skip:n 10': 0.62; 'complete': 0.63; '100%': 0.72; 'issues:': 0.84; 'source:': 0.84; 'upgrade.': 0.84; 'announcing': 0.91
DKIM-Signature v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=RR9P2ZF5wQCJr7/2BW69SmfSBgX+/7urTW4MmubnXzw=; b=SSJxFZDBrCCrucOvEQUy+gGv7puBfYHInRl1VHwm85ztIa0Q3tQay+fYUZpmRaQB3S +wdaiO2AAykaSb/EGGJXGxe6q9MbTbHZx7ZtjfVsnBhRY4v/cBSkgN5c9fKjYDap2oP0 RQehepWcqcXh6am6uelKKQn/7vGsgSRde9eaHtTyl+0CsgT2VDSX2c/ZThYOaljdM8St ejegp0Su9ji+Jngi6i90inNvN29oT8v97dzrKJqI9ihqHwqia5UeonHNOjcrLf/7oUMM PjLr/zKRAfTzOGkI8HS84Y6CvTZ8TA6eHxK2ERy/SahvVgwhXu9d9+w3d9jfaCoHeIbm RY/g==
MIME-Version 1.0
X-Received by 10.107.47.168 with SMTP id v40mr37158666iov.30.1441232866259; Wed, 02 Sep 2015 15:27:46 -0700 (PDT)
Date Wed, 2 Sep 2015 15:27:46 -0700
Subject ANN: WordSegment 0.5.2 Released
From Grant Jenks <grant.jenks@gmail.com>
To python-announce-list@python.org
Content-Type text/plain; charset=UTF-8
Content-Transfer-Encoding quoted-printable
X-Mailman-Approved-At Thu, 03 Sep 2015 07:06:14 +0200
X-BeenThere python-announce-list@python.org
X-Mailman-Version 2.1.20+
Precedence list
List-Id Announcement-only list for the Python programming language <python-announce-list.python.org>
List-Unsubscribe <https://mail.python.org/mailman/options/python-announce-list>, <mailto:python-announce-list-request@python.org?subject=unsubscribe>
List-Archive <http://mail.python.org/pipermail/python-announce-list/>
List-Post <mailto:python-announce-list@python.org>
List-Help <mailto:python-announce-list-request@python.org?subject=help>
List-Subscribe <https://mail.python.org/mailman/listinfo/python-announce-list>, <mailto:python-announce-list-request@python.org?subject=subscribe>
Approved python-announce-list@python.org
Newsgroups comp.lang.python.announce
Message-ID <mailman.53.1441256776.8327.python-announce-list@python.org> (permalink)
Lines 35
NNTP-Posting-Host 2001:888:2000:d::a6
X-Trace 1441256776 news.xs4all.nl 23734 [2001:888:2000:d::a6]:41161
X-Complaints-To abuse@xs4all.nl
Xref csiph.com comp.lang.python.announce:1835

Show key headers only | View raw


Announcing the Release of WordSegment Version 0.5.2

What is WordSegment?
-------------------------

WordSegment is an Apache2 licensed module for English word segmentation,
written in pure-Python, and based on a trillion-word corpus. Based on code from
the chapter “Natural Language Corpus Data” by Peter Norvig from the book
“Beautiful Data” (Segaran and Hammerbacher, 2009). Data files are derived from
the Google Web Trillion Word Corpus. It's implemented in pure-Python with 100%
code coverage and complete documentation.

What's new in 0.5.2?
--------------------

- Updated documentation with tutorial and API reference.
- Removed unigrams longer than 24 characters.
- Bug Fix: Converted all bigrams to lowercase.
- Bug Fix: Sanitize input text by lowercasing and removing non-alphanumerics.
- Replaced "memoize" decorator with local memo-dict for server use.

Links
-----

- Documentation: http://www.grantjenks.com/docs/wordsegment/
- Download: https://pypi.python.org/pypi/wordsegment
- Source: https://github.com/grantjenks/wordsegment
- Issues: https://github.com/grantjenks/wordsegment/issues

This release is backwards-compatible. Please upgrade.

Back to comp.lang.python.announce | Previous | Next | Find similar | Unroll thread


Thread

ANN: WordSegment 0.5.2 Released Grant Jenks <grant.jenks@gmail.com> - 2015-09-02 15:27 -0700

csiph-web