Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.lang.python.announce > #1835 > unrolled thread

ANN: WordSegment 0.5.2 Released

Started byGrant Jenks <grant.jenks@gmail.com>
First post2015-09-02 15:27 -0700
Last post2015-09-02 15:27 -0700
Articles 1 — 1 participant

Back to article view | Back to comp.lang.python.announce


Contents

  ANN: WordSegment 0.5.2 Released Grant Jenks <grant.jenks@gmail.com> - 2015-09-02 15:27 -0700

#1835 — ANN: WordSegment 0.5.2 Released

FromGrant Jenks <grant.jenks@gmail.com>
Date2015-09-02 15:27 -0700
SubjectANN: WordSegment 0.5.2 Released
Message-ID<mailman.53.1441256776.8327.python-announce-list@python.org>
Announcing the Release of WordSegment Version 0.5.2

What is WordSegment?
-------------------------

WordSegment is an Apache2 licensed module for English word segmentation,
written in pure-Python, and based on a trillion-word corpus. Based on code from
the chapter “Natural Language Corpus Data” by Peter Norvig from the book
“Beautiful Data” (Segaran and Hammerbacher, 2009). Data files are derived from
the Google Web Trillion Word Corpus. It's implemented in pure-Python with 100%
code coverage and complete documentation.

What's new in 0.5.2?
--------------------

- Updated documentation with tutorial and API reference.
- Removed unigrams longer than 24 characters.
- Bug Fix: Converted all bigrams to lowercase.
- Bug Fix: Sanitize input text by lowercasing and removing non-alphanumerics.
- Replaced "memoize" decorator with local memo-dict for server use.

Links
-----

- Documentation: http://www.grantjenks.com/docs/wordsegment/
- Download: https://pypi.python.org/pypi/wordsegment
- Source: https://github.com/grantjenks/wordsegment
- Issues: https://github.com/grantjenks/wordsegment/issues

This release is backwards-compatible. Please upgrade.

[toc] | [standalone]


Back to top | Article view | comp.lang.python.announce


csiph-web