Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.lang.python.announce > #953

ANN: python-blosc 1.1 RC1, a wrapper for the compression library, is available

Path csiph.com!usenet.pasdenom.info!gegeweb.org!de-l.enfer-du-nord.net!feeder2.enfer-du-nord.net!newsfeed1.swip.net!uio.no!news.tele.dk!news.tele.dk!small.news.tele.dk!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
Return-Path <francesc@continuum.io>
X-Original-To python-announce-list@python.org
Delivered-To python-announce-list@mail.python.org
X-Spam-Status OK 0.004
X-Spam-Evidence '*H*': 0.99; '*S*': 0.00; 'licenses': 0.04; 'binary': 0.07; 'cache': 0.07; 'pypi': 0.07; 'see:': 0.07; 'skip:` 10': 0.07; 'subject:ANN': 0.07; '===========': 0.09; 'arrays': 0.09; 'omit': 0.09; 'prefix': 0.09; 'release.': 0.09; 'url:github': 0.09; 'wrapper': 0.09; 'python': 0.11; '(another': 0.16; '(via': 0.16; '==========': 0.16; 'added.': 0.16; 'alted': 0.16; 'compression': 0.16; 'docstrings': 0.16; 'fetch': 0.16; 'francesc': 0.16; 'from:name:francesc alted': 0.16; 'license.': 0.16; 'subject:library': 0.16; 'to:addr:python-announce-list': 0.16; 'url:licenses': 0.16; 'subject:python': 0.16; 'skip:= 10': 0.16; 'url:org)': 0.16; 'url:)': 0.16; 'library': 0.18; 'numerical': 0.19; 'examples': 0.20; '(the': 0.22; 'command': 0.22; 'memory': 0.22; 'install': 0.23; 'header:User-Agent:1': 0.23; 'pointer': 0.24; 'processor': 0.24; 'values': 0.27; 'installed': 0.27; 'url:wiki': 0.31; 'consequence': 0.31; 'values.': 0.31; 'allows': 0.31; 'call.': 0.33; 'sources': 0.33; 'at:': 0.34; 'subject:the': 0.34; 'received:google.com': 0.35; 'there': 0.35; 'data,': 0.36; 'in:': 0.36; 'installing': 0.36; 'library.': 0.36; 'thanks': 0.36; 'possible': 0.36; 'url:org': 0.36; 'should': 0.36; 'wrong': 0.37; 'list': 0.37; 'level': 0.37; 'area': 0.37; 'performance': 0.37; 'system,': 0.38; 'checks': 0.38; 'depends': 0.38; 'recent': 0.39; 'supporting': 0.39; 'sure': 0.39; 'to:addr:python.org': 0.39; 'mailing': 0.39; 'called': 0.40; 'release': 0.40; 'most': 0.60; 'new': 0.61; 'details.': 0.61; 'high': 0.63; 'url:group': 0.63; 'skip:n 10': 0.64; 'more': 0.64; 'different': 0.65; 'relatively': 0.65; 'effectively': 0.66; 'series': 0.66; 'services': 0.66; 'direct': 0.67; 'optimized': 0.68; 'ranges': 0.74; 'site:': 0.83; 'low': 0.83; '============': 0.84; 'improved.': 0.84; 'safe.': 0.84; 'url:master': 0.84; 'url:trac': 0.84; 'announcing': 0.91; 'conducted': 0.91; 'info,': 0.91; 'subject:available': 0.93; 'email addr:googlegroups.com': 0.95
X-Google-DKIM-Signature v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=x-received:message-id:date:from:user-agent:mime-version:to:subject :content-type:content-transfer-encoding:x-gm-message-state; bh=DAbEcBQKnP+/hqBuTi0OEcZlJCKclhfUhg/AxjgsG+k=; b=fbBL+mbIRj3Ykbx+LG2Od6BXXG/VllIGhkOIutNt9eL9YoH0VHmu1sWovMX5cXBXNG qifastAOecCwboMXXjMzl1VhBzIUBnSAmmfjDfgOzUoh/OF/vkK/Z3Ohu3Mb+ZuEY4o/ A2VXN+UD3z3JflMkEJxv1IFOQgRe/hHkqsdSfcCaRk2aGRqNAsDxGy0dNIr9uZKEdHLi DEbw82raU5UsuK/8B2ifowmm873Mgh5rnyWfU43xGgM/f3YQ84kCB2GB3/sDFnb9jase bN0R6e1PeeSWuA+m6QfeuLSqPhhjTiyDrVmGqB1LAdhGv4v1bqFiSkqqzATIVwgZyDsg 1Qyw==
X-Received by 10.194.95.9 with SMTP id dg9mr2218983wjb.20.1368816003070; Fri, 17 May 2013 11:40:03 -0700 (PDT)
Date Fri, 17 May 2013 20:40:02 +0200
From Francesc Alted <francesc@continuum.io>
User-Agent Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20130329 Thunderbird/17.0.5
MIME-Version 1.0
To Python Announcements <python-announce-list@python.org>
Subject ANN: python-blosc 1.1 RC1, a wrapper for the compression library, is available
Content-Type text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding 8bit
X-Gm-Message-State ALoCoQnvtASe0luQ+T3pGMihTQNJOQ4eFD/eQEoG7lmSlrfaBbEIC/NyTKjUiD03QUgtuH8OHZnv
X-Mailman-Approved-At Sun, 19 May 2013 09:52:54 +0200
X-BeenThere python-announce-list@python.org
X-Mailman-Version 2.1.15
Precedence list
Reply-To python-list@python.org
List-Id Announcement-only list for the Python programming language <python-announce-list.python.org>
List-Unsubscribe <http://mail.python.org/mailman/options/python-announce-list>, <mailto:python-announce-list-request@python.org?subject=unsubscribe>
List-Archive <http://mail.python.org/pipermail/python-announce-list/>
List-Post <mailto:python-announce-list@python.org>
List-Help <mailto:python-announce-list-request@python.org?subject=help>
List-Subscribe <http://mail.python.org/mailman/listinfo/python-announce-list>, <mailto:python-announce-list-request@python.org?subject=subscribe>
Approved python-announce-list@python.org
Newsgroups comp.lang.python.announce
Message-ID <mailman.1839.1368949974.3114.python-announce-list@python.org> (permalink)
Lines 105
NNTP-Posting-Host 2001:888:2000:d::a6
X-Trace 1368949974 news.xs4all.nl 15997 [2001:888:2000:d::a6]:56311
X-Complaints-To abuse@xs4all.nl
Xref csiph.com comp.lang.python.announce:953

Show key headers only | View raw


================================
Announcing python-blosc 1.1 RC1
================================

What is it?
===========

python-blosc (http://blosc.pydata.org/) is a Python wrapper for the
Blosc compression library.

Blosc (http://blosc.org) is a high performance compressor optimized for
binary data.  It has been designed to transmit data to the processor
cache faster than the traditional, non-compressed, direct memory fetch
approach via a memcpy() OS call.  Whether this is achieved or not
depends of the data compressibility, the number of cores in the system,
and other factors.  See a series of benchmarks conducted for many
different systems: http://blosc.org/trac/wiki/SyntheticBenchmarks.

Blosc works well for compressing numerical arrays that contains data
with relatively low entropy, like sparse data, time series, grids with
regular-spaced values, etc.

There is also a handy command line for Blosc called Bloscpack
(https://github.com/esc/bloscpack) that allows you to compress large
binary datafiles on-disk.  Although the format for Bloscpack has not
stabilized yet, it allows you to effectively use Blosc from your
favorite shell.


What is new?
============

- Added new `compress_ptr` and `decompress_ptr` functions that allows to
   compress and decompress from/to a data pointer.  These are low level
   calls and user must make sure that the pointer data area is safe.

- Since Blosc (the C library) already supports to be installed as an
   standalone library (via cmake), it is also possible to link
   python-blosc against a system Blosc library.

- The Python calls to Blosc are now thread-safe (another consequence of
   recent Blosc library supporting this at C level).

- Many checks on types and ranges of values have been added.  Most of
   the calls will now complain when passed the wrong values.

- Docstrings are much improved. Also, Sphinx-based docs are available
   now.

Many thanks to Valentin Hänel for his impressive work for this release.

For more info, you can see the release notes in:

https://github.com/FrancescAlted/python-blosc/wiki/Release-notes

More docs and examples are available in the documentation site:

http://blosc.pydata.org


Installing
==========

python-blosc is in PyPI repository, so installing it is easy:

$ pip install -U blosc  # yes, you should omit the blosc- prefix


Download sources
================

The sources are managed through github services at:

http://github.com/FrancescAlted/python-blosc


Documentation
=============

There is Sphinx-based documentation site at:

http://blosc.pydata.org/


Mailing list
============

There is an official mailing list for Blosc at:

blosc@googlegroups.com
http://groups.google.es/group/blosc


Licenses
========

Both Blosc and its Python wrapper are distributed using the MIT license.
See:

https://github.com/FrancescAlted/python-blosc/blob/master/LICENSES

for more details.

--
Francesc Alted

Back to comp.lang.python.announce | Previous | Next | Find similar | Unroll thread


Thread

ANN: python-blosc 1.1 RC1, a wrapper for the compression library, is available Francesc Alted <francesc@continuum.io> - 2013-05-17 20:40 +0200

csiph-web