Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.lang.python.announce > #2102

ANN: python-blosc 1.3.1

Path csiph.com!news.swapon.de!fu-berlin.de!uni-berlin.de!not-for-mail
From Francesc Alted <faltet@gmail.com>
Newsgroups comp.lang.python.announce
Subject ANN: python-blosc 1.3.1
Date Thu, 7 Apr 2016 13:43:36 +0200
Lines 70
Approved python-announce-list@python.org
Message-ID <mailman.20.1460029568.2253.python-announce-list@python.org> (permalink)
References <CAFrp1voqj6PuKihExFT2=MJtW1-76DppC_tX-TipXFnjZ1uEyA@mail.gmail.com>
Reply-To faltet@gmail.com
Mime-Version 1.0
Content-Type text/plain; charset=UTF-8
X-Trace news.uni-berlin.de 9v+yWJsdlv3YJA8XXfzf0AwlCedFgcGX2i4HyZhs14Wg==
Return-Path <faltet@gmail.com>
X-Original-To python-announce-list@python.org
Delivered-To python-announce-list@mail.python.org
X-Spam-Status OK 0.000
X-Spam-Evidence '*H*': 1.00; '*S*': 0.00; 'binary': 0.05; 'cache': 0.05; 'fixes': 0.05; 'needed,': 0.05; 'repository': 0.05; 'nasty': 0.07; 'subject:ANN': 0.07; 'wrapper': 0.07; 'api': 0.09; '===========': 0.09; 'cc:addr:googlegroups.com': 0.09; 'compression': 0.09; 'fetch': 0.09; 'url:github': 0.09; 'url:rst': 0.09; 'python': 0.10; 'url:org)': 0.13; 'url:)': 0.14; 'subject:python': 0.14; 'alted': 0.16; 'arrays,': 0.16; 'compress': 0.16; 'francesc': 0.16; 'from:addr:faltet': 0.16; 'from:name:francesc alted': 0.16; 'in-memory': 0.16; 'machinery.': 0.16; 'numpy': 0.16; 'received:io': 0.16; 'received:psf.io': 0.16; 'stability.': 0.16; 'memory': 0.17; 'library,': 0.18; 'numerical': 0.18; 'processor': 0.18; 'skip:` 10': 0.18; 'skip:= 10': 0.18; 'library': 0.20; 'cc:addr:python.org': 0.20; 'cc:2**2': 0.20; 'arrays': 0.22; 'skip:= 20': 0.22; 'represents': 0.23; 'examples': 0.24; 'external': 0.27; '----': 0.27; 'message- id:@mail.gmail.com': 0.27; 'data,': 0.27; 'interface': 0.29; 'regular': 0.29; 'buffers': 0.29; 'symbols': 0.29; 'cc:no real name:2**1': 0.29; 'allows': 0.30; 'call.': 0.30; 'at:': 0.31; 'included': 0.32; 'received:google.com': 0.35; 'replaced': 0.35; 'but': 0.36; 'there': 0.36; 'url:org': 0.36; 'tool': 0.36; 'received:209.85': 0.36; 'data.': 0.36; 'faster': 0.36; 'notes': 0.36; 'subject:: ': 0.37; 'sources': 0.37; 'release': 0.37; 'received:209': 0.38; 'data': 0.39; 'subject:-': 0.39; 'called': 0.40; 'some': 0.40; 'high': 0.60; 'your': 0.60; 'competitive': 0.61; 'maximum': 0.61; 'skip:n 10': 0.62; 'relatively': 0.63; 'more': 0.63; 'here:': 0.63; 'services': 0.67; 'header:Reply- To:1': 0.67; 'direct': 0.68; 'reply-to:no real name:2**0': 0.71; 'site:': 0.75; 'reply-to:addr:gmail.com': 0.76; 'low': 0.83; '============': 0.84; 'url:master': 0.84; 'announcing': 0.91; 'info,': 0.93
DKIM-Signature v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:reply-to:date:message-id:subject:from:to:cc; bh=HsL2nh+5jo8tcYQofwrCSgvqwPn6YxziamF3k5UJ2AU=; b=D4jl0wCVnVF6yvfQcbtVlXzn4UEJKLYNrWgWh9kPFfsg8LWdlx042211KzR8brN1+K PlYKDvRvyUMCOKrVCPMPg6p5V+dx9fLnVO2+gQepW1azDukuX0U9E7GoYanNWtyNdS5+ 5+e9C3vl8nnMIfAPQi9nqQ0nyoA8xq8IG/OdqqF0MmseEeAZ6lflH2XdvWP3m3u2bizD ZzJ89/RnHKQR6xxRbsYw4r9YTbYaN8gxVkPlT29rupCxpXehYyCEQPfYJPxeHEnxnvyd ip5QrDFXuijJFP/O6opFnUYsmK0KI21IZbeXhe5ZsUozgoXha6li00XiFf8mByEScXpp 1RZA==
X-Google-DKIM-Signature v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:reply-to:date:message-id:subject :from:to:cc; bh=HsL2nh+5jo8tcYQofwrCSgvqwPn6YxziamF3k5UJ2AU=; b=BXOVkISEBh+YqCVMtaQ2VZv79HXP8eVW/mXNWN67SP3oYcBLuTGolSyeTGn5B5ob9W j7xRj8DRpuwU6s/rdGJBQm1koYCjCBciEWD7YUVdKBgvfTX1TeUu4NrJ4B8jmLp1pcqh gU1gE+6JgM5KHWdcpyoJny+lIQrZUeuFqVMF6ajMav71/T5lKV5TfxVIKgpd+Hyj5EZv QcF2qPkt7jyBMWAZJkYioID0DJCFNvJNuXM82KntJjKhCz8S4YVAZMLRbL0ZKA3q7pcJ 4yCF0wCc4a1ewRtWcRQJk9UAM+55aURI6SA61GB1unBE4WJQ1pWpJQ6g/YmA5lXaHEBB PrXA==
X-Gm-Message-State AD7BkJLeFKy1oHx7lLCLnKFRzPN8Hz+dwRiovLwfEhJiFiWb6HDaFxlSwRRLtomkn7GjEI5LsiiKvD1/NHeGXg==
X-Received by 10.129.84.194 with SMTP id i185mr1216452ywb.175.1460029416820; Thu, 07 Apr 2016 04:43:36 -0700 (PDT)
X-Mailman-Approved-At Thu, 07 Apr 2016 07:46:07 -0400
X-Content-Filtered-By Mailman/MimeDel 2.1.21
X-BeenThere python-announce-list@python.org
X-Mailman-Version 2.1.21
Precedence list
List-Id Announcement-only list for the Python programming language <python-announce-list.python.org>
List-Unsubscribe <https://mail.python.org/mailman/options/python-announce-list>, <mailto:python-announce-list-request@python.org?subject=unsubscribe>
List-Archive <http://mail.python.org/pipermail/python-announce-list/>
List-Post <mailto:python-announce-list@python.org>
List-Help <mailto:python-announce-list-request@python.org?subject=help>
List-Subscribe <https://mail.python.org/mailman/listinfo/python-announce-list>, <mailto:python-announce-list-request@python.org?subject=subscribe>
X-Mailman-Original-Message-ID <CAFrp1voqj6PuKihExFT2=MJtW1-76DppC_tX-TipXFnjZ1uEyA@mail.gmail.com>
Xref csiph.com comp.lang.python.announce:2102

Show key headers only | View raw


=============================
Announcing python-blosc 1.3.1
=============================

What is new?
============

This is an important release in terms of stability.  Now, the -O1 flag
for compiling the included C-Blosc sources on Linux.  This represents
slower performance, but fixes the nasty issue #110.  In case maximum
speed is needed, please `compile python-blosc with an external C-Blosc
library <
https://github.com/Blosc/python-blosc#compiling-with-an-installed-blosc-library-recommended
)>`_.

Also, symbols like BLOSC_MAX_BUFFERSIZE have been replaced for allowing
backward compatibility with python-blosc 1.2.x series.

For whetting your appetite, look at some benchmarks here:

https://github.com/Blosc/python-blosc#benchmarking

For more info, you can have a look at the release notes in:

https://github.com/Blosc/python-blosc/blob/master/RELEASE_NOTES.rst

More docs and examples are available in the documentation site:

http://python-blosc.blosc.org


What is it?
===========

Blosc (http://www.blosc.org) is a high performance compressor optimized
for binary data.  It has been designed to transmit data to the processor
cache faster than the traditional, non-compressed, direct memory fetch
approach via a memcpy() OS call.  Blosc works well for compressing
numerical arrays that contains data with relatively low entropy, like
sparse data, time series, grids with regular-spaced values, etc.

python-blosc (http://python-blosc.blosc.org/) is the Python wrapper for
the Blosc compression library, with added functions (`compress_ptr()`
and `pack_array()`) for efficiently compressing NumPy arrays, minimizing
the number of memory copies during the process.  python-blosc can be
used to compress in-memory data buffers for transmission to other
machines, persistence or just as a compressed cache.

There is also a handy tool built on top of python-blosc called Bloscpack
(https://github.com/Blosc/bloscpack). It features a commmand line
interface that allows you to compress large binary datafiles on-disk.
It also comes with a Python API that has built-in support for
serializing and deserializing Numpy arrays both on-disk and in-memory at
speeds that are competitive with regular Pickle/cPickle machinery.


Sources repository
==============

The sources and documentation are managed through github services at:

http://github.com/Blosc/python-blosc


----

  **Enjoy data!**

-- 
Francesc Alted

Back to comp.lang.python.announce | Previous | Next | Find similar | Unroll thread


Thread

ANN: python-blosc 1.3.1 Francesc Alted <faltet@gmail.com> - 2016-04-07 13:43 +0200

csiph-web