Path: csiph.com!feeder.erje.net!2.eu.feeder.erje.net!newsreader4.netcologne.de!news.netcologne.de!newsfeed0.kamp.net!newsfeed.kamp.net!fu-berlin.de!uni-berlin.de!not-for-mail From: Francesc Alted Newsgroups: comp.lang.python.announce Subject: ANN: python-blosc 1.3.0 released Date: Thu, 31 Mar 2016 19:30:26 +0200 Lines: 106 Approved: python-announce-list@python.org Message-ID: Reply-To: faltet@gmail.com Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 X-Trace: news.uni-berlin.de 996UOwOdBwIX9pwFg6jBuguSgDrYZc1Fv/VvRkcXGQAw== Return-Path: X-Original-To: python-announce-list@python.org Delivered-To: python-announce-list@mail.python.org X-Spam-Status: OK 0.000 X-Spam-Evidence: '*H*': 1.00; '*S*': 0.00; 'binary': 0.05; 'cache': 0.05; 'omit': 0.07; 'prefix': 0.07; 'pypi': 0.07; 'subject:ANN': 0.07; 'subject:released': 0.07; 'wrapper': 0.07; 'api': 0.09; '===========': 0.09; 'cc:addr:googlegroups.com': 0.09; 'codecs': 0.09; 'compression': 0.09; 'fetch': 0.09; 'filter,': 0.09; 'newest': 0.09; 'url:github': 0.09; 'url:rst': 0.09; 'python': 0.10; 'url:org)': 0.13; 'url:)': 0.14; 'subject:python': 0.14; 'licenses': 0.15; '1.3.0': 0.16; '==========': 0.16; 'alted': 0.16; 'compress': 0.16; 'datasets': 0.16; 'datasets.': 0.16; 'francesc': 0.16; 'from:addr:faltet': 0.16; 'from:name:francesc alted': 0.16; 'in-memory': 0.16; 'license.': 0.16; 'machinery.': 0.16; 'numpy': 0.16; 'received:io': 0.16; 'received:psf.io': 0.16; 'such,': 0.16; 'url:licenses': 0.16; 'url:py': 0.16; 'memory': 0.17; 'numerical': 0.18; 'processor': 0.18; 'skip:= 10': 0.18; 'cc:addr:python.org': 0.20; 'cc:2**1': 0.22; 'meant': 0.22; 'arrays': 0.22; 'expense': 0.22; 'see:': 0.22; 'skip:= 20': 0.22; 'examples': 0.24; 'install': 0.25; '----': 0.27; 'message- id:@mail.gmail.com': 0.27; 'data,': 0.27; 'interface': 0.29; 'regular': 0.29; 'cc:no real name:2**1': 0.29; 'allows': 0.30; 'call.': 0.30; 'at:': 0.31; 'run': 0.33; 'list': 0.34; 'received:google.com': 0.35; 'installing': 0.35; 'library.': 0.35; 'but': 0.36; 'there': 0.36; 'url:org': 0.36; 'tool': 0.36; 'received:209.85': 0.36; 'data.': 0.36; 'faster': 0.36; 'notes': 0.36; 'subject:: ': 0.37; 'being': 0.37; 'sources': 0.37; 'release': 0.37; 'received:209': 0.38; 'mailing': 0.38; 'data': 0.39; 'subject:-': 0.39; 'called': 0.40; 'some': 0.40; 'high': 0.60; 'competitive': 0.61; 'url:group': 0.61; 'details': 0.62; 'skip:n 10': 0.62; 'relatively': 0.63; 'more': 0.63; 'different': 0.63; 'url:pdf': 0.64; 'services': 0.67; 'header:Reply-To:1': 0.67; 'direct': 0.68; 'reply-to:no real name:2**0': 0.71; 'site:': 0.75; 'reply-to:addr:gmail.com': 0.76; 'url:es': 0.76; 'low': 0.83; '============': 0.84; 'internally.': 0.84; 'pip': 0.84; 'url:master': 0.84; 'announcing': 0.91; 'url:tutorial': 0.91; 'info,': 0.93; 'email addr:googlegroups.com': 0.95 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:reply-to:date:message-id:subject:from:to:cc; bh=eHQIKhEa7KlvNy/kVM/IHOS9L3cAmJVIT5EW3ZSDvtY=; b=yRO/vIzCoFWWsb2dTFjb8DATruolXdpBMhAgQTN1zPGHw8vOb5INMcWMkS1PKvuHjP QM0aK02Q4WIb4AvC+qJ0rncf3vcFf60y7rdGMOF3St0t240Xrs37EFbRVXYiJbbKm1Wn fxJThsdyicZ8Y3JGCX9mjlADJn4HJZSwbbVCZmERGuOQ6mQ7ZIIU3TOL3UzjzeUV1Kt7 7JiyzGyzaAbwTRxQIw0wDxdOOiiD8RWIW2N03LKm5P08Jq6OxhvUYalG7+03i/3P2Ce1 iakX9rixWqPQt4IdRpl9TVr2NS7N7a7+Ro8zSgwDj0d4gPFuUDnHG7RXX3DhKMDIXfra JKVQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:reply-to:date:message-id:subject :from:to:cc; bh=eHQIKhEa7KlvNy/kVM/IHOS9L3cAmJVIT5EW3ZSDvtY=; b=lIr//LLFw8eFoiKV1Cz9WwjQEgsFC+l5qcrJSICpBcnBQ8rr1L9lJCtQV7a0fBDBqU iETihj7RFOMIGoGt7RJGFkSVyBjT0LE3FH2Q2pIZ7nr9nFElOjxLjgI6lVlKpYemwCWr w3TlkFxoRf0TcE/0n5PW+ND8oB77aGZ3Kqt22V7xIOQiJR1CRdP7j6cS0td18nF7mYwu YjZdRzmt535Gz3GZBUOoLq2/Lvc6FGtGuERBJcWBLUgS0QQSp/MGWssw90Bo4SphwFRQ zzot1pHKrwkAh2hVul1jyozeXk4WfLxrPd3VA1kaOn+rBNJQ0BVOQj2lfeibSdZO/kBK ovxw== X-Gm-Message-State: AD7BkJKA7dWKiKc+d/2gHRlRuLPOcVWy6JXpIRjnjJAMx+nbW4EZbGKUWFUEAAd6n7qp30m+jnJOA7ucJssu/Q== X-Received: by 10.13.239.197 with SMTP id y188mr92380ywe.39.1459445426098; Thu, 31 Mar 2016 10:30:26 -0700 (PDT) X-Mailman-Approved-At: Thu, 31 Mar 2016 17:29:37 -0400 X-Content-Filtered-By: Mailman/MimeDel 2.1.21 X-BeenThere: python-announce-list@python.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Announcement-only list for the Python programming language List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Xref: csiph.com comp.lang.python.announce:2094 ============================= Announcing python-blosc 1.3.0 ============================= What is new? ============ There is support for newest C-Blosc. As such, C-Blosc 1.8.0 is being distributed internally. Support for the new `BITSHUFFLE` filter, allowing for more compression ratios in many cases, at the expense of some slowdown. For details see: http://python-blosc.blosc.org/tutorial.html#using-different-filters You can also run some benchmarks including different codecs and filters: https://github.com/Blosc/python-blosc/blob/master/bench/compress_ptr.py For more info, you can have a look at the release notes in: https://github.com/Blosc/python-blosc/blob/master/RELEASE_NOTES.rst More docs and examples are available in the documentation site: http://python-blosc.blosc.org What is it? =========== Blosc (http://www.blosc.org) is a high performance compressor optimized for binary data. It has been designed to transmit data to the processor cache faster than the traditional, non-compressed, direct memory fetch approach via a memcpy() OS call. Blosc is the first compressor that is meant not only to reduce the size of large datasets on-disk or in-memory, but also to accelerate object manipulations that are memory-bound (http://www.blosc.org/docs/StarvingCPUs.pdf). See http://www.blosc.org/synthetic-benchmarks.html for some benchmarks on how much speed it can achieve in some datasets. Blosc works well for compressing numerical arrays that contains data with relatively low entropy, like sparse data, time series, grids with regular-spaced values, etc. python-blosc (http://python-blosc.blosc.org/) is the Python wrapper for the Blosc compression library. There is also a handy tool built on Blosc called Bloscpack (https://github.com/Blosc/bloscpack). It features a commmand line interface that allows you to compress large binary datafiles on-disk. It also comes with a Python API that has built-in support for serializing and deserializing Numpy arrays both on-disk and in-memory at speeds that are competitive with regular Pickle/cPickle machinery. Installing ========== python-blosc is in PyPI repository, so installing it is easy: $ pip install -U blosc # yes, you must omit the 'python-' prefix Download sources ================ The sources are managed through github services at: http://github.com/Blosc/python-blosc Documentation ============= There is Sphinx-based documentation site at: http://python-blosc.blosc.org/ Mailing list ============ There is an official mailing list for Blosc at: blosc@googlegroups.com http://groups.google.es/group/blosc Licenses ======== Both Blosc and its Python wrapper are distributed using the MIT license. See: https://github.com/Blosc/python-blosc/blob/master/LICENSES for more details. ---- **Enjoy data!** -- Francesc Alted