Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]
Groups > comp.lang.python.announce > #653
| Path | csiph.com!usenet.pasdenom.info!goblin2!goblin.stu.neva.ru!feeder1.cambriumusenet.nl!feed.tweaknews.nl!194.109.133.84.MISMATCH!newsfeed.xs4all.nl!newsfeed5.news.xs4all.nl!xs4all!post.news.xs4all.nl!not-for-mail |
|---|---|
| Return-Path | <francesc@continuum.io> |
| X-Original-To | python-announce-list@python.org |
| Delivered-To | python-announce-list@mail.python.org |
| X-Spam-Status | OK 0.000 |
| X-Spam-Evidence | '*H*': 1.00; '*S*': 0.00; '---------': 0.05; 'binary': 0.05; 'cache': 0.05; 'memory.': 0.05; 'repository': 0.05; '64-bit': 0.07; 'see:': 0.07; 'subject:ANN': 0.07; 'subject:released': 0.07; '(although': 0.09; '32-bit': 0.09; 'compression': 0.09; 'enhancements': 0.09; 'internally': 0.09; 'moreover,': 0.09; 'url:github': 0.09; 'contribute': 0.10; 'yet.': 0.13; 'library': 0.15; 'alted': 0.16; 'container.': 0.16; 'francesc': 0.16; 'from:name:francesc alted': 0.16; 'in-memory': 0.16; 'numpy': 0.16; 'too).': 0.16; 'library,': 0.17; 'numerical': 0.17; '(in': 0.18; 'systems.': 0.18; 'memory': 0.18; 'subject:] ': 0.19; 'windows': 0.19; 'addition,': 0.21; 'received:mail- bk0-f46.google.com': 0.22; 'skip:= 20': 0.22; "user's": 0.22; 'allows': 0.25; 'least': 0.25; 'header:User-Agent:1': 0.26; '----------': 0.26; 'url:wiki': 0.26; '----': 0.27; 'implemented': 0.27; 'disk': 0.27; 'format,': 0.27; 'instead.': 0.27; 'list:': 0.27; 'received:209.85.214.46': 0.27; '0.5': 0.29; 'container': 0.29; 'declared': 0.29; 'fast.': 0.29; 'proposing': 0.29; 'vector': 0.29; 'url:download': 0.29; 'source': 0.29; "skip:' 10": 0.30; 'notes': 0.30; 'performing': 0.30; 'query': 0.30; 'at:': 0.31; 'good.': 0.32; 'platforms.': 0.33; 'operations': 0.33; 'typically': 0.33; 'version': 0.34; 'received:google.com': 0.34; 'done': 0.34; 'described': 0.35; 'doing': 0.35; 'received:209.85': 0.35; 'url:org': 0.36; 'data.': 0.36; 'test': 0.36; 'operating': 0.36; 'subject:[': 0.37; 'resources': 0.37; 'received:209': 0.37; 'data': 0.37; 'from:': 0.38; 'supports': 0.38; 'url:docs': 0.38; 'several': 0.39; 'to:addr:python.org': 0.39; 'received:209.85.214': 0.39; 'release': 0.39; 'space': 0.39; 'where': 0.40; 'header:Received:5': 0.40; 'your': 0.60; 'url:group': 0.60; 'url:5': 0.61; 'introduction': 0.62; 'different': 0.63; 'more': 0.63; 'visit': 0.64; 'carried': 0.65; 'to:addr:python-announce-list': 0.65; 'forward': 0.66; 'levels': 0.66; 'home': 0.66; 'advantages': 0.71; 'announcing': 0.91; 'info,': 0.91; 'email addr:googlegroups.com': 0.95; 'reducing': 0.95 |
| X-Google-DKIM-Signature | v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:subject :content-type:content-transfer-encoding:x-gm-message-state; bh=B7zXO1/60FYYrl117Ay1iNozwkjKatVxexlfaSkGyhw=; b=MJPZw2+Xtq8s5V1qFiCrzoF0WlMkkzoYc+bAtmTyaNYz+BgI7OBQLKHJgU2f0yJVFn B1pxYyvj3t5PVdX5tD/QwLTLK2NiMQue36f8SYKjTMTHDX0jP8T2+VJkUkDnFfSFKlwO 4yfFS6AIYf1QxyM+FKbWQjPlSgTXX5pkA+d8HGm0i5lijmE86JjRiqSggpo7bObEnouu uljH/0E3Ty6zQ7kuSh8WsXhFtAaZS129L6ze2QAhK61r7pcwlKy12uWmyUsfXckKmMZs M6sO2s60GPI6tp3Jhnq8dyJBJnDbKAXVZCE1dHJtYWAp5E6vVuybruZlK7tpV00RDUxn JBQQ== |
| Date | Tue, 21 Aug 2012 20:33:37 +0200 |
| From | Francesc Alted <francesc@continuum.io> |
| User-Agent | Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:14.0) Gecko/20120713 Thunderbird/14.0 |
| MIME-Version | 1.0 |
| To | python-announce-list@python.org |
| Subject | [ANN] carray 0.5 released |
| Content-Type | text/plain; charset=ISO-8859-1; format=flowed |
| Content-Transfer-Encoding | 7bit |
| X-Gm-Message-State | ALoCoQnfxF20xr5kcmWcTPDCY8J5I9NDc97LUQuVfOJ/rM5Qquucmcp9ZivR9WnfpAQXuihN6loh |
| X-Mailman-Approved-At | Tue, 21 Aug 2012 22:22:49 +0200 |
| X-BeenThere | python-announce-list@python.org |
| X-Mailman-Version | 2.1.12 |
| Precedence | list |
| Reply-To | python-list@python.org |
| List-Id | Announcement-only list for the Python programming language <python-announce-list.python.org> |
| List-Unsubscribe | <http://mail.python.org/mailman/options/python-announce-list>, <mailto:python-announce-list-request@python.org?subject=unsubscribe> |
| List-Archive | <http://mail.python.org/pipermail/python-announce-list> |
| List-Post | <mailto:python-announce-list@python.org> |
| List-Help | <mailto:python-announce-list-request@python.org?subject=help> |
| List-Subscribe | <http://mail.python.org/mailman/listinfo/python-announce-list>, <mailto:python-announce-list-request@python.org?subject=subscribe> |
| Approved | python-announce-list@python.org |
| Newsgroups | comp.lang.python.announce |
| Message-ID | <mailman.3618.1345580570.4697.python-announce-list@python.org> (permalink) |
| Lines | 77 |
| NNTP-Posting-Host | 2001:888:2000:d::a6 |
| X-Trace | 1345580570 news.xs4all.nl 6857 [2001:888:2000:d::a6]:45723 |
| X-Complaints-To | abuse@xs4all.nl |
| Xref | csiph.com comp.lang.python.announce:653 |
Show key headers only | View raw
Announcing carray 0.5
=====================
What's new
----------
carray 0.5 supports completely transparent storage on-disk in addition
to memory. That means that everything that can be done with an
in-memory container can be done using the disk instead.
The advantages of a disk-based container is that your addressable space
is much larger than just your available memory. Also, as carray is
based on a chunked and compressed data layout based on the super-fast
Blosc compression library, and the different cache levels existing in
both modern operating systems and the internal carray machinery, the
data access speed is very good.
The format chosen for the persistence layer is based on the 'bloscpack'
library (thanks to Valentin Haenel for his inspiration) and described in
'persistence.rst', although not everything has been implemented yet.
You may want to contribute by proposing enhancements to it. See:
https://github.com/FrancescAlted/carray/wiki/PersistenceProposal
CAVEAT: The bloscpack format is still evolving, so don't trust on
forward compatibility of the format, at least until 1.0, where the
internal format will be declared frozen.
For more detailed info, see the release notes in:
https://github.com/FrancescAlted/carray/wiki/Release-0.5
What it is
----------
carray is a chunked container for numerical data. Chunking allows for
efficient enlarging/shrinking of data container. In addition, it can
also be compressed for reducing memory/disk needs. The compression
process is carried out internally by Blosc, a high-performance
compressor that is optimized for binary data.
carray can use numexpr internally so as to accelerate many vector and
query operations (although it can use pure NumPy for doing so too).
numexpr can use optimize the memory usage and use several cores for
doing the computations, so it is blazing fast. Moreover, with the
introduction of a carray/ctable disk-based container (in version 0.5),
it can be used for seamlessly performing out-of-core computations.
carray comes with an exhaustive test suite and fully supports both
32-bit and 64-bit platforms. Also, it is typically tested on both UNIX
and Windows operating systems.
Resources
---------
Visit the main carray site repository at:
http://github.com/FrancescAlted/carray
You can download a source package from:
http://carray.pytables.org/download
Manual:
http://carray.pytables.org/docs/manual
Home of Blosc compressor:
http://blosc.pytables.org
User's mail list:
carray@googlegroups.com
http://groups.google.com/group/carray
----
Enjoy!
--
Francesc Alted
Back to comp.lang.python.announce | Previous | Next | Find similar | Unroll thread
[ANN] carray 0.5 released Francesc Alted <francesc@continuum.io> - 2012-08-21 20:33 +0200
csiph-web