Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.soft-sys.math.mathematica > #16104

Re: How to read 12 bits from a stream ?

From Vince Virgilio <blueschi@gmail.com>
Newsgroups comp.soft-sys.math.mathematica
Subject Re: How to read 12 bits from a stream ?
Date 2013-10-24 03:33 +0000
Message-ID <l4a4df$afb$1@smc.vnet.net> (permalink)
References <l450c4$shl$1@smc.vnet.net>
Organization Time-Warner Telecom

Show all headers | View raw


Some sketchy advice . . .

16.1 MB is a tiny amount of data.

I'd read the entire file into a string, e.g. Import[filename, "String"], then to bytes with ToCharacterCode, then use logical bit operations to extract your bit-fields.

Here's some code that might help you think about the problem. It assumes the binary data from ToCharacterCode has been paired up into words (from original bytes). So bLo and bHi are in [1, 16]. The code is listable. It can be very efficient if your data can be broken into a sequence of 'records' of identical length. Put the offset within a record in first dimension and the record # in the second dimension.

left[n_][b_] := BitShiftLeft[b, n];

right[n_][b_] := BitShiftRight[b, n];

(* n is # bits, p is zero-based position *)
mask[n_, p_][b_] := BitAnd[b, left[p][2^n - 1]] // right[p];

toU16[{b1_, b2_, ___}] := left[8]@b1 + b2;

toU32[{w1_, w2_, ___}] := left[16]@w1 + w2;

field[w_, b_][data_] := field[w, {b, b}][data];

(* bLo, bHi in [1, 16] *)
field[w_, {bLo_, bHi_}][data_] :=
  data[[w]] // mask[bHi - bLo + 1, 16 - bHi];

Vince

On Tuesday, October 22, 2013 12:53:24 AM UTC-4, J=E1nos L=F6bb wrote:
> Hi,
>
>
>
> I am trying to read a mixed file - binary and text -  with OpenRead and Read and BinaryRead, but I am not seeing a seek option, that is to move the pointer inside the file where I want it to be.  Of course I can do a read in a loop with a counter, but I hoped there is a better way to do it.
>
>
>
> The file is 16.1MB, the first 912 elements are characters and binary mixed, followed by 16MB binary section.  The binary in this second section is  packed in the way that 2 times 12 bits  of little endian value is packed into 3 bytes.  I need to unpack them and put them into big endian order.  I am not seeing how can I read 12 bits at once with BinaryRead, it is aligned at the multiples of 8 bits.
>
>
>
> Any good tip ?
>
>
>
> Thanks ahead,
>
> J=E1nos

Back to comp.soft-sys.math.mathematica | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread


Thread

How to read 12 bits from a stream ? János Löbb <janos@lobb.com> - 2013-10-22 04:53 +0000
  Re: How to read 12 bits from a stream ? Vince Virgilio <blueschi@gmail.com> - 2013-10-24 03:33 +0000
  Re: How to read 12 bits from a stream ? roby <roby.nowak@gmail.com> - 2013-10-24 03:33 +0000

csiph-web