Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.lang.python > #102806

Re: tarfile : read from a socket?

Path csiph.com!fu-berlin.de!uni-berlin.de!not-for-mail
From Chris Angelico <rosuav@gmail.com>
Newsgroups comp.lang.python
Subject Re: tarfile : read from a socket?
Date Fri, 12 Feb 2016 00:18:04 +1100
Lines 29
Message-ID <mailman.48.1455196694.22075.python-list@python.org> (permalink)
References <n9hgtb$rls$1@news2.informatik.uni-stuttgart.de> <mailman.43.1455187713.22075.python-list@python.org> <n9i07l$vgl$1@news2.informatik.uni-stuttgart.de>
Mime-Version 1.0
Content-Type text/plain; charset=UTF-8
X-Trace news.uni-berlin.de xSSjEOFsecFxaZfUChZAwAPdRkKLxnbKChXSEnRz2+Wg==
Return-Path <rosuav@gmail.com>
X-Original-To python-list@python.org
Delivered-To python-list@mail.python.org
X-Spam-Status OK 0.024
X-Spam-Evidence '*H*': 0.95; '*S*': 0.00; 'cc:addr:python-list': 0.09; '__init__': 0.09; 'mode,': 0.09; 'thu,': 0.15; '2016': 0.16; 'from:addr:rosuav': 0.16; 'from:name:chris angelico': 0.16; 'received:io': 0.16; 'received:psf.io': 0.16; 'sock': 0.16; 'tarfile': 0.16; 'wrote:': 0.16; 'attribute': 0.18; 'have:': 0.18; 'cc:2**0': 0.20; 'cc:addr:python.org': 0.20; 'skip:" 30': 0.20; 'file.': 0.22; 'feb': 0.23; '(most': 0.24; 'header:In-Reply-To:1': 0.24; 'message-id:@mail.gmail.com': 0.27; "skip:' 10": 0.28; '**kwargs)': 0.29; 'subject: : ': 0.30; 'skip:s 30': 0.31; 'skip:t 50': 0.32; 'traceback': 0.33; 'open': 0.33; 'file': 0.34; 'received:google.com': 0.35; 'but': 0.36; 'should': 0.36; 'received:209.85': 0.36; 'possible': 0.36; 'subject:?': 0.36; 'pm,': 0.36; 'subject:: ': 0.37; 'received:209.85.213': 0.37; 'received:209': 0.38; 'subject:from': 0.39; "didn't": 0.39; 'build': 0.40; 'more': 0.63; 'content,': 0.66; 'sounds': 0.76; 'chrisa': 0.84; 'subject:read': 0.84; 'upstream': 0.84; 'to:none': 0.91; 'glance': 0.91
DKIM-Signature v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:cc :content-type; bh=EcXpecg0ckDOVHjXsA/SQc+hJB+5i5rw+P8mciuBt6o=; b=VwxDAxdwQEzLQPe0aaInOzriW88wFmbhazXbApXS/o/VyR1ml0GRwW6AbBO9IGOppE WQAvlS69dODtJ2g+ohOqKaEfWKjw4a4UAPG2Lf6OKNDkUMz55g3MCoGaArDA6NVI9DFQ Wa2DvqTosAZNGNlCH/YRjH78rVaww5oFi9rEoKXwxYB4fX+nEyjFj1lgiLRZKZzuussw Peinpfbg/8MJomQIuHWdZIZp5UdnRWsKLzvl1JsCHpC0gV00U3bZKkNoEuHu+Iu019cn c2gyL8gP0eVErxzdrNbNtOBwYjgJAX7Tkf49wFjFEBU9XNkhsaHBQd2wlp3GGmZdwlQc aIpQ==
X-Google-DKIM-Signature v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:cc:content-type; bh=EcXpecg0ckDOVHjXsA/SQc+hJB+5i5rw+P8mciuBt6o=; b=IxsYGmHVy3Na9sJekBuQDQ1q17jmXLz6uOLPh44M1QT0eAjIfeJ9LW1WpQRT/z7i+8 edj03fXhy6UhcRVgUpmkC1H1phAwi5ZF3QtQMKDTY3WwKAeu9BrXqslUrTGkKBpGkVox A3OUaixyGiV2ToUihWr+Cw2w8ieS8Ok7YCdEg5/u3y+p1wHlUfRTdn2EsSCxG51uRJu8 TwkDbJ/w33k2wpHPH0eQltrFkGricjvQ8c0T/8grjTl11r9bV8YpThj5dfLWORf5l9II KWFmKG2JP1qwr2Wr3PQRTPc0/4KJS+9u2nmBrIAOf5WXxWnnwrr2onKY9vfCKe8Deer7 e5CQ==
X-Gm-Message-State AG10YOT3u/sQeETz/lw1K/VxT4mkGYpEA9HFm6EvSPFvVlenkFkWHfTqCw4gfzUpC3COgR4wAqV2DWx/PO2w6w==
X-Received by 10.50.176.195 with SMTP id ck3mr16985498igc.94.1455196684776; Thu, 11 Feb 2016 05:18:04 -0800 (PST)
In-Reply-To <n9i07l$vgl$1@news2.informatik.uni-stuttgart.de>
X-BeenThere python-list@python.org
X-Mailman-Version 2.1.21rc2
Precedence list
List-Id General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe <https://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive <http://mail.python.org/pipermail/python-list/>
List-Post <mailto:python-list@python.org>
List-Help <mailto:python-list-request@python.org?subject=help>
List-Subscribe <https://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Xref csiph.com comp.lang.python:102806

Show key headers only | View raw

On Thu, Feb 11, 2016 at 11:53 PM, Ulli Horlacher
<framstag@rus.uni-stuttgart.de> wrote:
> I have:
>
>   sock = socket.create_connection((server,port))
>   bs = kB64
>   taro = tarfile.open(fileobj=sock.makefile('w',kB64),mode='w')
>
>
>
> Traceback (most recent call last):
>   (...)
>   File "./fexit.py", line 1838, in sex_send
>     taro = tarfile.open(fileobj=sock.makefile('w',kB64),mode='w')
>   File "/usr/lib/python2.7/tarfile.py", line 1695, in open
>     return cls.taropen(name, mode, fileobj, **kwargs)
>   File "/usr/lib/python2.7/tarfile.py", line 1705, in taropen
>     return cls(name, mode, fileobj, **kwargs)
>   File "/usr/lib/python2.7/tarfile.py", line 1566, in __init__
>     self.offset = self.fileobj.tell()
> AttributeError: '_fileobject' object has no attribute 'tell'

Sounds like tarfile needs a seekable file. How big is this file you're
reading? Can you simply read the whole thing into memory, then use
io.BytesIO? I had a quick glance at help(BytesIO) but didn't find a
simple way to make a buffer that reads from an upstream file when it
needs more content, but it should be possible to build one.

ChrisA

Back to comp.lang.python | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread

Thread

tarfile : read from a socket? Ulli Horlacher <framstag@rus.uni-stuttgart.de> - 2016-02-11 08:31 +0000
  Re: tarfile : read from a socket? INADA Naoki <songofacandy@gmail.com> - 2016-02-11 19:26 +0900
  Re: tarfile : read from a socket? Antoon Pardon <antoon.pardon@rece.vub.ac.be> - 2016-02-11 11:47 +0100
    Re: tarfile : read from a socket? Ulli Horlacher <framstag@rus.uni-stuttgart.de> - 2016-02-11 12:53 +0000
      Re: tarfile : read from a socket? MRAB <python@mrabarnett.plus.com> - 2016-02-11 13:16 +0000
      Re: tarfile : read from a socket? Chris Angelico <rosuav@gmail.com> - 2016-02-12 00:18 +1100
        Re: tarfile : read from a socket? Ulli Horlacher <framstag@rus.uni-stuttgart.de> - 2016-02-11 13:34 +0000
      Re: tarfile : read from a socket? Ulli Horlacher <framstag@rus.uni-stuttgart.de> - 2016-02-11 13:25 +0000
        Re: tarfile : read from a socket? Ulli Horlacher <framstag@rus.uni-stuttgart.de> - 2016-02-11 16:41 +0000
          Re: tarfile : read from a socket? MRAB <python@mrabarnett.plus.com> - 2016-02-11 17:10 +0000
          modifying a standard module? (was: Re: tarfile : read from a socket?) Ulli Horlacher <framstag@rus.uni-stuttgart.de> - 2016-02-11 17:10 +0000
            Re: modifying a standard module? (was: Re: tarfile : read from a socket?) Matt Wheeler <m@funkyhat.org> - 2016-02-12 20:53 +0000
              Re: modifying a standard module? Ulli Horlacher <framstag@rus.uni-stuttgart.de> - 2016-02-12 22:46 +0000
                Re: modifying a standard module? Paul Rubin <no.email@nospam.invalid> - 2016-02-12 16:21 -0800
          Re: tarfile : read from a socket? Peter Otten <__peter__@web.de> - 2016-02-11 18:18 +0100
          Re: tarfile : read from a socket? Lars Gustäbel <lars@gustaebel.de> - 2016-02-11 18:27 +0100
          Re: tarfile : read from a socket? Random832 <random832@fastmail.com> - 2016-02-11 16:23 -0500
          Re: tarfile : read from a socket? Antoon Pardon <antoon.pardon@rece.vub.ac.be> - 2016-02-12 09:35 +0100
          Re: tarfile : read from a socket? Lars Gustäbel <lars@gustaebel.de> - 2016-02-12 09:40 +0100
            Re: tarfile : read from a socket? Ulli Horlacher <framstag@rus.uni-stuttgart.de> - 2016-02-12 12:48 +0000

csiph-web