Path: csiph.com!usenet.pasdenom.info!news.albasani.net!newsfeed.freenet.ag!news2.euro.net!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
Return-Path: <andrea.crotti.0@gmail.com>
X-Original-To: python-list@python.org
Delivered-To: python-list@mail.python.org
X-Spam-Status: OK 0.004
X-Spam-Evidence: '*H*': 0.99; '*S*': 0.00; 'exception': 0.03; 'area)': 0.09; 'fails.': 0.09; 'ioerror:': 0.09; 'received:mail- lpp01m010-f46.google.com': 0.09; 'cc:addr:python-list': 0.10; 'thread': 0.11; '67,': 0.16; 'reproduce': 0.16; 'rewriting': 0.16; 'scratch': 0.16; 'subject:failed': 0.16; 'skip:" 40': 0.20; 'written': 0.20; 'cc:2**0': 0.23; 'seems': 0.23; 'cc:no real name:2**0': 0.24; 'linux': 0.24; 'cc:addr:python.org': 0.25; 'header:In-Reply-To:1': 0.25; '(most': 0.27; '(we': 0.27; 'skip:" 50': 0.27; 'message-id:@mail.gmail.com': 0.27; 'run': 0.28; '204,': 0.29; 'skip:_ 10': 0.29; 'received:209.85.215.46': 0.30; 'error': 0.30; 'checked': 0.30; 'file': 0.32; 'skip:s 30': 0.33; 'traceback': 0.33; "can't": 0.34; 'program,': 0.34; 'received:google.com': 0.34; 'clear': 0.35; 'open': 0.35; 'received:209.85': 0.35; 'there': 0.35; 'really': 0.36; 'but': 0.36; 'received:209': 0.37; 'subject:: ': 0.38; 'nothing': 0.38; 'subject:-': 0.40; 'header:Received:5': 0.40; 'skip:u 10': 0.60; 'percentage,': 0.84; 'self.run()': 0.84; 'ages': 0.91
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=6SW4iHDQJ552a18R3kD/dhZOPrAjjlY55EJLavWr7Tc=; b=AnrAOx9ilM6GaZjCUldAPXh0E0FUpvKOLONdpUafowwgK20sC1LUZiVEtxi+1albBZ 6j4QvoW1g2cljCfIb8d+x95OU5ff7JSxgBlb2RJ71vs5O7k1KLY+vX556DKX0/U2Gk9C fZjE9PXGLprPxgGyDU98iFFeGb78SZT7IrRvGUgqzIKH9qmwMOVyWabFjIkBUNqgX1d2 upKFma8dLPfeSuTlFLqcLX4kgJLN8czAnvVqZC+1gl1KQeA4ry8slMxWOJzn9rRWhSFl xn5W086lFFGyTrzq1ld7vbt12av+7FGgEUw60ahp3XJQOJ0YZ5BCuQfaB+CBPM/Fc60x zwKA==
MIME-Version: 1.0
In-Reply-To: <50190ED6.1040100@shopzeus.com>
References: <CAF_E5JahAZ4w3em_aqBbx63pxiTU-nqtRLZWb5_jRQr2yqhRWA@mail.gmail.com> <50190ED6.1040100@shopzeus.com>
Date: Wed, 1 Aug 2012 14:01:45 +0100
Subject: Re: CRC-checksum failed in gzip
From: andrea crotti <andrea.crotti.0@gmail.com>
To: Laszlo Nagy <gandalf@shopzeus.com>
Content-Type: text/plain; charset=ISO-8859-1
Cc: python-list@python.org
X-BeenThere: python-list@python.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe: <http://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive: <http://mail.python.org/pipermail/python-list>
List-Post: <mailto:python-list@python.org>
List-Help: <mailto:python-list-request@python.org?subject=help>
List-Subscribe: <http://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups: comp.lang.python
Message-ID: <mailman.2825.1343826107.4697.python-list@python.org>
Lines: 39
NNTP-Posting-Host: 2001:888:2000:d::a6
X-Trace: 1343826108 news.xs4all.nl 6860 [2001:888:2000:d::a6]:52202
X-Complaints-To: abuse@xs4all.nl
Xref: csiph.com comp.lang.python:26356

Full traceback:

Exception in thread Thread-8:
Traceback (most recent call last):
  File "/user/sim/python/lib/python2.7/threading.py", line 530, in
__bootstrap_inner
    self.run()
  File "/user/sim/tests/llif/AutoTester/src/AutoTester2.py", line 67, in run
    self.processJobData(jobData, logger)
  File "/user/sim/tests/llif/AutoTester/src/AutoTester2.py", line 204,
in processJobData
    self.run_simulator(area, jobData[1] ,log)
  File "/user/sim/tests/llif/AutoTester/src/AutoTester2.py", line 142,
in run_simulator
    report_file, percentage, body_text = SimResults.copy_test_batch(log, area)
  File "/user/sim/tests/llif/AutoTester/src/SimResults.py", line 274,
in copy_test_batch
    out2_lines = out2.read()
  File "/user/sim/python/lib/python2.7/gzip.py", line 245, in read
    self._read(readsize)
  File "/user/sim/python/lib/python2.7/gzip.py", line 316, in _read
    self._read_eof()
  File "/user/sim/python/lib/python2.7/gzip.py", line 338, in _read_eof
    hex(self.crc)))
IOError: CRC check failed 0x4f675fba != 0xa9e45aL


- The file is written with the linux gzip program.
- no I can't reproduce the error with the same exact file that did
failed, that's what is really puzzling,
  there seems to be no clear pattern and just randmoly fails. The file
is also just open for read from this program,
  so in theory no way that it can be corrupted.

  I also checked with lsof if there are processes that opened it but
nothing appears..

- can't really try on the local disk, might take ages unfortunately
(we are rewriting this system from scratch anyway)