Re: CRC-checksum failed in gzip

Path	csiph.com!usenet.pasdenom.info!news.albasani.net!newsfeed.freenet.ag!news2.euro.net!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
Return-Path	<andrea.crotti.0@gmail.com>
X-Original-To	python-list@python.org
Delivered-To	python-list@mail.python.org
X-Spam-Status	OK 0.004
X-Spam-Evidence	'H': 0.99; 'S': 0.00; 'exception': 0.03; 'area)': 0.09; 'fails.': 0.09; 'ioerror:': 0.09; 'received:mail- lpp01m010-f46.google.com': 0.09; 'cc:addr:python-list': 0.10; 'thread': 0.11; '67,': 0.16; 'reproduce': 0.16; 'rewriting': 0.16; 'scratch': 0.16; 'subject:failed': 0.16; 'skip:" 40': 0.20; 'written': 0.20; 'cc:20': 0.23; 'seems': 0.23; 'cc:no real name:20': 0.24; 'linux': 0.24; 'cc:addr:python.org': 0.25; 'header:In-Reply-To:1': 0.25; '(most': 0.27; '(we': 0.27; 'skip:" 50': 0.27; 'message-id:@mail.gmail.com': 0.27; 'run': 0.28; '204,': 0.29; 'skip:_ 10': 0.29; 'received:209.85.215.46': 0.30; 'error': 0.30; 'checked': 0.30; 'file': 0.32; 'skip:s 30': 0.33; 'traceback': 0.33; "can't": 0.34; 'program,': 0.34; 'received:google.com': 0.34; 'clear': 0.35; 'open': 0.35; 'received:209.85': 0.35; 'there': 0.35; 'really': 0.36; 'but': 0.36; 'received:209': 0.37; 'subject:: ': 0.38; 'nothing': 0.38; 'subject:-': 0.40; 'header:Received:5': 0.40; 'skip:u 10': 0.60; 'percentage,': 0.84; 'self.run()': 0.84; 'ages': 0.91
DKIM-Signature	v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=6SW4iHDQJ552a18R3kD/dhZOPrAjjlY55EJLavWr7Tc=; b=AnrAOx9ilM6GaZjCUldAPXh0E0FUpvKOLONdpUafowwgK20sC1LUZiVEtxi+1albBZ 6j4QvoW1g2cljCfIb8d+x95OU5ff7JSxgBlb2RJ71vs5O7k1KLY+vX556DKX0/U2Gk9C fZjE9PXGLprPxgGyDU98iFFeGb78SZT7IrRvGUgqzIKH9qmwMOVyWabFjIkBUNqgX1d2 upKFma8dLPfeSuTlFLqcLX4kgJLN8czAnvVqZC+1gl1KQeA4ry8slMxWOJzn9rRWhSFl xn5W086lFFGyTrzq1ld7vbt12av+7FGgEUw60ahp3XJQOJ0YZ5BCuQfaB+CBPM/Fc60x zwKA==
MIME-Version	1.0
In-Reply-To	<50190ED6.1040100@shopzeus.com>
References	<CAF_E5JahAZ4w3em_aqBbx63pxiTU-nqtRLZWb5_jRQr2yqhRWA@mail.gmail.com> <50190ED6.1040100@shopzeus.com>
Date	Wed, 1 Aug 2012 14:01:45 +0100
Subject	Re: CRC-checksum failed in gzip
From	andrea crotti <andrea.crotti.0@gmail.com>
To	Laszlo Nagy <gandalf@shopzeus.com>
Content-Type	text/plain; charset=ISO-8859-1
Cc	python-list@python.org
X-BeenThere	python-list@python.org
X-Mailman-Version	2.1.12
Precedence	list
List-Id	General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe	<http://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive	<http://mail.python.org/pipermail/python-list>
List-Post	<mailto:python-list@python.org>
List-Help	<mailto:python-list-request@python.org?subject=help>
List-Subscribe	<http://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups	comp.lang.python
Message-ID	<mailman.2825.1343826107.4697.python-list@python.org> (permalink)
Lines	39
NNTP-Posting-Host	2001:888:2000:d::a6
X-Trace	1343826108 news.xs4all.nl 6860 [2001:888:2000:d::a6]:52202
X-Complaints-To	abuse@xs4all.nl
Xref	csiph.com comp.lang.python:26356

Show key headers only | View raw

Full traceback:

Exception in thread Thread-8:
Traceback (most recent call last):
  File "/user/sim/python/lib/python2.7/threading.py", line 530, in
__bootstrap_inner
    self.run()
  File "/user/sim/tests/llif/AutoTester/src/AutoTester2.py", line 67, in run
    self.processJobData(jobData, logger)
  File "/user/sim/tests/llif/AutoTester/src/AutoTester2.py", line 204,
in processJobData
    self.run_simulator(area, jobData[1] ,log)
  File "/user/sim/tests/llif/AutoTester/src/AutoTester2.py", line 142,
in run_simulator
    report_file, percentage, body_text = SimResults.copy_test_batch(log, area)
  File "/user/sim/tests/llif/AutoTester/src/SimResults.py", line 274,
in copy_test_batch
    out2_lines = out2.read()
  File "/user/sim/python/lib/python2.7/gzip.py", line 245, in read
    self._read(readsize)
  File "/user/sim/python/lib/python2.7/gzip.py", line 316, in _read
    self._read_eof()
  File "/user/sim/python/lib/python2.7/gzip.py", line 338, in _read_eof
    hex(self.crc)))
IOError: CRC check failed 0x4f675fba != 0xa9e45aL


- The file is written with the linux gzip program.
- no I can't reproduce the error with the same exact file that did
failed, that's what is really puzzling,
  there seems to be no clear pattern and just randmoly fails. The file
is also just open for read from this program,
  so in theory no way that it can be corrupted.

  I also checked with lsof if there are processes that opened it but
nothing appears..

- can't really try on the local disk, might take ages unfortunately
(we are rewriting this system from scratch anyway)

Back to comp.lang.python | Previous | Next — Next in thread | Find similar | Unroll thread

Thread

Re: CRC-checksum failed in gzip andrea crotti <andrea.crotti.0@gmail.com> - 2012-08-01 14:01 +0100
  Re: CRC-checksum failed in gzip Steven D'Aprano <steve+comp.lang.python@pearwood.info> - 2012-08-01 16:17 +0000
    Re: CRC-checksum failed in gzip andrea crotti <andrea.crotti.0@gmail.com> - 2012-08-01 17:38 +0100
    Re: CRC-checksum failed in gzip Laszlo Nagy <gandalf@shopzeus.com> - 2012-08-01 19:05 +0200
    Re: CRC-checksum failed in gzip andrea crotti <andrea.crotti.0@gmail.com> - 2012-08-01 18:17 +0100
    Re: CRC-checksum failed in gzip Laszlo Nagy <gandalf@shopzeus.com> - 2012-08-01 19:57 +0200
      Re: CRC-checksum failed in gzip Ulrich Eckhardt <ulrich.eckhardt@dominolaser.com> - 2012-08-02 10:49 +0200
        Re: CRC-checksum failed in gzip Laszlo Nagy <gandalf@shopzeus.com> - 2012-08-02 12:14 +0200
    Re: CRC-checksum failed in gzip andrea crotti <andrea.crotti.0@gmail.com> - 2012-08-02 10:26 +0100
    Re: CRC-checksum failed in gzip Laszlo Nagy <gandalf@shopzeus.com> - 2012-08-02 12:21 +0200
    Re: CRC-checksum failed in gzip andrea crotti <andrea.crotti.0@gmail.com> - 2012-08-02 11:57 +0100
    Re: CRC-checksum failed in gzip andrea crotti <andrea.crotti.0@gmail.com> - 2012-08-02 11:59 +0100

csiph-web