Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.lang.python > #26350

Re: CRC-checksum failed in gzip

Path csiph.com!usenet.pasdenom.info!gegeweb.org!usenet-fr.net!nerim.net!novso.com!news2.euro.net!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
Return-Path <gandalf@shopzeus.com>
X-Original-To python-list@python.org
Delivered-To python-list@mail.python.org
X-Spam-Status OK 0.006
X-Spam-Evidence '*H*': 0.99; '*S*': 0.00; 'that?': 0.05; 'computed': 0.07; 'python': 0.09; 'bytes)': 0.09; 'eof': 0.09; 'truncate': 0.09; 'file,': 0.15; '(last': 0.16; 'flushed': 0.16; 'marker': 0.16; 'possible?': 0.16; 'program?': 0.16; 'reproduce': 0.16; 'subject:failed': 0.16; 'file.': 0.20; 'written': 0.20; 'error.': 0.21; 'work.': 0.23; 'thus': 0.24; 'header:In-Reply-To:1': 0.25; 'header:User-Agent:1': 0.26; "doesn't": 0.28; 'actual': 0.28; 'run': 0.28; 'trigger': 0.29; 'source': 0.29; "i'm": 0.29; 'error': 0.30; 'code': 0.31; 'file': 0.32; 'could': 0.32; 'right?': 0.33; 'traceback': 0.33; 'problem': 0.33; 'to:addr :python-list': 0.33; 'another': 0.33; "can't": 0.34; 'problem,': 0.35; 'saved': 0.35; 'doing': 0.35; 'sometimes': 0.35; 'there': 0.35; 'but': 0.36; 'generation': 0.36; 'subject:: ': 0.38; 'files': 0.38; 'some': 0.38; 'to:addr:python.org': 0.39; 'received:192': 0.39; 'received:192.168': 0.40; 'subject:-': 0.40; 'end': 0.40; 'think': 0.40; 'your': 0.60; 'making': 0.64; 'reached': 0.65; 'drive,': 0.65; 'received:204': 0.72; 'nfs': 0.84
Date Wed, 01 Aug 2012 13:11:18 +0200
From Laszlo Nagy <gandalf@shopzeus.com>
User-Agent Mozilla/5.0 (X11; Linux x86_64; rv:14.0) Gecko/20120714 Thunderbird/14.0
MIME-Version 1.0
To python-list@python.org
Subject Re: CRC-checksum failed in gzip
References <CAF_E5JahAZ4w3em_aqBbx63pxiTU-nqtRLZWb5_jRQr2yqhRWA@mail.gmail.com>
In-Reply-To <CAF_E5JahAZ4w3em_aqBbx63pxiTU-nqtRLZWb5_jRQr2yqhRWA@mail.gmail.com>
Content-Type text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding 7bit
X-BeenThere python-list@python.org
X-Mailman-Version 2.1.12
Precedence list
List-Id General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe <http://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive <http://mail.python.org/pipermail/python-list>
List-Post <mailto:python-list@python.org>
List-Help <mailto:python-list-request@python.org?subject=help>
List-Subscribe <http://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups comp.lang.python
Message-ID <mailman.2820.1343819483.4697.python-list@python.org> (permalink)
Lines 26
NNTP-Posting-Host 2001:888:2000:d::a6
X-Trace 1343819483 news.xs4all.nl 6938 [2001:888:2000:d::a6]:53430
X-Complaints-To abuse@xs4all.nl
Xref csiph.com comp.lang.python:26350

Show key headers only | View raw


> very simple right? But sometimes we get a checksum error.
Do you have a traceback showing the actual error?

>
>   - CRC is at the end of the file and is computed against the whole
> file (last 8 bytes)
>   - after the CRC there is the \0000 marker for the EOF
>   - readline() doesn't trigger the checksum generation in the
> beginning, but only when the EOF is reached
>   - until a file is flushed or closed you can't read the new content in it
How do you write the file? Is it written from another Python program? 
Can we see the source code of that?
>
> but the problem is that we can't reproduce it, because doing it
> manually on the same files it works perfectly,
> and the same files some time work some time don't work.
The problem might be with the saved file. Once you get an error for a 
given file, can you reproduce the error using the same file?
>
> The files are on a shared NFS drive, I'm starting to think that it's a
> network/fs problem, which might truncate the file
> adding an EOF before the end and thus making the checksum fail..
> But is it possible?
> Or what else could it be?
Can your try to run the same program on a local drive?

Back to comp.lang.python | Previous | Next | Find similar | Unroll thread


Thread

Re: CRC-checksum failed in gzip Laszlo Nagy <gandalf@shopzeus.com> - 2012-08-01 13:11 +0200

csiph-web