Re: How to safely maintain a status file

Path	csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!news.mixmin.net!weretis.net!feeder4.news.weretis.net!ecngs!feeder2.ecngs.de!newsfeed.freenet.ag!news2.euro.net!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
Return-Path	<python-python-list@m.gmane.org>
X-Original-To	python-list@python.org
Delivered-To	python-list@mail.python.org
X-Spam-Status	OK 0.007
X-Spam-Evidence	'H': 0.99; 'S': 0.00; 'cache': 0.05; 'subject:file': 0.07; 'subject:How': 0.09; 'received:80.91': 0.09; 'received:80.91.229': 0.09; 'received:gmane.org': 0.09; 'received:list': 0.09; 'batteries': 0.16; 'fiber': 0.16; 'from:addr:cheimes.de': 0.16; 'from:addr:lists': 0.16; 'from:name:christian heimes': 0.16; 'message-id:@dough.gmane.org': 0.16; 'received:80.91.229.3': 0.16; 'received:plane.gmane.org': 0.16; 'sync': 0.16; 'issue.': 0.20; 'tells': 0.22; 'random': 0.24; 'device': 0.24; 'external': 0.24; 'header:In-Reply-To:1': 0.25; 'header:User-Agent:1': 0.26; '(e.g.': 0.27; 'header:X-Complaints- To:1': 0.28; 'steven': 0.29; 'ups': 0.29; 'channel': 0.32; 'to:addr:python-list': 0.33; 'another': 0.33; 'christian': 0.34; 'done': 0.34; 'board': 0.35; 'received:org': 0.36; 'be.': 0.36; 'expensive': 0.36; 'level': 0.37; 'data': 0.37; 'subject:: ': 0.38; 'some': 0.38; 'to:addr:python.org': 0.39; 'header:Received:5': 0.40; 'our': 0.65; 'physical': 0.69; 'special': 0.73; 'power': 0.74; 'subject:status': 0.84; 'disks,': 0.91; 'device.': 0.93; 'safe.': 0.93
X-Injected-Via-Gmane	http://gmane.org/
To	python-list@python.org
From	Christian Heimes <lists@cheimes.de>
Subject	Re: How to safely maintain a status file
Date	Sat, 14 Jul 2012 14:38:28 +0200
References	<CAOV1wRVtm27yWez1HZuN8=ia-TyM2aXp9QCUbSZ5aZExP_ZChA@mail.gmail.com> <sanjv7lo0vb3rlhip4ov1gpgp4gs51bvfr@invalid.netcom.com> <4FF9F454.40207@shopzeus.com> <jtcvf8$ock$1@dough.gmane.org> <4FFEC371.5040703@shopzeus.com> <mailman.2038.1342098831.4697.python-list@python.org> <4fff7f4c$0$29965$c3e8da3$5496439d@news.astraweb.com>
Mime-Version	1.0
Content-Type	text/plain; charset=ISO-8859-1
Content-Transfer-Encoding	7bit
X-Gmane-NNTP-Posting-Host	f048077172.adsl.alicedsl.de
User-Agent	Mozilla/5.0 (X11; Linux x86_64; rv:12.0) Gecko/20120430 Thunderbird/12.0.1
In-Reply-To	<4fff7f4c$0$29965$c3e8da3$5496439d@news.astraweb.com>
X-BeenThere	python-list@python.org
X-Mailman-Version	2.1.12
Precedence	list
List-Id	General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe	<http://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive	<http://mail.python.org/pipermail/python-list>
List-Post	<mailto:python-list@python.org>
List-Help	<mailto:python-list-request@python.org?subject=help>
List-Subscribe	<http://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups	comp.lang.python
Message-ID	<mailman.2113.1342269522.4697.python-list@python.org> (permalink)
Lines	22
NNTP-Posting-Host	2001:888:2000:d::a6
X-Trace	1342269522 news.xs4all.nl 6890 [2001:888:2000:d::a6]:33157
X-Complaints-To	abuse@xs4all.nl
Xref	csiph.com comp.lang.python:25311

Show key headers only | View raw

Am 13.07.2012 03:52, schrieb Steven D'Aprano:
> And some storage devices (e.g. hard drives, USB sticks) don't actually 
> write data permanently even when you sync the device. They just write to 
> a temporary cache, then report that they are done (liar liar pants on 
> fire). Only when the cache is full, or at some random time at the 
> device's choosing, do they actually write data to the physical media. 
> 
> The result of this is that even when the device tells you that the data 
> is synched, it may not be.

Yes, that's another issue. Either you have to buy expensive enterprise
hardware with UPS batteries or you need to compensate for failures on
software level (e.g. Hadoop cluster).

We have big storage devices with double redundant controllers, on board
buffer batteries, triple redundant power supplies, special RAID disks,
multipath IO fiber channel links and external backup solution to keep
our data reasonable safe.

Christian

Back to comp.lang.python | Previous | Next — Previous in thread | Find similar | Unroll thread

Thread

Re: How to safely maintain a status file Christian Heimes <lists@cheimes.de> - 2012-07-12 15:05 +0200
  Re: How to safely maintain a status file Ross Ridge <rridge@csclub.uwaterloo.ca> - 2012-07-12 11:48 -0400
  Re: How to safely maintain a status file Steven D'Aprano <steve+comp.lang.python@pearwood.info> - 2012-07-13 01:52 +0000
    Re: How to safely maintain a status file Christian Heimes <lists@cheimes.de> - 2012-07-14 14:38 +0200

csiph-web