Path: csiph.com!usenet.pasdenom.info!goblin2!goblin.stu.neva.ru!newsfeed.xs4all.nl!newsfeed7.news.xs4all.nl!post.news.xs4all.nl!not-for-mail Return-Path: X-Original-To: python-list@python.org Delivered-To: python-list@mail.python.org X-Spam-Status: OK 0.054 X-Spam-Evidence: '*H*': 0.89; '*S*': 0.00; 'subject:text': 0.04; 'subject:keys': 0.09; 'cc:addr:python-list': 0.10; 'python': 0.11; 'from:addr:rosuav': 0.16; 'from:name:chris angelico': 0.16; 'subject: \n ': 0.16; 'subject:CSV': 0.16; 'subject:XML': 0.16; 'subject:headers': 0.16; 'subject:values': 0.16; 'wrote:': 0.16; 'cc:2**0': 0.21; 'cc:addr:python.org': 0.21; 'archiving': 0.22; 'subject:will': 0.22; 'am,': 0.23; '2015': 0.23; 'header:In-Reply- To:1': 0.24; 'disk': 0.27; 'message-id:@mail.gmail.com': 0.28; 'cpu': 0.29; 'subject:that': 0.29; "i'd": 0.31; 'probably': 0.32; 'compiled': 0.32; 'subject:) ': 0.32; 'another': 0.34; 'received:google.com': 0.34; 'something': 0.35; 'subject:" ': 0.36; 'subject:: ': 0.37; 'difference': 0.38; 'experience,': 0.38; 'tue,': 0.38; 'doing': 0.38; 'takes': 0.39; 'data': 0.40; 'subject:with': 0.40; 'subject: (': 0.40; 'your': 0.60; 'more': 0.62; '30,': 0.63; 'hours': 0.63; 'making': 0.64; 'between': 0.65; 'backup': 0.66; 'hate': 0.66; 'chrisa': 0.84; 'subject:write': 0.84; 'to:none': 0.90; 'dennis': 0.91; 'same,': 0.91 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:cc :content-type; bh=CUVJeKJD9TsW5rnuYmXgQPJ5qHsqAyUBbA696tNe9IM=; b=bTYFoEFpKM0TR9Ep0FZem4TPyZZPdDm02bwYf03Q9ydTHR79X2NYR/eYIM+9WoTakp zb9Gpz6FHv18sR4fCL6HoG4FHwAAp4Q+0Z4m/MBoYBKztge8akexLYcGfHikdS/glnfV jRd9zjhvBNi5DXSt6JxqaYK773QuFZN6nJfPbAZ8hQM+IYCbWwrFbIy7B3DWo4jC90tZ fz7ZHBwKSgWZO4HbvxDBN8phcMb6v/Z57Hkk5te3vyvsm/pFp+XX84TJtclTegqyndYg JJHqGXuRnH9tsZSmL1rRQGPdVflwIgdCkPGofYxs82gtjIjJPXXFs9hBmL47zoffF4ZJ g/bA== MIME-Version: 1.0 X-Received: by 10.107.131.75 with SMTP id f72mr19080301iod.53.1435668027583; Tue, 30 Jun 2015 05:40:27 -0700 (PDT) In-Reply-To: References: <14aeae7a-41ab-4619-8331-7995e2420e54@googlegroups.com> Date: Tue, 30 Jun 2015 22:40:27 +1000 Subject: Re: enumerate XML tags (keys that will become headers) along with text (values) and write to CSV in one row (as opposed to "stacked" values with one header) From: Chris Angelico Cc: "python-list@python.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: python-list@python.org X-Mailman-Version: 2.1.20+ Precedence: list List-Id: General discussion list for the Python programming language List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Newsgroups: comp.lang.python Message-ID: Lines: 17 NNTP-Posting-Host: 2001:888:2000:d::a6 X-Trace: 1435668030 news.xs4all.nl 2916 [2001:888:2000:d::a6]:58975 X-Complaints-To: abuse@xs4all.nl Xref: csiph.com comp.lang.python:93327 On Tue, Jun 30, 2015 at 11:26 AM, Dennis Lee Bieber wrote: > My system takes something like three hours just to generate a 500GB > backup (one partition each week -- I have a 4TB backup drive with only > 740GB free; the other drives are only half full or I'd need an 8TB backup). > And that's using a compiled backup program -- I'd hate to consider what > Python would require to backup the partition. Probably about the same, actually. In my experience, there's often very little speed difference between a straight 'dd' from one partition to another (say, making a disk image prior to data recovery) and doing more complicated work (say, archiving and compressing). Until you actually manage to saturate your CPU with the workload (video editing or something), the time is most likely to be dominated by the disk platters. ChrisA