Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]
Groups > comp.lang.python > #72324
| Path | csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!feeder.erje.net!eu.feeder.erje.net!newsfeed.xs4all.nl!newsfeed3a.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail |
|---|---|
| Return-Path | <paul@mcnettware.com> |
| X-Original-To | python-list@python.org |
| Delivered-To | python-list@mail.python.org |
| X-Spam-Status | OK 0.037 |
| X-Spam-Evidence | '*H*': 0.93; '*S*': 0.00; 'output': 0.05; 'suddenly': 0.07; 'inserted': 0.09; 'rows': 0.09; 'python': 0.11; 'fits': 0.16; 'globals': 0.16; 'wrote:': 0.18; 'trying': 0.19; 'header :User-Agent:1': 0.23; "aren't": 0.24; 'paul': 0.24; '(or': 0.24; 'script': 0.25; 'header:In-Reply-To:1': 0.27; 'chris': 0.29; '[1]': 0.29; "i'm": 0.30; 'lines': 0.31; 'running': 0.33; 'but': 0.35; 'there': 0.35; 'processed': 0.36; 'possible': 0.36; 'should': 0.36; 'requirements': 0.37; 'starting': 0.37; 'to:addr :python-list': 0.38; 'pm,': 0.38; 'does': 0.39; 'received:71': 0.39; 'to:addr:python.org': 0.39; 'how': 0.40; 'read': 0.60; 'deleting': 0.60; 'received:208': 0.61; 'side': 0.67; 'increase': 0.74; 'again?': 0.84; 'received:208.70': 0.91 |
| Date | Fri, 30 May 2014 15:03:43 -0700 |
| From | Paul McNett <paul@mcnettware.com> |
| User-Agent | Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:24.0) Gecko/20100101 Thunderbird/24.5.0 |
| MIME-Version | 1.0 |
| To | python-list@python.org |
| Subject | Re: Script suddenly stops |
| References | <5387F12E.101@arcor.de> |
| In-Reply-To | <5387F12E.101@arcor.de> |
| Content-Type | text/plain; charset=ISO-8859-1; format=flowed |
| Content-Transfer-Encoding | 7bit |
| X-BeenThere | python-list@python.org |
| X-Mailman-Version | 2.1.15 |
| Precedence | list |
| List-Id | General discussion list for the Python programming language <python-list.python.org> |
| List-Unsubscribe | <https://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe> |
| List-Archive | <http://mail.python.org/pipermail/python-list/> |
| List-Post | <mailto:python-list@python.org> |
| List-Help | <mailto:python-list-request@python.org?subject=help> |
| List-Subscribe | <https://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe> |
| Newsgroups | comp.lang.python |
| Message-ID | <mailman.10502.1401488685.18130.python-list@python.org> (permalink) |
| Lines | 23 |
| NNTP-Posting-Host | 2001:888:2000:d::a6 |
| X-Trace | 1401488685 news.xs4all.nl 2965 [2001:888:2000:d::a6]:48048 |
| X-Complaints-To | abuse@xs4all.nl |
| Xref | csiph.com comp.lang.python:72324 |
Show key headers only | View raw
On 5/29/14, 7:47 PM, Chris wrote: > I'm trying to read ten 200 MB textfiles into a MySQL MyISAM database > (Linux, ext4). The script output is suddenly stopping, while the Python > process is still running (or should I say sleeping?). It's not in top, > but in ps visible. Does it stop in the same place every time? How long are you waiting before giving up? Is it at all possible that it is the MySQL side that is blocking? > Why is it stopping? Is there a way to make it continue, without calling > "kill -9", deleting the processed lines and starting it again? One thing to try (maybe, depending on whether it still fits into your requirements for a database transaction) is to increase the number of rows inserted before each commit. > [1] http://pastebin.com/CxHCA9eB It won't have any bearing, but those globals aren't necessary... Paul
Back to comp.lang.python | Previous | Next | Find similar | Unroll thread
Re: Script suddenly stops Paul McNett <paul@mcnettware.com> - 2014-05-30 15:03 -0700
csiph-web