Path: csiph.com!fu-berlin.de!uni-berlin.de!not-for-mail
From: Ben Finney <ben+python@benfinney.id.au>
Newsgroups: comp.lang.python
Subject: Re: Best way to inplace alter a list going into postgres
Date: Wed, 01 Jun 2016 06:10:18 +1000
Lines: 18
Message-ID: <mailman.59.1464725431.1839.python-list@python.org>
References: <705c69aa-f82d-4e03-9d83-bb33ed20ad4d@googlegroups.com> <574d2805$0$1521$c3e8da3$5496439d@news.astraweb.com> <60214c2e-4015-403e-95e7-a77771e94ddc@googlegroups.com> <9ffc7ef3-3ec5-45ea-87be-b7e4e41e815c@googlegroups.com> <85d1o26lat.fsf@benfinney.id.au>
Mime-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 8bit
X-Trace: news.uni-berlin.de P+Q3x3qGJA7IWd27ttzkAgqZmyhRBiVyAMo2EnaAVY1g==
Cancel-Lock: sha1:K3AOobzpTNC6lagn0GDUIVuVrL8=
Return-Path: <python-python-list@m.gmane.org>
X-Original-To: python-list@python.org
Delivered-To: python-list@mail.python.org
X-Spam-Status: OK 0.016
X-Spam-Evidence: '*H*': 0.97; '*S*': 0.00; 'postgres': 0.09; 'received:80.91': 0.09; 'received:80.91.229': 0.09; 'received:gmane.org': 0.09; 'received:list': 0.09; 'subject:into': 0.09; 'operation,': 0.16; 'optimised': 0.16; 'rdbms': 0.16; 'received:80.91.229.3': 0.16; 'received:io': 0.16; 'received:plane.gmane.org': 0.16; 'received:psf.io': 0.16; 'assumes': 0.22; 'mysql,': 0.22; 'header:User-Agent:1': 0.26; 'subject:list': 0.26; '(which': 0.26; 'header:X-Complaints-To:1': 0.26; 'that.': 0.30; 'rules': 0.31; 'probably': 0.31; 'especially': 0.32; 'problem': 0.33; '2009': 0.34; 'handle': 0.34; 'done': 0.35; 'but': 0.36; 'data.': 0.36; 'to:addr:python-list': 0.36; 'subject:: ': 0.37; 'say': 0.37; 'received:org': 0.37; 'mean': 0.38; 'data': 0.39; 'to:addr:python.org': 0.40; '8bit%:43': 0.72; 'url:a': 0.75; 'hand': 0.82; '_o__)': 0.84; 'received:125': 0.84; 'subject:Best': 0.93
X-Injected-Via-Gmane: http://gmane.org/
X-Gmane-NNTP-Posting-Host: jigong.madmonks.org
X-Public-Key-ID: 0xAC128405
X-Public-Key-Fingerprint: 517C F14B B2F3 98B0 CB35  4855 B8B2 4C06 AC12 8405
X-Public-Key-URL: http://www.benfinney.id.au/contact/bfinney-pubkey.asc
X-Post-From: Ben Finney <bignose+hates-spam@benfinney.id.au>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.4 (gnu/linux)
X-BeenThere: python-list@python.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe: <https://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive: <http://mail.python.org/pipermail/python-list/>
List-Post: <mailto:python-list@python.org>
List-Help: <mailto:python-list-request@python.org?subject=help>
List-Subscribe: <https://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
X-Mailman-Original-Message-ID: <85d1o26lat.fsf@benfinney.id.au>
X-Mailman-Original-References: <705c69aa-f82d-4e03-9d83-bb33ed20ad4d@googlegroups.com> <574d2805$0$1521$c3e8da3$5496439d@news.astraweb.com> <60214c2e-4015-403e-95e7-a77771e94ddc@googlegroups.com> <9ffc7ef3-3ec5-45ea-87be-b7e4e41e815c@googlegroups.com>
Xref: csiph.com comp.lang.python:109292

Sayth Renshaw <flebber.crue@gmail.com> writes:

> Probably easier to handle in postgres http://stackoverflow.com/a/37538641/461887

Yes, a proper RDBMS is expressly optimised for manipulating the data.

Especially when the problem at hand is expressible as a set operation,
the RDBMS is almost always the better place to do that.

This assumes you have an RDBMS that is good at manipulating data
efficiently (which rules out MySQL, but you've already done that I see.)

-- 
 \     “[…] we don’t understand what we mean when we say that [God] is |
  `\    ‘good’, ‘wise’, or ‘intelligent’.” —Karen Armstrong, _The Case |
_o__)                                                   For God_, 2009 |
Ben Finney