Path: csiph.com!fu-berlin.de!uni-berlin.de!not-for-mail From: Dennis Lee Bieber Newsgroups: comp.lang.python Subject: Re: Suggested datatype for getting latest information from log files Date: Thu, 11 Feb 2016 20:19:10 -0500 Organization: IISS Elusive Unicorn Lines: 29 Message-ID: References: <621f72dc-ad32-48e8-ad37-a2e7eb2d4bd8@googlegroups.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Trace: news.uni-berlin.de hJhZO0uD9sKUNWQ7FbPiMgRCZUYO7zOnP7vefB7fOHsQ== Return-Path: X-Original-To: python-list@python.org Delivered-To: python-list@mail.python.org X-Spam-Status: OK 0.003 X-Spam-Evidence: '*H*': 0.99; '*S*': 0.00; 'mentioned,': 0.07; 'subject:getting': 0.07; 'message-id:@4ax.com': 0.09; 'received:80.91': 0.09; 'received:80.91.229': 0.09; 'received:gmane.org': 0.09; 'received:list': 0.09; 'subject:files': 0.09; 'timestamp': 0.09; 'assume': 0.11; 'thu,': 0.15; '2016': 0.16; 'afterwards': 0.16; 'aggregates': 0.16; 'received:80.91.229.3': 0.16; 'received:io': 0.16; 'received:plane.gmane.org': 0.16; 'received:psf.io': 0.16; 'skip:> 50': 0.16; 'subject:log': 0.16; 'unordered': 0.16; 'restrictions': 0.18; 'url:home': 0.18; 'select': 0.23; 'seems': 0.23; 'feb': 0.23; 'example': 0.26; 'header:X-Complaints-To:1': 0.26; 'skip:" 20': 0.26; 'idea': 0.28; 'values': 0.28; 'dictionary': 0.29; 'eating': 0.29; "i'm": 0.30; 'lets': 0.33; 'info': 0.34; 'needed': 0.36; 'to:addr:python-list': 0.36; 'subject:: ': 0.37; 'received:org': 0.37; 'thought': 0.37; 'charset:us-ascii': 0.37; 'wanted': 0.37; 'difference': 0.38; 'stuff': 0.38; 'data': 0.39; 'sure': 0.39; 'subject:from': 0.39; 'to:addr:python.org': 0.40; 'some': 0.40; 'email addr:gmail.com': 0.62; 'here.': 0.62; 'skip:n 10': 0.62; 'more': 0.63; 'between': 0.65; 'hand': 0.82; 'subject:latest': 0.84; 'way)': 0.84; 'dennis': 0.91; 'trouble.': 0.91; 'received:108': 0.93 X-Injected-Via-Gmane: http://gmane.org/ X-Gmane-NNTP-Posting-Host: adsl-108-79-217-78.dsl.klmzmi.sbcglobal.net X-Newsreader: Forte Agent 6.00/32.1186 X-No-Archive: YES X-BeenThere: python-list@python.org X-Mailman-Version: 2.1.21rc2 Precedence: list List-Id: General discussion list for the Python programming language List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Xref: csiph.com comp.lang.python:102838 On Thu, 11 Feb 2016 10:07:21 -0800 (PST), ltomassmail@gmail.com declaimed the following: > >timeStamp,name,marblesHeld,timeNow,timeSinceLastEaten > As mentioned, what is the difference between "timeStamp" and "timeNow"? non-sequitur: are they eating marbles? Otherwise the "marblesHeld" and "timeSinceLastEaten" seems unrelated. > >I thought a dictionary would be a good idea because of the key restrictions ensuring no duplicates, so the data would always update - However because they are unordered and I need to do some more processing on the data afterwards I'm having trouble. > Off hand -- my first thought, given the nature of the data -- would be to just stuff it all into a database, and try to come up with database queries to produce the needed order/subset information. >For example lets assume that once I have the most upto date values from dave,steve,jenny I wanted to do timeNow - timeSinceLastEaten to get an interval then write all the info together to some other database. Crucially order is important here. > (very pseudo SQL... I'm not even sure the aggregates work that way) select name, marblesLeft, timeNow - timeSinceLastEaten group by name having max(timeStamp) order by timeStamp -- Wulfraed Dennis Lee Bieber AF6VN wlfraed@ix.netcom.com HTTP://wlfraed.home.netcom.com/