Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.lang.python > #37676

Re: mysql solution

Path csiph.com!newsfeed.hal-mli.net!feeder3.hal-mli.net!newsfeed.hal-mli.net!feeder2.hal-mli.net!newsfeed.xs4all.nl!newsfeed2.news.xs4all.nl!xs4all!post.news.xs4all.nl!not-for-mail
Return-Path <nikos.gr33k@gmail.com>
X-Original-To python-list@python.org
Delivered-To python-list@mail.python.org
X-Spam-Status OK 0.000
X-Spam-Evidence '*H*': 1.00; '*S*': 0.00; 'else:': 0.03; 'example:': 0.03; 'exception': 0.03; '#if': 0.05; 'error:': 0.05; 'much!': 0.05; 'retrieved': 0.05; 'schema': 0.05; 'that?': 0.05; '%s"': 0.07; 'column': 0.07; 'data:': 0.07; 'except:': 0.07; 'host,': 0.07; 'null,': 0.07; 'try:': 0.07; '%s",': 0.09; '(1,': 0.09; 'hostname': 0.09; 'keyed': 0.09; 'to:addr:comp.lang.python': 0.09; 'cc:addr:python-list': 0.10; 'index': 0.13; '"error': 0.16; '%d:': 0.16; '%s,': 0.16; '(%s)",': 0.16; '(%s,': 0.16; 'also:': 0.16; 'data...': 0.16; 'hits': 0.16; 'host)': 0.16; 'increment': 0.16; 'presume': 0.16; 'row': 0.16; 'later': 0.16; 'duplicate': 0.17; 'exists': 0.17; 'integer': 0.17; 'thu,': 0.17; 'jan': 0.18; 'appears': 0.18; 'combination': 0.22; 'help.': 0.22; 'defined': 0.22; "i'd": 0.22; 'cc:2**0': 0.23; 'for?': 0.23; 'insert': 0.23; 'references': 0.23; 'cc:no real name:2**0': 0.24; 'idea': 0.24; 'host': 0.24; 'cc:addr:python.org': 0.25; 'header:In-Reply-To:1': 0.25; 'header:User-Agent:1': 0.26; 'values': 0.26; 'record': 0.28; 'key,': 0.29; 'unique,': 0.29; 'probably': 0.29; 'worked': 0.30; 'primary': 0.30; 'print': 0.32; 'page.': 0.33; 'skip:s 30': 0.33; "aren't": 0.33; 'like:': 0.33; 'null': 0.33; 'received:google.com': 0.34; 'needed': 0.35; 'auto': 0.35; 'sequence': 0.35; 'doing': 0.35; 'table': 0.35; 'received:209.85': 0.35; 'something': 0.35; 'next': 0.35; 'really': 0.36; 'except': 0.36; 'but': 0.36; 'should': 0.36; 'thank': 0.36; 'does': 0.37; 'being': 0.37; 'why': 0.37; 'received:209': 0.37; 'data': 0.37; 'subject:: ': 0.38; 'mean': 0.38; 'page': 0.38; 'where': 0.40; 'your': 0.60; 'most': 0.61; "you've": 0.61; 'save': 0.61; 'provide': 0.62; 'times': 0.63; 'show': 0.63; 'visit': 0.64; 'making': 0.64; 'date,': 0.65; 'pin': 0.65; 'webpage': 0.65; '8bit%:100': 0.70; '8bit%:92': 0.70; 'saving': 0.72; 'foreign': 0.72; '(url)': 0.84; '2013': 0.84; 'cid': 0.84; 'vid': 0.84; 'dennis': 0.91; 'visits': 0.91
X-Received by 10.49.1.70 with SMTP id 6mr1270334qek.27.1359128634017; Fri, 25 Jan 2013 07:43:54 -0800 (PST)
Newsgroups comp.lang.python
Date Fri, 25 Jan 2013 07:43:53 -0800 (PST)
In-Reply-To <mailman.1012.1359060248.2939.python-list@python.org>
Complaints-To groups-abuse@google.com
Injection-Info glegroupsg2000goo.googlegroups.com; posting-host=94.68.70.179; posting-account=DYJQ-woAAACEPH85Au2BhUVfFTfSfVa4
References <88306c73-dfa2-44e1-ab0c-d90dba05be1c@googlegroups.com> <mailman.1012.1359060248.2939.python-list@python.org>
User-Agent G2/1.0
X-Google-Web-Client true
X-Google-IP 94.68.70.179
MIME-Version 1.0
Subject Re: mysql solution
From Ferrous Cranus <nikos.gr33k@gmail.com>
To comp.lang.python@googlegroups.com
Content-Type text/plain; charset=UTF-8
Content-Transfer-Encoding quoted-printable
Cc python-list@python.org
X-BeenThere python-list@python.org
X-Mailman-Version 2.1.15
Precedence list
List-Id General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe <http://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive <http://mail.python.org/pipermail/python-list/>
List-Post <mailto:python-list@python.org>
List-Help <mailto:python-list-request@python.org?subject=help>
List-Subscribe <http://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Message-ID <mailman.1043.1359128642.2939.python-list@python.org> (permalink)
Lines 248
NNTP-Posting-Host 2001:888:2000:d::a6
X-Trace 1359128642 news.xs4all.nl 6855 [2001:888:2000:d::a6]:48889
X-Complaints-To abuse@xs4all.nl
Xref csiph.com comp.lang.python:37676

Show key headers only | View raw


Τη Πέμπτη, 24 Ιανουαρίου 2013 10:43:59 μ.μ. UTC+2, ο χρήστης Dennis Lee Bieber έγραψε:
> On Thu, 24 Jan 2013 03:04:46 -0800 (PST), Ferrous Cranus
> 
> <nikos.gr33k@gmail.com> declaimed the following in
> 
> gmane.comp.python.general:
> 
> 
> 
> > # insert new page record in table counters or update it if already exists
> 
> > 	try:
> 
> > 		cursor.execute( '''INSERT INTO counters(page, hits) VALUES(%s, %s) 
> 
> > 								ON DUPLICATE KEY UPDATE hits = hits + 1''', (htmlpage, 1) )
> 
> > 	except MySQLdb.Error, e:
> 
> > 		print ( "Query Error: ", sys.exc_info()[1].excepinfo()[2] )
> 
> > 		
> 
> > 	# update existing visitor record if same pin and same host found
> 
> > 	try:
> 
> > 		cursor.execute( '''UPDATE visitors SET hits = hits + 1, useros = %s, browser = %s, date = %s WHERE pin = %s AND host = %s''', (useros, browser, date, pin, host))
> 
> > 	except MySQLdb.Error, e:
> 
> > 		print ( "Error %d: %s" % (e.args[0], e.args[1]) )
> 
> >
> 
> > 	# insert new visitor record if above update did not affect a row
> 
> > 	if cursor.rowcount == 0:
> 
> > 		cursor.execute( '''INSERT INTO visitors(hits, host, useros, browser, date) VALUES(%s, %s, %s, %s, %s)''', (1, host, useros, browser, date) )
> 
> > 
> 
> 
> 
> 	Seeing the database schema would help. At present I have no idea
> 
> what is defined as a key, what may be a foreign key, etc.
> 
> 
> 
> 	For example: you show a "counters" table in which you are saving
> 
> "hits" per page (I presume the URL is being saved). But the very next
> 
> thing you are doing is something with a hit count in a "visitors" table
> 
> which appears to be keyed by the combination of "host" and "pin" -- but
> 
> you've failed to provide "pin" on the INSERT.
> 
> 
> 
> 	Furthermore, your "visitors" table is only saving the most recent
> 
> "useros" and "browser" data... Is that what you really want -- or do you
> 
> want to log ALL users that visit the page.
> 
> 
> 
> 	Making presumptions, I'd probably have something like:
> 
> 
> 
> SCHEMA:
> 
> 
> 
> create table counters
> 
> (
> 
>   ID integer not null auto_increment primary key,
> 
>   URL varchar(255) not null,
> 
>   hits integer not null default 1,
> 
>   unique index (URL)
> 
> );
> 
> 
> 
> create table visitors
> 
> (
> 
>   ID integer not null auto_increment primary key,
> 
>   counterID integer not null,
> 
>   host varchar(255) not null,
> 
>   userOS varchar(255) not null,
> 
>   browser varchar(255) not null,
> 
>   hits integer not null default 1,
> 
>   lastVisit datetime not null,
> 
>   foreign key (counterID) references counters (ID),
> 
>   unique index (counterID, host)
> 
> );
> 
> 
> 
> -=-=-=-
> 
> 
> 
> con = db.connection()
> 
> 
> 
> cur = con.cursor()
> 
> 
> 
> try:
> 
> 	#find the needed counter for the page URL
> 
> 	cur.execute("select ID from counters where URL = %s", (htmlpage, ) )
> 
> 	data = cur.fetchone()	#URL is unique, so should only be one
> 
> 	if not data:
> 
> 		#first time for page; primary key is automatic, hit is defaulted
> 
> 		cur.execute("insert into counters (URL) values (%s)",
> 
> 						(htmlpage,) )
> 
> 		cID = cur.lastrowid	#get the primary key value of the new record
> 
> 	else:
> 
> 		#found the page, save primary key and use it to issue hit update
> 
> 		cID = data[0]
> 
> 		cur.execute("update counters set hits = hits + 1 where ID = %s",
> 
> 						(cID,) )
> 
> 
> 
> 	#find the visitor record for the (saved) cID and current host
> 
> 	cur.execute("""select ID from visitors 
> 
> 					where counterID = %s
> 
> 						and host = %s""",
> 
> 					(cID, host) )
> 
> 	data = cur.fetchone()	#cID&host are unique
> 
> 	if not data:
> 
> 		#first time for this host on this page, create new record
> 
> 		cur.execute("""insert into visitors 
> 
> 						(counterID, host, userOS, browser, lastVisit)
> 
> 						values (%s, %s, %s, %s, %s)""",
> 
> 						(cID, host, useros, browser, date) )
> 
> 		#primary key and hits are defaulted, don't care about key
> 
> 	else:
> 
> 		#found the page, save its primary key for later use
> 
> 		vID = data[0]
> 
> 		#update record using retrieved vID
> 
> 		cur.execute("""update visitors set
> 
> 							userOS = %s,
> 
> 							browser = %s,
> 
> 							lastVisit = %s,
> 
> 							hits = hits + 1
> 
> 						where ID = %s""",
> 
> 						(useros, browser, date, vID) )
> 
> 
> 
> 	con.commit()	#if we made it here, the transaction is complete
> 
> 
> 
> except:		#blind excepts aren't "good", but you get the idea
> 
> 			#ANY exception needs to rollback the above sequence
> 
> 	con.rollback()	#something failed, rollback the entire transaction
> 
> 	print "ERROR DURING hit counter update sequence"
> 

It worked like a charm! Thank you very much!

what do you mean by that?

 " Furthermore, your "visitors" table is only saving the most recent 
"useros" and "browser" data... Is that what you really want -- or do you 
want to log ALL users that visit the page. "

If the same hostname  visits my webpage multiple times i only update the userOS, bwoswer, date information. 

What do you mean?

And also: why does the table 'visitors' ahs to have an auto increment column ID what for?

Back to comp.lang.python | Previous | NextPrevious in thread | Find similar | Unroll thread


Thread

mysql solution Ferrous Cranus <nikos.gr33k@gmail.com> - 2013-01-24 03:04 -0800
  Re: mysql solution Chris Angelico <rosuav@gmail.com> - 2013-01-24 22:16 +1100
    Re: mysql solution Ferrous Cranus <nikos.gr33k@gmail.com> - 2013-01-24 05:31 -0800
      Re: mysql solution Chris Angelico <rosuav@gmail.com> - 2013-01-25 01:46 +1100
    Re: mysql solution Ferrous Cranus <nikos.gr33k@gmail.com> - 2013-01-24 05:31 -0800
  Re: mysql solution Lele Gaifax <lele@metapensiero.it> - 2013-01-24 12:25 +0100
    Re: mysql solution Ferrous Cranus <nikos.gr33k@gmail.com> - 2013-01-24 04:01 -0800
      Re: mysql solution Lele Gaifax <lele@metapensiero.it> - 2013-01-24 13:22 +0100
        Re: mysql solution Ferrous Cranus <nikos.gr33k@gmail.com> - 2013-01-24 05:24 -0800
          Re: mysql solution Lele Gaifax <lele@metapensiero.it> - 2013-01-24 14:37 +0100
            Re: mysql solution Ferrous Cranus <nikos.gr33k@gmail.com> - 2013-01-24 06:35 -0800
            Re: mysql solution Ferrous Cranus <nikos.gr33k@gmail.com> - 2013-01-24 06:35 -0800
              Re: mysql solution Duncan Booth <duncan.booth@invalid.invalid> - 2013-01-24 15:19 +0000
                Re: mysql solution Chris Angelico <rosuav@gmail.com> - 2013-01-25 02:27 +1100
                Re: mysql solution Lele Gaifax <lele@metapensiero.it> - 2013-01-24 16:39 +0100
                Re: mysql solution Ferrous Cranus <nikos.gr33k@gmail.com> - 2013-01-24 10:22 -0800
                Re: mysql solution Ferrous Cranus <nikos.gr33k@gmail.com> - 2013-01-24 10:22 -0800
        Re: mysql solution Ferrous Cranus <nikos.gr33k@gmail.com> - 2013-01-24 05:24 -0800
    Re: mysql solution Ferrous Cranus <nikos.gr33k@gmail.com> - 2013-01-24 04:01 -0800
  Re: mysql solution Chris Angelico <rosuav@gmail.com> - 2013-01-24 22:29 +1100
  Re: mysql solution Dennis Lee Bieber <wlfraed@ix.netcom.com> - 2013-01-24 15:43 -0500
    Re: mysql solution Ferrous Cranus <nikos.gr33k@gmail.com> - 2013-01-25 07:43 -0800
      Re: mysql solution Dennis Lee Bieber <wlfraed@ix.netcom.com> - 2013-01-25 16:56 -0500
        Re: mysql solution Ferrous Cranus <nikos.gr33k@gmail.com> - 2013-01-26 02:35 -0800
        Re: mysql solution Ferrous Cranus <nikos.gr33k@gmail.com> - 2013-01-26 02:35 -0800
    Re: mysql solution Ferrous Cranus <nikos.gr33k@gmail.com> - 2013-01-25 07:43 -0800

csiph-web