Path: csiph.com!usenet.pasdenom.info!dedibox.gegeweb.org!gegeweb.eu!nntpfeed.proxad.net!proxad.net!feeder1-2.proxad.net!usenet-fr.net!nerim.net!novso.com!newsfeed.xs4all.nl!newsfeed1.news.xs4all.nl!xs4all!post.news.xs4all.nl!not-for-mail
Date: Sun, 27 Oct 2013 03:37:29 -0300
From: Zero Piraeus <z@etiol.net>
To: python-list@python.org
Subject: Re: Using the nntplib module to count Google Groups users
References: <526c8949$0$29972$c3e8da3$5496439d@news.astraweb.com> <CAPTjJmp4FieqcD25bKw8x49C+8-+bacJiSJGyg-1YxKZWPmnWA@mail.gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <CAPTjJmp4FieqcD25bKw8x49C+8-+bacJiSJGyg-1YxKZWPmnWA@mail.gmail.com>
User-Agent: Mutt/1.5.21 (2010-09-15)
Precedence: list
Newsgroups: comp.lang.python
Message-ID: <mailman.1640.1382856296.18130.python-list@python.org>
Lines: 68
NNTP-Posting-Host: 2001:888:2000:d::a6
Xref: csiph.com comp.lang.python:57724

:

On Sun, Oct 27, 2013 at 03:35:40PM +1100, Chris Angelico wrote:
> On Sun, Oct 27, 2013 at 2:32 PM, Steven D'Aprano
> <steve+comp.lang.python@pearwood.info> wrote:
> > If anyone wants to modify the script to determine the ratio of posters,
> > rather than posts, using GG, be my guest.
> 
> And if anyone does, do please post the result on-list.

Taking a different tack, since I happen to have a complete[1] local
archive of python-list going back a few years ... here's a quick and
dirty script to count unique senders and Google Groups users for this
year:

 - - -

import os
from email.parser import HeaderParser

LIST = "python-list@python.org" 
MAILDIR = "/path/to/mail/archive/cur"
YEAR = "2013"

parser = HeaderParser()

found = set()
gg_users = 0

for filename in os.listdir(MAILDIR):
    with open(os.path.join(MAILDIR, filename)) as message:
        headers = parser.parse(message)
        sender = headers.get("from", "")
        dest = headers.get("to", "")
        date = headers.get("date", "")
        if (LIST not in dest) or (YEAR not in date) or (sender in found):
            continue
        found.add(sender)
        if "groups-abuse@google.com" in headers.get("complaints-to", ""):
            gg_users += 1
            print("GG user:")
        print(sender)
        print("Senders: %d" % len(found))
        print("GG users: %d" % gg_users)
        print("---")

 - - -

It's obviously not very robust, but I reckon it's good enough to get an
idea what's going on.

The results:

Senders: 1701
GG users: 879

... so just over 50%.

If anyone wants the complete output, just let me know and I'll email it
privately.

 -[]z.

[1] except for spam filtered out by Gmail.

-- 
Zero Piraeus: ad referendum
http://etiol.net/pubkey.asc