Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.os.linux.advocacy > #372861 > unrolled thread

Geographic breakdown of cola regs

Started byDFS <nospam@dfs.com>
First post2016-09-26 12:57 -0400
Last post2016-09-27 13:34 -0700
Articles 20 on this page of 67 — 16 participants

Back to article view | Back to comp.os.linux.advocacy


Contents

  Geographic breakdown of cola regs DFS <nospam@dfs.com> - 2016-09-26 12:57 -0400
    Re: Geographic breakdown of cola regs Steve Carroll <fretwizzer@gmail.com> - 2016-09-26 10:14 -0700
      Re: Geographic breakdown of cola regs Silver Slimer <.m@nsn.s> - 2016-09-26 13:38 -0400
        Re: Geographic breakdown of cola regs Steve Carroll <fretwizzer@gmail.com> - 2016-09-26 10:48 -0700
          Re: Geographic breakdown of cola regs Silver Slimer <.m@nsn.s> - 2016-09-26 13:56 -0400
            Re: Geographic breakdown of cola regs Steve Carroll <fretwizzer@gmail.com> - 2016-09-26 11:09 -0700
              Re: Geographic breakdown of cola regs Silver Slimer <.m@nsn.s> - 2016-09-26 14:13 -0400
                Re: Geographic breakdown of cola regs "Octavian W. Lagrange" <olagrang@perch.invalid> - 2016-09-26 18:30 +0000
                  Re: Geographic breakdown of cola regs Silver Slimer <.m@nsn.s> - 2016-09-26 16:51 -0400
                Re: Geographic breakdown of cola regs "Octavian W. Lagrange" <olagrang@perch.invalid> - 2016-09-27 19:06 +0000
                  Re: Geographic breakdown of cola regs Snit <usenet@gallopinginsanity.com> - 2016-09-27 12:32 -0700
                    Re: Geographic breakdown of cola regs "Octavian W. Lagrange" <olagrang@perch.invalid> - 2016-09-27 19:50 +0000
                      Re: Geographic breakdown of cola regs Snit <usenet@gallopinginsanity.com> - 2016-09-27 13:19 -0700
                      Re: Geographic breakdown of cola regs Silver Slimer <.m@nsn.s> - 2016-09-27 20:12 -0400
                        Re: Geographic breakdown of cola regs Silver Slimer <.m@nsn.s> - 2016-09-28 08:01 -0400
                          Re: Geographic breakdown of cola regs Jim Polaski <jpolaski@linuxmail.org> - 2016-09-28 14:18 +0000
                          Re: Geographic breakdown of cola regs Snit <usenet@gallopinginsanity.com> - 2016-09-28 08:46 -0700
                            Re: Geographic breakdown of cola regs Steve Carroll <fretwizzer@gmail.com> - 2016-09-28 10:00 -0700
                              Re: Geographic breakdown of cola regs Silver Slimer <.m@nsn.s> - 2016-09-28 14:55 -0400
        Re: Geographic breakdown of cola regs Marek Novotny <marek.novotny@marspolar.com> - 2016-09-26 19:06 +0000
          Re: Geographic breakdown of cola regs chrisv <chrisv@nospam.invalid> - 2016-09-26 14:12 -0500
            Re: Geographic breakdown of cola regs GreyCloud <Cumulus@mist.com> - 2016-09-26 13:53 -0600
              Re: Geographic breakdown of cola regs DFS <nospam@dfs.com> - 2016-09-26 19:03 -0400
                Re: Geographic breakdown of cola regs GreyCloud <Cumulus@mist.com> - 2016-09-26 18:32 -0600
              Re: Geographic breakdown of cola regs -hh <recscuba_google@huntzinger.com> - 2016-09-27 15:35 -0700
                Re: Geographic breakdown of cola regs GreyCloud <Cumulus@mist.com> - 2016-09-27 16:45 -0600
            Re: Geographic breakdown of cola regs William Poaster <wp@dev.null> - 2016-09-26 22:35 +0100
              Re: Geographic breakdown of cola regs Chris Ahlstrom <OFeem1987@teleworm.us> - 2016-09-26 17:55 -0400
              Re: Geographic breakdown of cola regs DFS <nospam@dfs.com> - 2016-09-26 19:04 -0400
          Re: Geographic breakdown of cola regs Silver Slimer <.m@nsn.s> - 2016-09-26 16:55 -0400
            Re: Geographic breakdown of cola regs Snit <usenet@gallopinginsanity.com> - 2016-09-26 14:08 -0700
              Re: Geographic breakdown of cola regs Peter Köhlmann <peter-koehlmann@t-online.de> - 2016-09-27 00:19 +0200
                Re: Geographic breakdown of cola regs Silver Slimer <.m@nsn.s> - 2016-09-26 18:38 -0400
                Re: Geographic breakdown of cola regs Snit <usenet@gallopinginsanity.com> - 2016-09-26 15:27 -0700
      Re: Geographic breakdown of cola regs DFS <nospam@dfs.com> - 2016-09-26 19:18 -0400
        Re: Geographic breakdown of cola regs Silver Slimer <.m@nsn.s> - 2016-09-26 19:22 -0400
        Re: Geographic breakdown of cola regs Snit <usenet@gallopinginsanity.com> - 2016-09-26 16:36 -0700
          Re: Geographic breakdown of cola regs Steve Carroll <fretwizzer@gmail.com> - 2016-09-26 17:54 -0700
            Re: Geographic breakdown of cola regs DFS <nospam@dfs.com> - 2016-09-27 11:09 -0400
              Re: Geographic breakdown of cola regs Steve Carroll <fretwizzer@gmail.com> - 2016-09-27 08:58 -0700
                Re: Geographic breakdown of cola regs Steve Carroll <fretwizzer@gmail.com> - 2016-09-27 09:50 -0700
                  Re: Geographic breakdown of cola regs DFS <nospam@dfs.com> - 2016-09-27 14:33 -0400
                    Re: Geographic breakdown of cola regs Steve Carroll <fretwizzer@gmail.com> - 2016-09-27 12:24 -0700
                      Re: Geographic breakdown of cola regs DFS <nospam@dfs.com> - 2016-09-29 19:51 -0400
                        Re: Geographic breakdown of cola regs Steve Carroll <fretwizzer@gmail.com> - 2016-09-29 17:22 -0700
                          Re: Geographic breakdown of cola regs DFS <nospam@dfs.com> - 2016-09-29 23:27 -0400
        Re: Geographic breakdown of cola regs GreyCloud <Cumulus@mist.com> - 2016-09-26 18:35 -0600
          Re: Geographic breakdown of cola regs "Octavian W. Lagrange" <olagrang@perch.invalid> - 2016-09-27 05:38 +0000
          Re: Geographic breakdown of cola regs DFS <nospam@dfs.com> - 2016-09-27 01:48 -0400
            Re: Geographic breakdown of cola regs GreyCloud <Cumulus@mist.com> - 2016-09-27 12:08 -0600
          Re: Geographic breakdown of cola regs Silver Slimer <.m@nsn.s> - 2016-09-27 08:48 -0400
            Re: Geographic breakdown of cola regs GreyCloud <Cumulus@mist.com> - 2016-09-27 12:10 -0600
              Re: Geographic breakdown of cola regs Silver Slimer <.m@nsn.s> - 2016-09-27 20:09 -0400
        Re: Geographic breakdown of cola regs "Octavian W. Lagrange" <olagrang@perch.invalid> - 2016-09-27 05:57 +0000
          Re: Geographic breakdown of cola regs DFS <nospam@dfs.com> - 2016-09-27 11:10 -0400
            Re: Geographic breakdown of cola regs "Octavian W. Lagrange" <olagrang@perch.invalid> - 2016-09-27 15:46 +0000
        Re: Geographic breakdown of cola regs Incubus <incubus9536612@gmail.com> - 2016-09-27 07:54 -0700
          Re: Geographic breakdown of cola regs Silver Slimer <.m@nsn.s> - 2016-09-27 11:18 -0400
            Re: Geographic breakdown of cola regs DFS <nospam@dfs.com> - 2016-09-27 11:28 -0400
    Re: Geographic breakdown of cola regs fr314159@gmail.com - 2016-09-26 10:23 -0700
    Re: Geographic breakdown of cola regs Sandman <mr@sandman.net> - 2016-09-27 09:06 +0000
      Re: Geographic breakdown of cola regs GreyCloud <Cumulus@mist.com> - 2016-09-27 12:11 -0600
        Re: Geographic breakdown of cola regs Peter Köhlmann <peter-koehlmann@t-online.de> - 2016-09-27 20:28 +0200
          Re: Geographic breakdown of cola regs GreyCloud <Cumulus@mist.com> - 2016-09-27 15:04 -0600
          Re: Geographic breakdown of cola regs Chris Ahlstrom <OFeem1987@teleworm.us> - 2016-09-27 19:00 -0400
        Re: Geographic breakdown of cola regs Sandman <mr@sandman.net> - 2016-09-27 20:32 +0000
          Re: Geographic breakdown of cola regs Snit <usenet@gallopinginsanity.com> - 2016-09-27 13:34 -0700

Page 3 of 4 — ← Prev page 1 2 [3] 4  Next page →


#372979

FromSteve Carroll <fretwizzer@gmail.com>
Date2016-09-27 09:50 -0700
Message-ID<e44eb1f5-d9f2-43a8-b758-5c54512514b0@googlegroups.com>
In reply to#372970
On Tuesday, September 27, 2016 at 9:59:07 AM UTC-6, Steve Carroll wrote:
(snip)
> This is a great response, exactly what I was looking for... thanks! 
> I've had trouble with getting pip happening but I will solve it at some 
> point and will give this a try if I can load the proper libraries required.

I did get the script to work,  now I have to figure out WTF you were talking about with that other stuff ;) How did you grab the entire history and put it into a db? Using this script with different parameters? Wouldn't that be a HUGE file? And then, after that, how do you ascertain how to get additional posts that you don't already have, by checking message IDs? 

[toc] | [prev] | [next] | [standalone]


#373005

FromDFS <nospam@dfs.com>
Date2016-09-27 14:33 -0400
Message-ID<nsee28$1ii$1@dont-email.me>
In reply to#372979
On 9/27/2016 12:50 PM, Steve Carroll wrote:
> On Tuesday, September 27, 2016 at 9:59:07 AM UTC-6, Steve Carroll
> wrote: (snip)
>> This is a great response, exactly what I was looking for... thanks!
>>  I've had trouble with getting pip happening but I will solve it at
>> some point and will give this a try if I can load the proper
>> libraries required.
>
> I did get the script to work,  now I have to figure out WTF you were
> talking about with that other stuff ;)

python lists, baby!

Data comes back from the server in list objects, and you need to extract 
the data from the lists to add it to your relational db.



> How did you grab the entire
> history and put it into a db?

Took a long time, because you don't want to ask for 50K or 100K articles 
at a time.  You probably can, but the server admin might notice and 
scold you, or ban you if you do it a lot.

First I downloaded every articleID on the server (and the post date), to 
see what was there.  As I recall I grabbed 1000 at a time in a loop - 
with 375K posts it probably took a few minutes.  Then I saw that on 
eternal-sep, the articleID sequence went directly from 1 to 201860.  1 
was a 2007 post, and 201860 was a Oct 2010 post.  Not sure why he keeps 1.

So I used the range of 201860 to 595126 (or whatever was the latest ID 
at the time - this was a few months ago) to build my db.

Then I went through each header I was interested in (From, Subject, 
MessageID, User-Agent, Newsgroups, References, InjectionInfo) and 
downloaded the header info for that range of articles 201860-595126.

Then I went back and got the Body for each post in that range.  That was 
the slowest part by far.  I think I did 100 posts at a time, store each 
line separately, parse the new content out, etc.  I'd kick off the 
program and let it run for a range of 10,000 posts, 100 at a loop. 
Probably spent 2-3 days on it, off and on.

Sandman uses something called 'suck' which retrieves NNTP data 
differently.  Then he parses the data locally, I believe.  It might be 
worth looking into.



> Using this script with different parameters?

Similar script, but much larger.  To build the db initially, I used a 
few scripts.  After the db was populated I created a maintenance script, 
which just gets the latest posts since the last time it was run.

--------------------------------------------
  > python nntp_updatedb.py
connecting...

added new articles: 605335-605532
updated Subject
updated From
updated Message-ID
updated User-Agent
updated Newsgroups
updated injection info
updated References
updated message bodies
added new content
Updated USENET.sqlite: 2.6e+02 seconds
--------------------------------------------

It now takes several minutes to store 200 posts.  Too slow.

The message bodies and new content part took as much as all other parts 
combined.  I need to look at the BODY table, maybe drop an index.  And 
fix the timer code.

And the 'get new content' routine is a little fubar for GoogleGroup posts.

So there are a few tweaks needed.


> Wouldn't that be a HUGE file?

Pretty large.  The SQLite db is a little over 3GB now, including 
indexes.  And that's normalized about as much as I could.  Each From and 
Subject and User-Agent is stored only once.

I like the tight design, but some queries are fast and some are slow. It 
can be a pain to query, actually.

The BODY table is now 17.48M rows, and indexed.  It's getting slow to 
populate.

Sometimes the SQLiteStudio app even freezes and crashes.



> And then, after that, how
> do you ascertain how to get additional posts that you don't already
> have, by checking message IDs?

Not with message IDs, but with article IDs.  Check the latest (largest) 
articleID assigned by the NNTP server against the latest articleID 
stored in your system.

The server response to the group command tells you the latest articleID 
available on the server, for that group:

resp, IDs, begID, endID, grpNm = news.group('comp.os.linux.advocacy')

resp: 211 394563 1 605472 comp.os.linux.advocacy
211    = command completed OK
394563 = number of articles available for that group
1      = earliest articleID for that group
605472 = latest articleID for that group
comp.os.linux.advocacy = group name

And with a successful response, python has already parsed the response 
and assigned values to the variables in the command:

resp, IDs, begID, endID, grpNm = news.group('comp.os.linux.advocacy')

resp  = "211 394563 1 605472 comp.os.linux.advocacy"
IDs   = 394563
begID = 1
endID = 605472
grpNm = "comp.os.linux.advocacy"

So now you compare the max articleID in your database (say 605452) 
against the latest articleID on the server (in this example, it's endID 
= 605472).  So you're missing the last 20 posts.

You should /definitely/ store the article ID assigned by the server. The 
article ID is unique for that post for that group for that server, but 
since your Usenet server company could shut down, you also need to keep 
track of which server assigned the article ID.  So I ended up assigning 
my own PostID:

CREATE TABLE POSTID (
POSTID INTEGER NOT NULL PRIMARY KEY AUTOINCREMENT,
SERVERID INTEGER NOT NULL REFERENCES NNTP_SERVER (SERVERID) ON UPDATE 
CASCADE,
GROUPID INTEGER NOT NULL REFERENCES NNTP_GROUP (GROUPID) ON UPDATE CASCADE,
ARTICLEID INTEGER NOT NULL
);

With that structure, you only have to add one new entry to the 
NNTP_SERVER table, point the code to the new NNTP server, and continue 
on.  No other changes to the code or db required.  Theoretically.  It's 
possible the new server doesn't support the same headers (eg some use 
'User-Agent', others use 'X-Newsreader' I believe) so that would be a 
minor tweak.  But it's super easy to use the same script to download 
other groups from the same or other servers.

[toc] | [prev] | [next] | [standalone]


#373014

FromSteve Carroll <fretwizzer@gmail.com>
Date2016-09-27 12:24 -0700
Message-ID<acbb73a7-9c4e-4826-b5b3-1a0ab61380f0@googlegroups.com>
In reply to#373005
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512

On Tuesday, September 27, 2016 at 12:33:57 PM UTC-6, DFS wrote:
> On 9/27/2016 12:50 PM, Steve Carroll wrote:
> > On Tuesday, September 27, 2016 at 9:59:07 AM UTC-6, Steve Carroll
> > wrote: (snip)
> >> This is a great response, exactly what I was looking for... thanks!
> >>  I've had trouble with getting pip happening but I will solve it at
> >> some point and will give this a try if I can load the proper
> >> libraries required.
> >
> > I did get the script to work,  now I have to figure out WTF you were
> > talking about with that other stuff ;)
> 
> python lists, baby!
> 
> Data comes back from the server in list objects, and you need to extract 
> the data from the lists to add it to your relational db.
> 
> 
> 
> > How did you grab the entire
> > history and put it into a db?
> 
> Took a long time, because you don't want to ask for 50K or 100K articles 
> at a time.  You probably can, but the server admin might notice and 
> scold you, or ban you if you do it a lot.
> 
> First I downloaded every articleID on the server (and the post date), to 
> see what was there.  As I recall I grabbed 1000 at a time in a loop - 
> with 375K posts it probably took a few minutes.  Then I saw that on 
> eternal-sep, the articleID sequence went directly from 1 to 201860.  1 
> was a 2007 post, and 201860 was a Oct 2010 post.  Not sure why he keeps 1.
> 
> So I used the range of 201860 to 595126 (or whatever was the latest ID 
> at the time - this was a few months ago) to build my db.
> 
> Then I went through each header I was interested in (From, Subject, 
> MessageID, User-Agent, Newsgroups, References, InjectionInfo) and 
> downloaded the header info for that range of articles 201860-595126.
> 
> Then I went back and got the Body for each post in that range.  That was 
> the slowest part by far.  I think I did 100 posts at a time, store each 
> line separately, parse the new content out, etc.  I'd kick off the 
> program and let it run for a range of 10,000 posts, 100 at a loop. 
> Probably spent 2-3 days on it, off and on.
> 
> Sandman uses something called 'suck' which retrieves NNTP data 
> differently.  Then he parses the data locally, I believe.  It might be 
> worth looking into.
> 
> 
> 
> > Using this script with different parameters?
> 
> Similar script, but much larger.  To build the db initially, I used a 
> few scripts.  After the db was populated I created a maintenance script, 
> which just gets the latest posts since the last time it was run.
> 
> --------------------------------------------
>   > python nntp_updatedb.py
> connecting...
> 
> added new articles: 605335-605532
> updated Subject
> updated From
> updated Message-ID
> updated User-Agent
> updated Newsgroups
> updated injection info
> updated References
> updated message bodies
> added new content
> Updated USENET.sqlite: 2.6e+02 seconds
> --------------------------------------------
> 
> It now takes several minutes to store 200 posts.  Too slow.
> 
> The message bodies and new content part took as much as all other parts 
> combined.  I need to look at the BODY table, maybe drop an index.  And 
> fix the timer code.
> 
> And the 'get new content' routine is a little fubar for GoogleGroup posts.
> 
> So there are a few tweaks needed.
> 
> 
> > Wouldn't that be a HUGE file?
> 
> Pretty large.  The SQLite db is a little over 3GB now, including 
> indexes.  And that's normalized about as much as I could.  Each From and 
> Subject and User-Agent is stored only once.
> 
> I like the tight design, but some queries are fast and some are slow. It 
> can be a pain to query, actually.
> 
> The BODY table is now 17.48M rows, and indexed.  It's getting slow to 
> populate.
> 
> Sometimes the SQLiteStudio app even freezes and crashes.
> 
> 
> 
> > And then, after that, how
> > do you ascertain how to get additional posts that you don't already
> > have, by checking message IDs?
> 
> Not with message IDs, but with article IDs.  Check the latest (largest) 
> articleID assigned by the NNTP server against the latest articleID 
> stored in your system.
> 
> The server response to the group command tells you the latest articleID 
> available on the server, for that group:
> 
> resp, IDs, begID, endID, grpNm = news.group('comp.os.linux.advocacy')
> 
> resp: 211 394563 1 605472 comp.os.linux.advocacy
> 211    = command completed OK
> 394563 = number of articles available for that group
> 1      = earliest articleID for that group
> 605472 = latest articleID for that group
> comp.os.linux.advocacy = group name
> 
> And with a successful response, python has already parsed the response 
> and assigned values to the variables in the command:
> 
> resp, IDs, begID, endID, grpNm = news.group('comp.os.linux.advocacy')
> 
> resp  = "211 394563 1 605472 comp.os.linux.advocacy"
> IDs   = 394563
> begID = 1
> endID = 605472
> grpNm = "comp.os.linux.advocacy"
> 
> So now you compare the max articleID in your database (say 605452) 
> against the latest articleID on the server (in this example, it's endID 
> = 605472).  So you're missing the last 20 posts.
> 
> You should /definitely/ store the article ID assigned by the server. The 
> article ID is unique for that post for that group for that server, but 
> since your Usenet server company could shut down, you also need to keep 
> track of which server assigned the article ID.  So I ended up assigning 
> my own PostID:
> 
> CREATE TABLE POSTID (
> POSTID INTEGER NOT NULL PRIMARY KEY AUTOINCREMENT,
> SERVERID INTEGER NOT NULL REFERENCES NNTP_SERVER (SERVERID) ON UPDATE 
> CASCADE,
> GROUPID INTEGER NOT NULL REFERENCES NNTP_GROUP (GROUPID) ON UPDATE CASCADE,
> ARTICLEID INTEGER NOT NULL
> );
> 
> With that structure, you only have to add one new entry to the 
> NNTP_SERVER table, point the code to the new NNTP server, and continue 
> on.  No other changes to the code or db required.  Theoretically.  It's 
> possible the new server doesn't support the same headers (eg some use 
> 'User-Agent', others use 'X-Newsreader' I believe) so that would be a 
> minor tweak.  But it's super easy to use the same script to download 
> other groups from the same or other servers.

Excellent stuff! Seriously, thanks again for this! I've been using this 
stupid pokemon data and it's OK considering I'm working with REST
API concepts... but I really wanted to get into some of this stuff you
and Sandman are doing with SQL databases. The most advanced 
queries I've run to date were simple joins, ex:

SELECT `ID`,`post_title` AS `Product Description`,
 `price`.`meta_value` AS `Price`, `stock`.`meta_value` AS `Stock` 
FROM `wp_posts` 
LEFT JOIN `wp_postmeta` AS `price` ON wp_posts.ID = price.post_id 
AND price.meta_key = 'regular_price'
LEFT JOIN `wp_postmeta` AS `stock` ON wp_posts.ID = stock.post_id 
AND stock.meta_key = 'stock'
WHERE (wp_posts.ID > '0') AND post_type = "product" ORDER BY `post_title`


It's probably lame but it did the job.

-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - https://gpgtools.org

iQIcBAEBCgAGBQJX6sdvAAoJELnOYK54exUCtM4P/As7mBUZrcmuaboT9kBP1h6E
CN7dizHL78dT1+Yrd0y+KsY3xCIA36h+TR2b0oibELpGUG2Q/4J0W+0KN3hNGzeJ
e8T+CINor3kDoD0TnHDfqWUgsBB/SnsQQgpjpzN4YiI6L0iLhEd1RXrp7+5qwHdR
fW4GcOEM5qFlqH5Li0xYI0JaOUaFK5cDDhJhzit8a3NCC314PNUH8qnq3R6V/xbG
EZPPyjAqEw/DIA8hMxKcX3NPuZ16wAYZP6QS7aD0Z7GoYRkCorOdQuscKVC894ou
GdeQRp94OpQVUB0PmfsirFClb4UNo1lGBLh9SedjpzU35zgc5SAXLAR4wIVsDy6c
JrD+NzMM+u1i6hlFtYzUM+KSXUzB6ZjjOjhKLBMsIMR6NngED2QQQAOQl/07sFDW
VBceV5QVLo4GSiCY6i1PmCDad+E5EuCnbWXgD6xus1kY1EVPLplC28/ld/WfS6Bm
G2ghkeLzSSglLbautg/17ri7BfVxvl9G4IIj6w1E5uuMdeHfWvmRnVOuAvSqlMkS
ofqvs8qrX39jRbMVHrGztLOwpsvSZ4jbppwDbAczDtprkNsKxTJ1llJoI/01mmUd
K3URdiad4RaGAQY1KMLQHxzSOXoSBR9LU/89YfuoYAuwd7drX2LV0sO6JLVlzMlQ
OGFKId5HDHjwaxN614Bf
=1BAX
-----END PGP SIGNATURE-----

[toc] | [prev] | [next] | [standalone]


#373505

FromDFS <nospam@dfs.com>
Date2016-09-29 19:51 -0400
Message-ID<nsk9d8$3ec$3@dont-email.me>
In reply to#373014
On 9/27/2016 3:24 PM, Steve Carroll wrote:


> Excellent stuff! Seriously, thanks again for this!


You're welcome.

To understand the data and how best to store it, I played around with a 
few designs in Access (populated via python and pyodbc) before 
committing to the final SQLite structure I have now (the DDL to which I 
posted the other day).

One simple design I tried was this:  http://imgur.com/a/rmIL9

It stores the data essentially as it looks onscreen.  It's easy to see 
the entire contents of a post, but not recommended whatsoever: it will 
grow huge, contain a lot of repeating data, and in general is slow and 
difficult to query against (look at that and try to imagine the SQL to 
count how many times chrisv said *plonk*, or how to count the number of 
posts everyone made in Sep 2015 - when you have 100K posts such queries 
probably won't ever finish).


Another "master" table design I tried was: http://imgur.com/a/qDjPj

I populated it with about 5K rows, to see what data was frequently 
captured in eternal-september.  After reviewing the data, I decided to 
not store Organization, Complaints-To, the various 'X-' fields, the 
NNTP-Posting-Host, and some others.  You could use a table like this 
(need to add server and group columns), plus a separate table for the 
post body, and that would be a workable design that's easy to query and 
populate. Cons are repeating data, and difficulty in accounting for 
nymshifts.





> I've been using this
> stupid pokemon data and it's OK considering I'm working with REST
> API concepts... but I really wanted to get into some of this stuff you
> and Sandman are doing with SQL databases. The most advanced
> queries I've run to date were simple joins, ex:
>
> SELECT `ID`,`post_title` AS `Product Description`,
>  `price`.`meta_value` AS `Price`, `stock`.`meta_value` AS `Stock`
> FROM `wp_posts`
> LEFT JOIN `wp_postmeta` AS `price` ON wp_posts.ID = price.post_id
> AND price.meta_key = 'regular_price'
> LEFT JOIN `wp_postmeta` AS `stock` ON wp_posts.ID = stock.post_id
> AND stock.meta_key = 'stock'
> WHERE (wp_posts.ID > '0') AND post_type = "product" ORDER BY `post_title`
>
>
> It's probably lame but it did the job.

Standard left join.  Nothing lame there, except it refers to 'Pokemon'. 
What kind of data is that?

[toc] | [prev] | [next] | [standalone]


#373512

FromSteve Carroll <fretwizzer@gmail.com>
Date2016-09-29 17:22 -0700
Message-ID<47dacb69-50b3-400f-9597-f57adedb6783@googlegroups.com>
In reply to#373505
On Thursday, September 29, 2016 at 5:51:17 PM UTC-6, DFS wrote:
> On 9/27/2016 3:24 PM, Steve Carroll wrote:
> 
> 
> > Excellent stuff! Seriously, thanks again for this!
> 
> 
> You're welcome.
> 
> To understand the data and how best to store it, I played around with a 
> few designs in Access (populated via python and pyodbc) before 
> committing to the final SQLite structure I have now (the DDL to which I 
> posted the other day).

I have to dial in some basic python. Never worked with tuples before so that was interesting.  The way you're using one for the static values (I was looking at the nntplib page) is handy in a  memory efficient way (cuz they're immutable, I guess).

> 
> One simple design I tried was this:  http://imgur.com/a/rmIL9
> 
> It stores the data essentially as it looks onscreen.  It's easy to see 
> the entire contents of a post, but not recommended whatsoever: it will 
> grow huge, contain a lot of repeating data, and in general is slow and 
> difficult to query against (look at that and try to imagine the SQL to 
> count how many times chrisv said *plonk*, or how to count the number of 
> posts everyone made in Sep 2015 - when you have 100K posts such queries 
> probably won't ever finish).
> 
> 
> Another "master" table design I tried was: http://imgur.com/a/qDjPj
> 
> I populated it with about 5K rows, to see what data was frequently 
> captured in eternal-september.  After reviewing the data, I decided to 
> not store Organization, Complaints-To, the various 'X-' fields, the 
> NNTP-Posting-Host, and some others.  You could use a table like this 
> (need to add server and group columns), plus a separate table for the 
> post body, and that would be a workable design that's easy to query and 
> populate. Cons are repeating data, and difficulty in accounting for 
> nymshifts.

I have a book on SQL around here somewhere, I should have read it by now.

> > I've been using this
> > stupid pokemon data and it's OK considering I'm working with REST
> > API concepts... but I really wanted to get into some of this stuff you
> > and Sandman are doing with SQL databases. The most advanced
> > queries I've run to date were simple joins, ex:
> >
> > SELECT `ID`,`post_title` AS `Product Description`,
> >  `price`.`meta_value` AS `Price`, `stock`.`meta_value` AS `Stock`
> > FROM `wp_posts`
> > LEFT JOIN `wp_postmeta` AS `price` ON wp_posts.ID = price.post_id
> > AND price.meta_key = 'regular_price'
> > LEFT JOIN `wp_postmeta` AS `stock` ON wp_posts.ID = stock.post_id
> > AND stock.meta_key = 'stock'
> > WHERE (wp_posts.ID > '0') AND post_type = "product" ORDER BY `post_title`
> >
> >
> > It's probably lame but it did the job.
> 
> Standard left join.  Nothing lame there, except it refers to 'Pokemon'. 
> What kind of data is that?

There is no Pokemon in that query, that was  some REST API stuff I was working on.

[toc] | [prev] | [next] | [standalone]


#373553

FromDFS <nospam@dfs.com>
Date2016-09-29 23:27 -0400
Message-ID<nskm1v$nri$4@dont-email.me>
In reply to#373512
On 9/29/2016 8:22 PM, Steve Carroll wrote:



> I have to dial in some basic python.

You write JavaScript - you'll be able to pick up python quickly once you 
dedicate a few hours to it.


> Never worked with tuples before
> so that was interesting.  The way you're using one for the static
> values (I was looking at the nntplib page) is handy in a  memory
> efficient way (cuz they're immutable, I guess).

Lists and what they call 'list comprehension' are the coolest features 
of python I've used so far.  Some of the web scraping and HTML handling 
libs are nice, too.

There's a huge boatload of stuff available at
https://pypi.python.org/pypi


> I have a book on SQL around here somewhere, I should have read it by
> now.

Unless you learn SQL, you'll be at the mercy of a QBE system (query by 
example).  Which isn't so bad - you can do a lot with them, but it's 
better to know the language.

If you have Parallels and Windows and MS Office, use Access to get 
started.  You can switch back and forth between the query designer and 
the SQL statement, and it's easy to prototype databases then upsize to a 
more powerful database program (Access tables will choke on millions of 
rows - and cola alone generates nearly 3 million lines of posts per year).

Or maybe mysql or SQLite for Mac, and find an admin tool that has a 
query builder.

Using SQLite with python is straightforward, too.

-----------------------------------------------------------------------
import os, sqlite3

dbName = "db.sqlite"

if os.path.exists(dbName):
	response = raw_input(dbName + ' already exists.  Overwrite? (y/n):')
	if response in ('Y','y'):	
		os.remove(dbName)
	
conn   = sqlite3.connect(dbName)
db     = conn.cursor()

sSQL =  " CREATE TABLE If Not Exists PACKAGES "  \
	" (PackageName,Version,License,Description, "  \
	" PRIMARY KEY (PackageName,Version)); "
db.execute(sSQL)

db.execute("INSERT or ignore INTO PACKAGES VALUES (?,?,?,?)",
('Biggus','0.7.0','LGPL3','Virtual large arrays and lazy evaluation'))

conn.commit()
db.close()
conn.close()
-----------------------------------------------------------------------

Now you have a SQLite database file - with a table - in the same 
directory in which you ran the script.

[toc] | [prev] | [next] | [standalone]


#372931

FromGreyCloud <Cumulus@mist.com>
Date2016-09-26 18:35 -0600
Message-ID<nsceru$2dh$5@dont-email.me>
In reply to#372918
On 09/26/2016 05:18 PM, DFS wrote:
> On 9/26/2016 1:14 PM, Steve Carroll wrote:
>> On Monday, September 26, 2016 at 10:58:06 AM UTC-6, DFS wrote:
>>> Eastern Europe: Melzzzzz
>>> Southern US: DFS, Ahlstrom, Gohde, Octavian, Tattoo
>>> Western US: Snit, Carroll, Marek
>>> NE US: flattie, -hh, Ezekiel
>>> unknown US: chrisv, ronb, Feeb, JED
>>> 3rd world: sbd
>>> Japan: Taka
>>> Canada: Slimer
>>> Germany: Kohlmann
>>> Great Britain: 7, Desk Rabbit, William Poaster
>>
>>
>> How, exactly, do you get the data? Do you grab it in the terminal
>> and pipe it to a file that you then parse and load into a database?
>> What are the steps involved?
>
>
> "Social engineering": I read and remember.
>
>
>
> * Smelzzzzz said he was from Serbia.
>
> * I'm from Atlanta Georgia USA
>
> * Ahlstrom posted his address to Usenet a long time ago:
>
>           Chris Ahlstrom
>           major league software, llc
>           1259 Center Lake Dr.
>           Mt. Pleasant, SC 29464-7419
>           (843)849-0985
>           a h l s t r o c @bellsouth.net
>
> https://groups.google.com/group/comp.std.c++/msg/c64e40426f7f7d53?hl=pt
>
>
> * Gohde said he lived in Richmond VA
>
>    https://sites.google.com/site/johnhgohde/home/biography
>
>
> * Octavian (extremely anonymous and paranoid) fucked up and posted some
>          specific details about the demographics of his town.
>
>          "68.5% white
>           20.3% black"
>
>          cc Googled and revealed it to be Kannapolis NC.
>
>          Hey, how did it feel to fuckup and be outed like that, Octavian?
>          adrenaline surge?  Go into doomsday mode?  heh!
>
>
> * You Steve Carroll were outed from CO by lamers in csma I
>          believe.  Or maybe you posted it?
>
> * Tattoo, Marek, flattie, -hh and Ezekiel all stated their US
>          residences: WV, CA, NY, NY, MA
>
> * Snit inadvertently exposed his address a long time ago (before my
>          time)
>
> * unknown US: chrisv, ronb, Feeb, JED.
>          - shitv posted a pic of his actual college diploma from the
>            "University of 'Covered By White Tape'"
>          - ronb said he lived in CA at some point
>          - Feeb talked about working for HP and Intuit
>          - Nobody but the USA would claim JED
>
> * 3rd world: sbd is from India, I'm sure of it.  A couple years ago he
>          babbled about 'a massive movement' to Linux in the Indian
>          countryside.
>
> * Taka (Takuya Saitoh) is a Japanese guy
>       https://plus.google.com/105437869953554502665
>
> * Slimer's proud to be Canadian - in fact, he won't stop telling us how
>      great Canada is compared to the US
>
> * Kohlmann was exposed as being from Mainz Germany way back
>
> * 7 was exposed as Joseph Michael from London a long time ago.  He
>       still puts "enemygadgets" in his Usenet organization header, and
>       others found his 'Joseph Michael Inventor of the Year Award' posts
>
> * Desk Rabbit: he uses the UK spelling of some words (honour and such)
>
> * William Poaster: a nym - he inadvertently exposed himself as Geoffrey
>    M. Fitton from the UK a long time ago
>
>
You forgot me!

Hungry Horse, MT.

[toc] | [prev] | [next] | [standalone]


#372938

From"Octavian W. Lagrange" <olagrang@perch.invalid>
Date2016-09-27 05:38 +0000
Message-ID<fhjasgdo98.s@perch.invalid>
In reply to#372931
GreyCloud <Cumulus@mist.com> wrote:
> On 09/26/2016 05:18 PM, DFS wrote:

>>
>>
> You forgot me!
> 
> Hungry Horse, MT.
> 

Awesome name!

[toc] | [prev] | [next] | [standalone]


#372940

FromDFS <nospam@dfs.com>
Date2016-09-27 01:48 -0400
Message-ID<nsd171$5rp$1@dont-email.me>
In reply to#372931
On 9/26/2016 8:35 PM, GreyCloud wrote:
> On 09/26/2016 05:18 PM, DFS wrote:


> You forgot me!

Sorry!  I forgot about Sandman, too (he's from Sweden).



> Hungry Horse, MT.

Tiny place.  pop. 826 at last census.

https://www.google.com/maps/place/Hungry+Horse,+MT/@48.338476,-114.0713259,5204a,20y,5.14h,44.23t/data=!3m1!1e3!4m5!3m4!1s0x5366342597338bb3:0xcfc5f9eeb720ecdc!8m2!3d48.3857979!4d-114.060953



The hills around your town look nice.  Did you ever hike them?

[toc] | [prev] | [next] | [standalone]


#372991

FromGreyCloud <Cumulus@mist.com>
Date2016-09-27 12:08 -0600
Message-ID<nsecj5$p2v$3@dont-email.me>
In reply to#372940
On 09/26/2016 11:48 PM, DFS wrote:
> On 9/26/2016 8:35 PM, GreyCloud wrote:
>> On 09/26/2016 05:18 PM, DFS wrote:
>
>
>> You forgot me!
>
> Sorry!  I forgot about Sandman, too (he's from Sweden).
>
>
>
>> Hungry Horse, MT.
>
> Tiny place.  pop. 826 at last census.
>
> https://www.google.com/maps/place/Hungry+Horse,+MT/@48.338476,-114.0713259,5204a,20y,5.14h,44.23t/data=!3m1!1e3!4m5!3m4!1s0x5366342597338bb3:0xcfc5f9eeb720ecdc!8m2!3d48.3857979!4d-114.060953
>
>
>
>
> The hills around your town look nice.  Did you ever hike them?
>
>
Yes I have and there are plenty of trails to wander.
I just don't bring a dog or peanut butter with me.  Grizzlies like dogs 
and peanut butter.

[toc] | [prev] | [next] | [standalone]


#372945

FromSilver Slimer <.m@nsn.s>
Date2016-09-27 08:48 -0400
Message-ID<nsdpqu$ifb$1@dont-email.me>
In reply to#372931
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

On 2016-09-26 8:35 PM, GreyCloud wrote:
> On 09/26/2016 05:18 PM, DFS wrote:
>> On 9/26/2016 1:14 PM, Steve Carroll wrote:
>>> On Monday, September 26, 2016 at 10:58:06 AM UTC-6, DFS wrote:
>>>> Eastern Europe: Melzzzzz Southern US: DFS, Ahlstrom, Gohde,
>>>> Octavian, Tattoo Western US: Snit, Carroll, Marek NE US:
>>>> flattie, -hh, Ezekiel unknown US: chrisv, ronb, Feeb, JED 3rd
>>>> world: sbd Japan: Taka Canada: Slimer Germany: Kohlmann Great
>>>> Britain: 7, Desk Rabbit, William Poaster
>>> 
>>> 
>>> How, exactly, do you get the data? Do you grab it in the
>>> terminal and pipe it to a file that you then parse and load
>>> into a database? What are the steps involved?
>> 
>> 
>> "Social engineering": I read and remember.
>> 
>> 
>> 
>> * Smelzzzzz said he was from Serbia.
>> 
>> * I'm from Atlanta Georgia USA
>> 
>> * Ahlstrom posted his address to Usenet a long time ago:
>> 
>> Chris Ahlstrom major league software, llc 1259 Center Lake Dr. 
>> Mt. Pleasant, SC 29464-7419 (843)849-0985 a h l s t r o c
>> @bellsouth.net
>> 
>> https://groups.google.com/group/comp.std.c++/msg/c64e40426f7f7d53?hl=
pt
>>
>>
>>
>> 
* Gohde said he lived in Richmond VA
>> 
>> https://sites.google.com/site/johnhgohde/home/biography
>> 
>> 
>> * Octavian (extremely anonymous and paranoid) fucked up and
>> posted some specific details about the demographics of his town.
>> 
>> "68.5% white 20.3% black"
>> 
>> cc Googled and revealed it to be Kannapolis NC.
>> 
>> Hey, how did it feel to fuckup and be outed like that, Octavian? 
>> adrenaline surge?  Go into doomsday mode?  heh!
>> 
>> 
>> * You Steve Carroll were outed from CO by lamers in csma I 
>> believe.  Or maybe you posted it?
>> 
>> * Tattoo, Marek, flattie, -hh and Ezekiel all stated their US 
>> residences: WV, CA, NY, NY, MA
>> 
>> * Snit inadvertently exposed his address a long time ago (before
>> my time)
>> 
>> * unknown US: chrisv, ronb, Feeb, JED. - shitv posted a pic of
>> his actual college diploma from the "University of 'Covered By
>> White Tape'" - ronb said he lived in CA at some point - Feeb
>> talked about working for HP and Intuit - Nobody but the USA would
>> claim JED
>> 
>> * 3rd world: sbd is from India, I'm sure of it.  A couple years
>> ago he babbled about 'a massive movement' to Linux in the Indian 
>> countryside.
>> 
>> * Taka (Takuya Saitoh) is a Japanese guy 
>> https://plus.google.com/105437869953554502665
>> 
>> * Slimer's proud to be Canadian - in fact, he won't stop telling
>> us how great Canada is compared to the US
>> 
>> * Kohlmann was exposed as being from Mainz Germany way back
>> 
>> * 7 was exposed as Joseph Michael from London a long time ago.
>> He still puts "enemygadgets" in his Usenet organization header,
>> and others found his 'Joseph Michael Inventor of the Year Award'
>> posts
>> 
>> * Desk Rabbit: he uses the UK spelling of some words (honour and
>> such)
>> 
>> * William Poaster: a nym - he inadvertently exposed himself as
>> Geoffrey M. Fitton from the UK a long time ago
>> 
>> 
> You forgot me!
> 
> Hungry Horse, MT.

What a cool name for a town.


- -- 
Silver Slimer
Islam is a disease
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2

iQEcBAEBCAAGBQJX6mqoAAoJEIwFfgf/rr+uo7QH/30K3eEn20uypXGoLZYK5hA8
NU3V5rcm7ALDTflo++kaotmiO1oR7jUcQvFzaqFFc6L3obSaqRT5m7Pwa0nJm07h
Xn0p4Nh+mhiEbpXU0zhygG7CrO1q5oKHUHDX1qdBSpdm1G9TJzJl/85d9yG2CjX9
zRIJsX2FbA5BC2mDQFWOH9AmZ/NN6AVhjBsh7Vw/lqIqVo7hRCnxZHAbO5+ceXV6
u6XPqB4GH0NQp0LjT/oa0E50+v5dFoohfyzZ0eaFOiaEw3qSflP1suAw8MG/Y+Eh
xgOEQHso0s4XskqUtaw6dK5TuMDeHKzho0vD7ciU+nDbIfHLwm9orqptd7rJ27A=
=qOhh
-----END PGP SIGNATURE-----

[toc] | [prev] | [next] | [standalone]


#372993

FromGreyCloud <Cumulus@mist.com>
Date2016-09-27 12:10 -0600
Message-ID<nseclj$p2v$4@dont-email.me>
In reply to#372945
On 09/27/2016 06:48 AM, Silver Slimer wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA256
>
> On 2016-09-26 8:35 PM, GreyCloud wrote:
>> On 09/26/2016 05:18 PM, DFS wrote:
>>> On 9/26/2016 1:14 PM, Steve Carroll wrote:
>>>> On Monday, September 26, 2016 at 10:58:06 AM UTC-6, DFS wrote:
>>>>> Eastern Europe: Melzzzzz Southern US: DFS, Ahlstrom, Gohde,
>>>>> Octavian, Tattoo Western US: Snit, Carroll, Marek NE US:
>>>>> flattie, -hh, Ezekiel unknown US: chrisv, ronb, Feeb, JED 3rd
>>>>> world: sbd Japan: Taka Canada: Slimer Germany: Kohlmann Great
>>>>> Britain: 7, Desk Rabbit, William Poaster
>>>>
>>>>
>>>> How, exactly, do you get the data? Do you grab it in the
>>>> terminal and pipe it to a file that you then parse and load
>>>> into a database? What are the steps involved?
>>>
>>>
>>> "Social engineering": I read and remember.
>>>
>>>
>>>
>>> * Smelzzzzz said he was from Serbia.
>>>
>>> * I'm from Atlanta Georgia USA
>>>
>>> * Ahlstrom posted his address to Usenet a long time ago:
>>>
>>> Chris Ahlstrom major league software, llc 1259 Center Lake Dr.
>>> Mt. Pleasant, SC 29464-7419 (843)849-0985 a h l s t r o c
>>> @bellsouth.net
>>>
>>> https://groups.google.com/group/comp.std.c++/msg/c64e40426f7f7d53?hl=
> pt
>>>
>>>
>>>
>>>
> * Gohde said he lived in Richmond VA
>>>
>>> https://sites.google.com/site/johnhgohde/home/biography
>>>
>>>
>>> * Octavian (extremely anonymous and paranoid) fucked up and
>>> posted some specific details about the demographics of his town.
>>>
>>> "68.5% white 20.3% black"
>>>
>>> cc Googled and revealed it to be Kannapolis NC.
>>>
>>> Hey, how did it feel to fuckup and be outed like that, Octavian?
>>> adrenaline surge?  Go into doomsday mode?  heh!
>>>
>>>
>>> * You Steve Carroll were outed from CO by lamers in csma I
>>> believe.  Or maybe you posted it?
>>>
>>> * Tattoo, Marek, flattie, -hh and Ezekiel all stated their US
>>> residences: WV, CA, NY, NY, MA
>>>
>>> * Snit inadvertently exposed his address a long time ago (before
>>> my time)
>>>
>>> * unknown US: chrisv, ronb, Feeb, JED. - shitv posted a pic of
>>> his actual college diploma from the "University of 'Covered By
>>> White Tape'" - ronb said he lived in CA at some point - Feeb
>>> talked about working for HP and Intuit - Nobody but the USA would
>>> claim JED
>>>
>>> * 3rd world: sbd is from India, I'm sure of it.  A couple years
>>> ago he babbled about 'a massive movement' to Linux in the Indian
>>> countryside.
>>>
>>> * Taka (Takuya Saitoh) is a Japanese guy
>>> https://plus.google.com/105437869953554502665
>>>
>>> * Slimer's proud to be Canadian - in fact, he won't stop telling
>>> us how great Canada is compared to the US
>>>
>>> * Kohlmann was exposed as being from Mainz Germany way back
>>>
>>> * 7 was exposed as Joseph Michael from London a long time ago.
>>> He still puts "enemygadgets" in his Usenet organization header,
>>> and others found his 'Joseph Michael Inventor of the Year Award'
>>> posts
>>>
>>> * Desk Rabbit: he uses the UK spelling of some words (honour and
>>> such)
>>>
>>> * William Poaster: a nym - he inadvertently exposed himself as
>>> Geoffrey M. Fitton from the UK a long time ago
>>>
>>>
>> You forgot me!
>>
>> Hungry Horse, MT.
>
> What a cool name for a town.
>

It was named that way because when some settlers moved in they found one 
hungry horse that was reduced to skin and bones, so they fed the horse 
and then liked the area.  Hence its name.

[toc] | [prev] | [next] | [standalone]


#373068

FromSilver Slimer <.m@nsn.s>
Date2016-09-27 20:09 -0400
Message-ID<nsf1oc$5q5$1@dont-email.me>
In reply to#372993
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

On 2016-09-27 2:10 PM, GreyCloud wrote:
> On 09/27/2016 06:48 AM, Silver Slimer wrote:
>> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256
>> 
>> On 2016-09-26 8:35 PM, GreyCloud wrote:
>>> On 09/26/2016 05:18 PM, DFS wrote:
>>>> On 9/26/2016 1:14 PM, Steve Carroll wrote:
>>>>> On Monday, September 26, 2016 at 10:58:06 AM UTC-6, DFS
>>>>> wrote:
>>>>>> Eastern Europe: Melzzzzz Southern US: DFS, Ahlstrom,
>>>>>> Gohde, Octavian, Tattoo Western US: Snit, Carroll, Marek
>>>>>> NE US: flattie, -hh, Ezekiel unknown US: chrisv, ronb,
>>>>>> Feeb, JED 3rd world: sbd Japan: Taka Canada: Slimer
>>>>>> Germany: Kohlmann Great Britain: 7, Desk Rabbit, William
>>>>>> Poaster
>>>>> 
>>>>> 
>>>>> How, exactly, do you get the data? Do you grab it in the 
>>>>> terminal and pipe it to a file that you then parse and
>>>>> load into a database? What are the steps involved?
>>>> 
>>>> 
>>>> "Social engineering": I read and remember.
>>>> 
>>>> 
>>>> 
>>>> * Smelzzzzz said he was from Serbia.
>>>> 
>>>> * I'm from Atlanta Georgia USA
>>>> 
>>>> * Ahlstrom posted his address to Usenet a long time ago:
>>>> 
>>>> Chris Ahlstrom major league software, llc 1259 Center Lake
>>>> Dr. Mt. Pleasant, SC 29464-7419 (843)849-0985 a h l s t r o
>>>> c @bellsouth.net
>>>> 
>>>> https://groups.google.com/group/comp.std.c++/msg/c64e40426f7f7d53?h
l=
>>
>>>> 
pt
>>>> 
>>>> 
>>>> 
>>>> 
>> * Gohde said he lived in Richmond VA
>>>> 
>>>> https://sites.google.com/site/johnhgohde/home/biography
>>>> 
>>>> 
>>>> * Octavian (extremely anonymous and paranoid) fucked up and 
>>>> posted some specific details about the demographics of his
>>>> town.
>>>> 
>>>> "68.5% white 20.3% black"
>>>> 
>>>> cc Googled and revealed it to be Kannapolis NC.
>>>> 
>>>> Hey, how did it feel to fuckup and be outed like that,
>>>> Octavian? adrenaline surge?  Go into doomsday mode?  heh!
>>>> 
>>>> 
>>>> * You Steve Carroll were outed from CO by lamers in csma I 
>>>> believe.  Or maybe you posted it?
>>>> 
>>>> * Tattoo, Marek, flattie, -hh and Ezekiel all stated their
>>>> US residences: WV, CA, NY, NY, MA
>>>> 
>>>> * Snit inadvertently exposed his address a long time ago
>>>> (before my time)
>>>> 
>>>> * unknown US: chrisv, ronb, Feeb, JED. - shitv posted a pic
>>>> of his actual college diploma from the "University of
>>>> 'Covered By White Tape'" - ronb said he lived in CA at some
>>>> point - Feeb talked about working for HP and Intuit - Nobody
>>>> but the USA would claim JED
>>>> 
>>>> * 3rd world: sbd is from India, I'm sure of it.  A couple
>>>> years ago he babbled about 'a massive movement' to Linux in
>>>> the Indian countryside.
>>>> 
>>>> * Taka (Takuya Saitoh) is a Japanese guy 
>>>> https://plus.google.com/105437869953554502665
>>>> 
>>>> * Slimer's proud to be Canadian - in fact, he won't stop
>>>> telling us how great Canada is compared to the US
>>>> 
>>>> * Kohlmann was exposed as being from Mainz Germany way back
>>>> 
>>>> * 7 was exposed as Joseph Michael from London a long time
>>>> ago. He still puts "enemygadgets" in his Usenet organization
>>>> header, and others found his 'Joseph Michael Inventor of the
>>>> Year Award' posts
>>>> 
>>>> * Desk Rabbit: he uses the UK spelling of some words (honour
>>>> and such)
>>>> 
>>>> * William Poaster: a nym - he inadvertently exposed himself
>>>> as Geoffrey M. Fitton from the UK a long time ago
>>>> 
>>>> 
>>> You forgot me!
>>> 
>>> Hungry Horse, MT.
>> 
>> What a cool name for a town.
>> 
> 
> It was named that way because when some settlers moved in they
> found one hungry horse that was reduced to skin and bones, so they
> fed the horse and then liked the area.  Hence its name.

And an even cuter story! :)


- -- 
Silver Slimer
Islam is a disease
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2

iQEcBAEBCAAGBQJX6wpXAAoJEIwFfgf/rr+uOCgH/1JH+qxsMtuU5V934Z3kKBbI
fSEwC8z94FpVG9V+dS6fKysvApv7BE/Hcb3UCuLeKCLTHBo+0jODYrtVkpmpyLtA
G3MB01yI9IhRWBIZBs7YtydquT4/Muy1LWQ3diY71rEtbm33gnxU+QszLIWHg0V7
7DWG3Jbehj0CbvBgJT/S5b6ppp2JBxY0lXCAXquOHXwaMnwagcqrdTPOS5DWCQpV
isy5F/e15jM/ekqHVWROGfvxmXSQL5E1fWdIa3gY2XcLNgoXi9rLoNWqqQD13i72
91vbiH5uv+Tw2WEYD0FEgxcMUgs9U2AWKUEvLQkcA31tCx7lMEhJ7rkTRuiLwGQ=
=3t41
-----END PGP SIGNATURE-----

[toc] | [prev] | [next] | [standalone]


#372942

From"Octavian W. Lagrange" <olagrang@perch.invalid>
Date2016-09-27 05:57 +0000
Message-ID<hjasugooe.e99@perch.invalid>
In reply to#372918
DFS <nospam@dfs.com> wrote:
> On 9/26/2016 1:14 PM, Steve Carroll wrote:
>> On Monday, September 26, 2016 at 10:58:06 AM UTC-6, DFS wrote:
>>> Eastern Europe: Melzzzzz
>>> Southern US: DFS, Ahlstrom, Gohde, Octavian, Tattoo
>>> Western US: Snit, Carroll, Marek
>>> NE US: flattie, -hh, Ezekiel
>>> unknown US: chrisv, ronb, Feeb, JED
>>> 3rd world: sbd
>>> Japan: Taka
>>> Canada: Slimer
>>> Germany: Kohlmann
>>> Great Britain: 7, Desk Rabbit, William Poaster
>>
>>
>> How, exactly, do you get the data? Do you grab it in the terminal
>> and pipe it to a file that you then parse and load into a database?
>> What are the steps involved?
> 
> 
> "Social engineering": I read and remember.
> 
> 
> 
> * Smelzzzzz said he was from Serbia.
> 
> * I'm from Atlanta Georgia USA
> 
> * Ahlstrom posted his address to Usenet a long time ago:
> 
>           Chris Ahlstrom
>           major league software, llc
>           1259 Center Lake Dr.
>           Mt. Pleasant, SC 29464-7419
>           (843)849-0985
>           a h l s t r o c @bellsouth.net
> 
> https://groups.google.com/group/comp.std.c++/msg/c64e40426f7f7d53?hl=pt
> 
> 
> * Gohde said he lived in Richmond VA
> 
>    https://sites.google.com/site/johnhgohde/home/biography
> 
> 
> * Octavian (extremely anonymous and paranoid) fucked up and posted some
>          specific details about the demographics of his town.
> 
>          "68.5% white
>           20.3% black"
> 
>          cc Googled and revealed it to be Kannapolis NC.
> 
>          Hey, how did it feel to fuckup and be outed like that, Octavian?
>          adrenaline surge?  Go into doomsday mode?  heh!
> 

LOL 

Did I tell you I lived in Decatur in the sixties?   Went to Grant Park Zoo a lot.
I remember Willie B.  Was sad to hear of his death, but it's good to know they 
finally let him out of that fucking glass and concrete prison he was in back then.

https://en.wikipedia.org/wiki/Willie_B.

[toc] | [prev] | [next] | [standalone]


#372960

FromDFS <nospam@dfs.com>
Date2016-09-27 11:10 -0400
Message-ID<nse25k$hh7$4@dont-email.me>
In reply to#372942
On 9/27/2016 1:57 AM, Octavian W. Lagrange wrote:
> DFS <nospam@dfs.com> wrote:


>> * Octavian (extremely anonymous and paranoid) fucked up and posted some
>>          specific details about the demographics of his town.
>>
>>          "68.5% white
>>           20.3% black"
>>
>>          cc Googled and revealed it to be Kannapolis NC.
>>
>>          Hey, how did it feel to fuckup and be outed like that, Octavian?
>>          adrenaline surge?  Go into doomsday mode?  heh!
>>
>
> LOL
>
> Did I tell you I lived in Decatur in the sixties?   Went to Grant Park Zoo a lot.
> I remember Willie B.  Was sad to hear of his death, but it's good to know they
> finally let him out of that fucking glass and concrete prison he was in back then.
>
> https://en.wikipedia.org/wiki/Willie_B.



Yeah, Willie B was awesome.  They eventually let him outside and he did 
well.  It's now 'Zoo Atlanta'.  Haven't been there in a long time - I 
don't like to see animals in captivity.

For a while in the late sixties/early seventies I lived a few miles from 
Decatur, and used to go to downtown Decatur to a hobby shop where you 
could race little slot cars around a track.

http://slotblog.net/topic/41997-hobby-housedecatur-speedway/


[toc] | [prev] | [next] | [standalone]


#372963

From"Octavian W. Lagrange" <olagrang@perch.invalid>
Date2016-09-27 15:46 +0000
Message-ID<hjasgud83.jgu@perch.invalid>
In reply to#372960
DFS <nospam@dfs.com> wrote:
> On 9/27/2016 1:57 AM, Octavian W. Lagrange wrote:
>> DFS <nospam@dfs.com> wrote:
> 
> 
>>> * Octavian (extremely anonymous and paranoid) fucked up and posted some
>>>          specific details about the demographics of his town.
>>>
>>>          "68.5% white
>>>           20.3% black"
>>>
>>>          cc Googled and revealed it to be Kannapolis NC.
>>>
>>>          Hey, how did it feel to fuckup and be outed like that, Octavian?
>>>          adrenaline surge?  Go into doomsday mode?  heh!
>>>
>>
>> LOL
>>
>> Did I tell you I lived in Decatur in the sixties?   Went to Grant Park Zoo a lot.
>> I remember Willie B.  Was sad to hear of his death, but it's good to know they
>> finally let him out of that fucking glass and concrete prison he was in back then.
>>
>> https://en.wikipedia.org/wiki/Willie_B.
> 
> 
> 
> Yeah, Willie B was awesome.  They eventually let him outside and he did 
> well.  It's now 'Zoo Atlanta'.  Haven't been there in a long time - I 
> don't like to see animals in captivity.
> 
> For a while in the late sixties/early seventies I lived a few miles from 
> Decatur, and used to go to downtown Decatur to a hobby shop where you 
> could race little slot cars around a track.
> 
> http://slotblog.net/topic/41997-hobby-housedecatur-speedway/
> 
 
I think I went there once.  Some friends and I were into building models,
and I remember one day a buddy's mom drove us to some store to get
one and it had an area with these big tables with slot car tracks.  
If that's the place, maybe they have parking in back or something,
because it seems like we pulled the car in facing the building directly.
It might have been a different place though.

[toc] | [prev] | [next] | [standalone]


#372956

FromIncubus <incubus9536612@gmail.com>
Date2016-09-27 07:54 -0700
Message-ID<4efcfe14-e069-44b2-9b58-19c4a0058ae4@googlegroups.com>
In reply to#372918
On Monday, September 26, 2016 at 11:19:06 PM UTC, DFS wrote:

> * 7 was exposed as Joseph Michael from London a long time ago.  He
>        still puts "enemygadgets" in his Usenet organization header, and
>        others found his 'Joseph Michael Inventor of the Year Award' posts

7 is what comes to Britain when a Labour government gets voted in...

> * Desk Rabbit: he uses the UK spelling of some words (honour and such)

So do people from Australia and New Zealand.

[toc] | [prev] | [next] | [standalone]


#372961

FromSilver Slimer <.m@nsn.s>
Date2016-09-27 11:18 -0400
Message-ID<nse2j8$k06$1@dont-email.me>
In reply to#372956
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

On 2016-09-27 10:54 AM, Incubus wrote:
> On Monday, September 26, 2016 at 11:19:06 PM UTC, DFS wrote:
> 
>> * 7 was exposed as Joseph Michael from London a long time ago.
>> He still puts "enemygadgets" in his Usenet organization header,
>> and others found his 'Joseph Michael Inventor of the Year Award'
>>  posts
> 
> 7 is what comes to Britain when a Labour government gets voted 
> in...
> 
>> * Desk Rabbit: he uses the UK spelling of some words (honour and
>>  such)
> 
> So do people from Australia and New Zealand.

And self-respecting Canadians.


- -- 
Silver Slimer
Islam is a disease
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2

iQEcBAEBCAAGBQJX6o2zAAoJEIwFfgf/rr+uigcH/1K1CzlFPifocp+42WQbWnqq
HDcxWy2jPE/P/5I73Q/KTKb0b/vpTNZ9APMQhuKFZADRfOo/QkEAOlb6ZWX1ucuE
PHX1PuzkyREQXgGXYv63UDsDEdmvFfrnEbFq18DQYqHScVwHSnuhXeMaEBQ3MdYJ
v9YVrD0SsxV2u7SfixDN7ge8Iz3qXHlZkfsPP6T2U3Z79lBoqB1ysBpWmUUJVerI
sknKzxiiv5YEmLR67rXHanmqfTOGxpbH01/W+9tkxh0VTqNNXiM/YhulTaoqtCLn
22B/1M9e2PTAhy0HIt2JNVJXB13dG1MufSdT24T0V26M7DyZfwaviW3/DOdcpVU=
=8lrn
-----END PGP SIGNATURE-----

[toc] | [prev] | [next] | [standalone]


#372962

FromDFS <nospam@dfs.com>
Date2016-09-27 11:28 -0400
Message-ID<nse375$mdc$1@dont-email.me>
In reply to#372961
On 9/27/2016 11:18 AM, Silver Slimer wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA256
>
> On 2016-09-27 10:54 AM, Incubus wrote:
>> On Monday, September 26, 2016 at 11:19:06 PM UTC, DFS wrote:
>>
>>> * 7 was exposed as Joseph Michael from London a long time ago.
>>> He still puts "enemygadgets" in his Usenet organization header,
>>> and others found his 'Joseph Michael Inventor of the Year Award'
>>>  posts
>>
>> 7 is what comes to Britain when a Labour government gets voted
>> in...
>>
>>> * Desk Rabbit: he uses the UK spelling of some words (honour and
>>>  such)
>>
>> So do people from Australia and New Zealand.
>
> And self-respecting Canadians.


You found one?

:)

[toc] | [prev] | [next] | [standalone]


#372864

Fromfr314159@gmail.com
Date2016-09-26 10:23 -0700
Message-ID<70989519-c4c0-43cb-b8fd-05d63da42517@googlegroups.com>
In reply to#372861
On Monday, September 26, 2016 at 12:58:06 PM UTC-4, DFS wrote:

> 
> [snip boring and useless pseudo-contribution]
>

What, no Swedes?  Is no one from the Feminist Republic of Sweden?

In Sweden, the women rule and the men smooch their asses like
wimpy, toady fawns.  One would therefore believe that this NG
would be overrun by Swedish idiots.

Maybe, out of shame, they all attempt to disguise the fact.

But don't fear.  In 10 years Swedes will be extinct.  There's
only a few million left and they are dwindling fast.

[toc] | [prev] | [next] | [standalone]


Page 3 of 4 — ← Prev page 1 2 [3] 4  Next page →

Back to top | Article view | comp.os.linux.advocacy


csiph-web