Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]
Groups > comp.os.linux.advocacy > #372861 > unrolled thread
| Started by | DFS <nospam@dfs.com> |
|---|---|
| First post | 2016-09-26 12:57 -0400 |
| Last post | 2016-09-27 13:34 -0700 |
| Articles | 20 on this page of 67 — 16 participants |
Back to article view | Back to comp.os.linux.advocacy
Geographic breakdown of cola regs DFS <nospam@dfs.com> - 2016-09-26 12:57 -0400
Re: Geographic breakdown of cola regs Steve Carroll <fretwizzer@gmail.com> - 2016-09-26 10:14 -0700
Re: Geographic breakdown of cola regs Silver Slimer <.m@nsn.s> - 2016-09-26 13:38 -0400
Re: Geographic breakdown of cola regs Steve Carroll <fretwizzer@gmail.com> - 2016-09-26 10:48 -0700
Re: Geographic breakdown of cola regs Silver Slimer <.m@nsn.s> - 2016-09-26 13:56 -0400
Re: Geographic breakdown of cola regs Steve Carroll <fretwizzer@gmail.com> - 2016-09-26 11:09 -0700
Re: Geographic breakdown of cola regs Silver Slimer <.m@nsn.s> - 2016-09-26 14:13 -0400
Re: Geographic breakdown of cola regs "Octavian W. Lagrange" <olagrang@perch.invalid> - 2016-09-26 18:30 +0000
Re: Geographic breakdown of cola regs Silver Slimer <.m@nsn.s> - 2016-09-26 16:51 -0400
Re: Geographic breakdown of cola regs "Octavian W. Lagrange" <olagrang@perch.invalid> - 2016-09-27 19:06 +0000
Re: Geographic breakdown of cola regs Snit <usenet@gallopinginsanity.com> - 2016-09-27 12:32 -0700
Re: Geographic breakdown of cola regs "Octavian W. Lagrange" <olagrang@perch.invalid> - 2016-09-27 19:50 +0000
Re: Geographic breakdown of cola regs Snit <usenet@gallopinginsanity.com> - 2016-09-27 13:19 -0700
Re: Geographic breakdown of cola regs Silver Slimer <.m@nsn.s> - 2016-09-27 20:12 -0400
Re: Geographic breakdown of cola regs Silver Slimer <.m@nsn.s> - 2016-09-28 08:01 -0400
Re: Geographic breakdown of cola regs Jim Polaski <jpolaski@linuxmail.org> - 2016-09-28 14:18 +0000
Re: Geographic breakdown of cola regs Snit <usenet@gallopinginsanity.com> - 2016-09-28 08:46 -0700
Re: Geographic breakdown of cola regs Steve Carroll <fretwizzer@gmail.com> - 2016-09-28 10:00 -0700
Re: Geographic breakdown of cola regs Silver Slimer <.m@nsn.s> - 2016-09-28 14:55 -0400
Re: Geographic breakdown of cola regs Marek Novotny <marek.novotny@marspolar.com> - 2016-09-26 19:06 +0000
Re: Geographic breakdown of cola regs chrisv <chrisv@nospam.invalid> - 2016-09-26 14:12 -0500
Re: Geographic breakdown of cola regs GreyCloud <Cumulus@mist.com> - 2016-09-26 13:53 -0600
Re: Geographic breakdown of cola regs DFS <nospam@dfs.com> - 2016-09-26 19:03 -0400
Re: Geographic breakdown of cola regs GreyCloud <Cumulus@mist.com> - 2016-09-26 18:32 -0600
Re: Geographic breakdown of cola regs -hh <recscuba_google@huntzinger.com> - 2016-09-27 15:35 -0700
Re: Geographic breakdown of cola regs GreyCloud <Cumulus@mist.com> - 2016-09-27 16:45 -0600
Re: Geographic breakdown of cola regs William Poaster <wp@dev.null> - 2016-09-26 22:35 +0100
Re: Geographic breakdown of cola regs Chris Ahlstrom <OFeem1987@teleworm.us> - 2016-09-26 17:55 -0400
Re: Geographic breakdown of cola regs DFS <nospam@dfs.com> - 2016-09-26 19:04 -0400
Re: Geographic breakdown of cola regs Silver Slimer <.m@nsn.s> - 2016-09-26 16:55 -0400
Re: Geographic breakdown of cola regs Snit <usenet@gallopinginsanity.com> - 2016-09-26 14:08 -0700
Re: Geographic breakdown of cola regs Peter Köhlmann <peter-koehlmann@t-online.de> - 2016-09-27 00:19 +0200
Re: Geographic breakdown of cola regs Silver Slimer <.m@nsn.s> - 2016-09-26 18:38 -0400
Re: Geographic breakdown of cola regs Snit <usenet@gallopinginsanity.com> - 2016-09-26 15:27 -0700
Re: Geographic breakdown of cola regs DFS <nospam@dfs.com> - 2016-09-26 19:18 -0400
Re: Geographic breakdown of cola regs Silver Slimer <.m@nsn.s> - 2016-09-26 19:22 -0400
Re: Geographic breakdown of cola regs Snit <usenet@gallopinginsanity.com> - 2016-09-26 16:36 -0700
Re: Geographic breakdown of cola regs Steve Carroll <fretwizzer@gmail.com> - 2016-09-26 17:54 -0700
Re: Geographic breakdown of cola regs DFS <nospam@dfs.com> - 2016-09-27 11:09 -0400
Re: Geographic breakdown of cola regs Steve Carroll <fretwizzer@gmail.com> - 2016-09-27 08:58 -0700
Re: Geographic breakdown of cola regs Steve Carroll <fretwizzer@gmail.com> - 2016-09-27 09:50 -0700
Re: Geographic breakdown of cola regs DFS <nospam@dfs.com> - 2016-09-27 14:33 -0400
Re: Geographic breakdown of cola regs Steve Carroll <fretwizzer@gmail.com> - 2016-09-27 12:24 -0700
Re: Geographic breakdown of cola regs DFS <nospam@dfs.com> - 2016-09-29 19:51 -0400
Re: Geographic breakdown of cola regs Steve Carroll <fretwizzer@gmail.com> - 2016-09-29 17:22 -0700
Re: Geographic breakdown of cola regs DFS <nospam@dfs.com> - 2016-09-29 23:27 -0400
Re: Geographic breakdown of cola regs GreyCloud <Cumulus@mist.com> - 2016-09-26 18:35 -0600
Re: Geographic breakdown of cola regs "Octavian W. Lagrange" <olagrang@perch.invalid> - 2016-09-27 05:38 +0000
Re: Geographic breakdown of cola regs DFS <nospam@dfs.com> - 2016-09-27 01:48 -0400
Re: Geographic breakdown of cola regs GreyCloud <Cumulus@mist.com> - 2016-09-27 12:08 -0600
Re: Geographic breakdown of cola regs Silver Slimer <.m@nsn.s> - 2016-09-27 08:48 -0400
Re: Geographic breakdown of cola regs GreyCloud <Cumulus@mist.com> - 2016-09-27 12:10 -0600
Re: Geographic breakdown of cola regs Silver Slimer <.m@nsn.s> - 2016-09-27 20:09 -0400
Re: Geographic breakdown of cola regs "Octavian W. Lagrange" <olagrang@perch.invalid> - 2016-09-27 05:57 +0000
Re: Geographic breakdown of cola regs DFS <nospam@dfs.com> - 2016-09-27 11:10 -0400
Re: Geographic breakdown of cola regs "Octavian W. Lagrange" <olagrang@perch.invalid> - 2016-09-27 15:46 +0000
Re: Geographic breakdown of cola regs Incubus <incubus9536612@gmail.com> - 2016-09-27 07:54 -0700
Re: Geographic breakdown of cola regs Silver Slimer <.m@nsn.s> - 2016-09-27 11:18 -0400
Re: Geographic breakdown of cola regs DFS <nospam@dfs.com> - 2016-09-27 11:28 -0400
Re: Geographic breakdown of cola regs fr314159@gmail.com - 2016-09-26 10:23 -0700
Re: Geographic breakdown of cola regs Sandman <mr@sandman.net> - 2016-09-27 09:06 +0000
Re: Geographic breakdown of cola regs GreyCloud <Cumulus@mist.com> - 2016-09-27 12:11 -0600
Re: Geographic breakdown of cola regs Peter Köhlmann <peter-koehlmann@t-online.de> - 2016-09-27 20:28 +0200
Re: Geographic breakdown of cola regs GreyCloud <Cumulus@mist.com> - 2016-09-27 15:04 -0600
Re: Geographic breakdown of cola regs Chris Ahlstrom <OFeem1987@teleworm.us> - 2016-09-27 19:00 -0400
Re: Geographic breakdown of cola regs Sandman <mr@sandman.net> - 2016-09-27 20:32 +0000
Re: Geographic breakdown of cola regs Snit <usenet@gallopinginsanity.com> - 2016-09-27 13:34 -0700
Page 3 of 4 — ← Prev page 1 2 [3] 4 Next page →
| From | Steve Carroll <fretwizzer@gmail.com> |
|---|---|
| Date | 2016-09-27 09:50 -0700 |
| Message-ID | <e44eb1f5-d9f2-43a8-b758-5c54512514b0@googlegroups.com> |
| In reply to | #372970 |
On Tuesday, September 27, 2016 at 9:59:07 AM UTC-6, Steve Carroll wrote: (snip) > This is a great response, exactly what I was looking for... thanks! > I've had trouble with getting pip happening but I will solve it at some > point and will give this a try if I can load the proper libraries required. I did get the script to work, now I have to figure out WTF you were talking about with that other stuff ;) How did you grab the entire history and put it into a db? Using this script with different parameters? Wouldn't that be a HUGE file? And then, after that, how do you ascertain how to get additional posts that you don't already have, by checking message IDs?
[toc] | [prev] | [next] | [standalone]
| From | DFS <nospam@dfs.com> |
|---|---|
| Date | 2016-09-27 14:33 -0400 |
| Message-ID | <nsee28$1ii$1@dont-email.me> |
| In reply to | #372979 |
On 9/27/2016 12:50 PM, Steve Carroll wrote:
> On Tuesday, September 27, 2016 at 9:59:07 AM UTC-6, Steve Carroll
> wrote: (snip)
>> This is a great response, exactly what I was looking for... thanks!
>> I've had trouble with getting pip happening but I will solve it at
>> some point and will give this a try if I can load the proper
>> libraries required.
>
> I did get the script to work, now I have to figure out WTF you were
> talking about with that other stuff ;)
python lists, baby!
Data comes back from the server in list objects, and you need to extract
the data from the lists to add it to your relational db.
> How did you grab the entire
> history and put it into a db?
Took a long time, because you don't want to ask for 50K or 100K articles
at a time. You probably can, but the server admin might notice and
scold you, or ban you if you do it a lot.
First I downloaded every articleID on the server (and the post date), to
see what was there. As I recall I grabbed 1000 at a time in a loop -
with 375K posts it probably took a few minutes. Then I saw that on
eternal-sep, the articleID sequence went directly from 1 to 201860. 1
was a 2007 post, and 201860 was a Oct 2010 post. Not sure why he keeps 1.
So I used the range of 201860 to 595126 (or whatever was the latest ID
at the time - this was a few months ago) to build my db.
Then I went through each header I was interested in (From, Subject,
MessageID, User-Agent, Newsgroups, References, InjectionInfo) and
downloaded the header info for that range of articles 201860-595126.
Then I went back and got the Body for each post in that range. That was
the slowest part by far. I think I did 100 posts at a time, store each
line separately, parse the new content out, etc. I'd kick off the
program and let it run for a range of 10,000 posts, 100 at a loop.
Probably spent 2-3 days on it, off and on.
Sandman uses something called 'suck' which retrieves NNTP data
differently. Then he parses the data locally, I believe. It might be
worth looking into.
> Using this script with different parameters?
Similar script, but much larger. To build the db initially, I used a
few scripts. After the db was populated I created a maintenance script,
which just gets the latest posts since the last time it was run.
--------------------------------------------
> python nntp_updatedb.py
connecting...
added new articles: 605335-605532
updated Subject
updated From
updated Message-ID
updated User-Agent
updated Newsgroups
updated injection info
updated References
updated message bodies
added new content
Updated USENET.sqlite: 2.6e+02 seconds
--------------------------------------------
It now takes several minutes to store 200 posts. Too slow.
The message bodies and new content part took as much as all other parts
combined. I need to look at the BODY table, maybe drop an index. And
fix the timer code.
And the 'get new content' routine is a little fubar for GoogleGroup posts.
So there are a few tweaks needed.
> Wouldn't that be a HUGE file?
Pretty large. The SQLite db is a little over 3GB now, including
indexes. And that's normalized about as much as I could. Each From and
Subject and User-Agent is stored only once.
I like the tight design, but some queries are fast and some are slow. It
can be a pain to query, actually.
The BODY table is now 17.48M rows, and indexed. It's getting slow to
populate.
Sometimes the SQLiteStudio app even freezes and crashes.
> And then, after that, how
> do you ascertain how to get additional posts that you don't already
> have, by checking message IDs?
Not with message IDs, but with article IDs. Check the latest (largest)
articleID assigned by the NNTP server against the latest articleID
stored in your system.
The server response to the group command tells you the latest articleID
available on the server, for that group:
resp, IDs, begID, endID, grpNm = news.group('comp.os.linux.advocacy')
resp: 211 394563 1 605472 comp.os.linux.advocacy
211 = command completed OK
394563 = number of articles available for that group
1 = earliest articleID for that group
605472 = latest articleID for that group
comp.os.linux.advocacy = group name
And with a successful response, python has already parsed the response
and assigned values to the variables in the command:
resp, IDs, begID, endID, grpNm = news.group('comp.os.linux.advocacy')
resp = "211 394563 1 605472 comp.os.linux.advocacy"
IDs = 394563
begID = 1
endID = 605472
grpNm = "comp.os.linux.advocacy"
So now you compare the max articleID in your database (say 605452)
against the latest articleID on the server (in this example, it's endID
= 605472). So you're missing the last 20 posts.
You should /definitely/ store the article ID assigned by the server. The
article ID is unique for that post for that group for that server, but
since your Usenet server company could shut down, you also need to keep
track of which server assigned the article ID. So I ended up assigning
my own PostID:
CREATE TABLE POSTID (
POSTID INTEGER NOT NULL PRIMARY KEY AUTOINCREMENT,
SERVERID INTEGER NOT NULL REFERENCES NNTP_SERVER (SERVERID) ON UPDATE
CASCADE,
GROUPID INTEGER NOT NULL REFERENCES NNTP_GROUP (GROUPID) ON UPDATE CASCADE,
ARTICLEID INTEGER NOT NULL
);
With that structure, you only have to add one new entry to the
NNTP_SERVER table, point the code to the new NNTP server, and continue
on. No other changes to the code or db required. Theoretically. It's
possible the new server doesn't support the same headers (eg some use
'User-Agent', others use 'X-Newsreader' I believe) so that would be a
minor tweak. But it's super easy to use the same script to download
other groups from the same or other servers.
[toc] | [prev] | [next] | [standalone]
| From | Steve Carroll <fretwizzer@gmail.com> |
|---|---|
| Date | 2016-09-27 12:24 -0700 |
| Message-ID | <acbb73a7-9c4e-4826-b5b3-1a0ab61380f0@googlegroups.com> |
| In reply to | #373005 |
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512
On Tuesday, September 27, 2016 at 12:33:57 PM UTC-6, DFS wrote:
> On 9/27/2016 12:50 PM, Steve Carroll wrote:
> > On Tuesday, September 27, 2016 at 9:59:07 AM UTC-6, Steve Carroll
> > wrote: (snip)
> >> This is a great response, exactly what I was looking for... thanks!
> >> I've had trouble with getting pip happening but I will solve it at
> >> some point and will give this a try if I can load the proper
> >> libraries required.
> >
> > I did get the script to work, now I have to figure out WTF you were
> > talking about with that other stuff ;)
>
> python lists, baby!
>
> Data comes back from the server in list objects, and you need to extract
> the data from the lists to add it to your relational db.
>
>
>
> > How did you grab the entire
> > history and put it into a db?
>
> Took a long time, because you don't want to ask for 50K or 100K articles
> at a time. You probably can, but the server admin might notice and
> scold you, or ban you if you do it a lot.
>
> First I downloaded every articleID on the server (and the post date), to
> see what was there. As I recall I grabbed 1000 at a time in a loop -
> with 375K posts it probably took a few minutes. Then I saw that on
> eternal-sep, the articleID sequence went directly from 1 to 201860. 1
> was a 2007 post, and 201860 was a Oct 2010 post. Not sure why he keeps 1.
>
> So I used the range of 201860 to 595126 (or whatever was the latest ID
> at the time - this was a few months ago) to build my db.
>
> Then I went through each header I was interested in (From, Subject,
> MessageID, User-Agent, Newsgroups, References, InjectionInfo) and
> downloaded the header info for that range of articles 201860-595126.
>
> Then I went back and got the Body for each post in that range. That was
> the slowest part by far. I think I did 100 posts at a time, store each
> line separately, parse the new content out, etc. I'd kick off the
> program and let it run for a range of 10,000 posts, 100 at a loop.
> Probably spent 2-3 days on it, off and on.
>
> Sandman uses something called 'suck' which retrieves NNTP data
> differently. Then he parses the data locally, I believe. It might be
> worth looking into.
>
>
>
> > Using this script with different parameters?
>
> Similar script, but much larger. To build the db initially, I used a
> few scripts. After the db was populated I created a maintenance script,
> which just gets the latest posts since the last time it was run.
>
> --------------------------------------------
> > python nntp_updatedb.py
> connecting...
>
> added new articles: 605335-605532
> updated Subject
> updated From
> updated Message-ID
> updated User-Agent
> updated Newsgroups
> updated injection info
> updated References
> updated message bodies
> added new content
> Updated USENET.sqlite: 2.6e+02 seconds
> --------------------------------------------
>
> It now takes several minutes to store 200 posts. Too slow.
>
> The message bodies and new content part took as much as all other parts
> combined. I need to look at the BODY table, maybe drop an index. And
> fix the timer code.
>
> And the 'get new content' routine is a little fubar for GoogleGroup posts.
>
> So there are a few tweaks needed.
>
>
> > Wouldn't that be a HUGE file?
>
> Pretty large. The SQLite db is a little over 3GB now, including
> indexes. And that's normalized about as much as I could. Each From and
> Subject and User-Agent is stored only once.
>
> I like the tight design, but some queries are fast and some are slow. It
> can be a pain to query, actually.
>
> The BODY table is now 17.48M rows, and indexed. It's getting slow to
> populate.
>
> Sometimes the SQLiteStudio app even freezes and crashes.
>
>
>
> > And then, after that, how
> > do you ascertain how to get additional posts that you don't already
> > have, by checking message IDs?
>
> Not with message IDs, but with article IDs. Check the latest (largest)
> articleID assigned by the NNTP server against the latest articleID
> stored in your system.
>
> The server response to the group command tells you the latest articleID
> available on the server, for that group:
>
> resp, IDs, begID, endID, grpNm = news.group('comp.os.linux.advocacy')
>
> resp: 211 394563 1 605472 comp.os.linux.advocacy
> 211 = command completed OK
> 394563 = number of articles available for that group
> 1 = earliest articleID for that group
> 605472 = latest articleID for that group
> comp.os.linux.advocacy = group name
>
> And with a successful response, python has already parsed the response
> and assigned values to the variables in the command:
>
> resp, IDs, begID, endID, grpNm = news.group('comp.os.linux.advocacy')
>
> resp = "211 394563 1 605472 comp.os.linux.advocacy"
> IDs = 394563
> begID = 1
> endID = 605472
> grpNm = "comp.os.linux.advocacy"
>
> So now you compare the max articleID in your database (say 605452)
> against the latest articleID on the server (in this example, it's endID
> = 605472). So you're missing the last 20 posts.
>
> You should /definitely/ store the article ID assigned by the server. The
> article ID is unique for that post for that group for that server, but
> since your Usenet server company could shut down, you also need to keep
> track of which server assigned the article ID. So I ended up assigning
> my own PostID:
>
> CREATE TABLE POSTID (
> POSTID INTEGER NOT NULL PRIMARY KEY AUTOINCREMENT,
> SERVERID INTEGER NOT NULL REFERENCES NNTP_SERVER (SERVERID) ON UPDATE
> CASCADE,
> GROUPID INTEGER NOT NULL REFERENCES NNTP_GROUP (GROUPID) ON UPDATE CASCADE,
> ARTICLEID INTEGER NOT NULL
> );
>
> With that structure, you only have to add one new entry to the
> NNTP_SERVER table, point the code to the new NNTP server, and continue
> on. No other changes to the code or db required. Theoretically. It's
> possible the new server doesn't support the same headers (eg some use
> 'User-Agent', others use 'X-Newsreader' I believe) so that would be a
> minor tweak. But it's super easy to use the same script to download
> other groups from the same or other servers.
Excellent stuff! Seriously, thanks again for this! I've been using this
stupid pokemon data and it's OK considering I'm working with REST
API concepts... but I really wanted to get into some of this stuff you
and Sandman are doing with SQL databases. The most advanced
queries I've run to date were simple joins, ex:
SELECT `ID`,`post_title` AS `Product Description`,
`price`.`meta_value` AS `Price`, `stock`.`meta_value` AS `Stock`
FROM `wp_posts`
LEFT JOIN `wp_postmeta` AS `price` ON wp_posts.ID = price.post_id
AND price.meta_key = 'regular_price'
LEFT JOIN `wp_postmeta` AS `stock` ON wp_posts.ID = stock.post_id
AND stock.meta_key = 'stock'
WHERE (wp_posts.ID > '0') AND post_type = "product" ORDER BY `post_title`
It's probably lame but it did the job.
-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - https://gpgtools.org
iQIcBAEBCgAGBQJX6sdvAAoJELnOYK54exUCtM4P/As7mBUZrcmuaboT9kBP1h6E
CN7dizHL78dT1+Yrd0y+KsY3xCIA36h+TR2b0oibELpGUG2Q/4J0W+0KN3hNGzeJ
e8T+CINor3kDoD0TnHDfqWUgsBB/SnsQQgpjpzN4YiI6L0iLhEd1RXrp7+5qwHdR
fW4GcOEM5qFlqH5Li0xYI0JaOUaFK5cDDhJhzit8a3NCC314PNUH8qnq3R6V/xbG
EZPPyjAqEw/DIA8hMxKcX3NPuZ16wAYZP6QS7aD0Z7GoYRkCorOdQuscKVC894ou
GdeQRp94OpQVUB0PmfsirFClb4UNo1lGBLh9SedjpzU35zgc5SAXLAR4wIVsDy6c
JrD+NzMM+u1i6hlFtYzUM+KSXUzB6ZjjOjhKLBMsIMR6NngED2QQQAOQl/07sFDW
VBceV5QVLo4GSiCY6i1PmCDad+E5EuCnbWXgD6xus1kY1EVPLplC28/ld/WfS6Bm
G2ghkeLzSSglLbautg/17ri7BfVxvl9G4IIj6w1E5uuMdeHfWvmRnVOuAvSqlMkS
ofqvs8qrX39jRbMVHrGztLOwpsvSZ4jbppwDbAczDtprkNsKxTJ1llJoI/01mmUd
K3URdiad4RaGAQY1KMLQHxzSOXoSBR9LU/89YfuoYAuwd7drX2LV0sO6JLVlzMlQ
OGFKId5HDHjwaxN614Bf
=1BAX
-----END PGP SIGNATURE-----
[toc] | [prev] | [next] | [standalone]
| From | DFS <nospam@dfs.com> |
|---|---|
| Date | 2016-09-29 19:51 -0400 |
| Message-ID | <nsk9d8$3ec$3@dont-email.me> |
| In reply to | #373014 |
On 9/27/2016 3:24 PM, Steve Carroll wrote: > Excellent stuff! Seriously, thanks again for this! You're welcome. To understand the data and how best to store it, I played around with a few designs in Access (populated via python and pyodbc) before committing to the final SQLite structure I have now (the DDL to which I posted the other day). One simple design I tried was this: http://imgur.com/a/rmIL9 It stores the data essentially as it looks onscreen. It's easy to see the entire contents of a post, but not recommended whatsoever: it will grow huge, contain a lot of repeating data, and in general is slow and difficult to query against (look at that and try to imagine the SQL to count how many times chrisv said *plonk*, or how to count the number of posts everyone made in Sep 2015 - when you have 100K posts such queries probably won't ever finish). Another "master" table design I tried was: http://imgur.com/a/qDjPj I populated it with about 5K rows, to see what data was frequently captured in eternal-september. After reviewing the data, I decided to not store Organization, Complaints-To, the various 'X-' fields, the NNTP-Posting-Host, and some others. You could use a table like this (need to add server and group columns), plus a separate table for the post body, and that would be a workable design that's easy to query and populate. Cons are repeating data, and difficulty in accounting for nymshifts. > I've been using this > stupid pokemon data and it's OK considering I'm working with REST > API concepts... but I really wanted to get into some of this stuff you > and Sandman are doing with SQL databases. The most advanced > queries I've run to date were simple joins, ex: > > SELECT `ID`,`post_title` AS `Product Description`, > `price`.`meta_value` AS `Price`, `stock`.`meta_value` AS `Stock` > FROM `wp_posts` > LEFT JOIN `wp_postmeta` AS `price` ON wp_posts.ID = price.post_id > AND price.meta_key = 'regular_price' > LEFT JOIN `wp_postmeta` AS `stock` ON wp_posts.ID = stock.post_id > AND stock.meta_key = 'stock' > WHERE (wp_posts.ID > '0') AND post_type = "product" ORDER BY `post_title` > > > It's probably lame but it did the job. Standard left join. Nothing lame there, except it refers to 'Pokemon'. What kind of data is that?
[toc] | [prev] | [next] | [standalone]
| From | Steve Carroll <fretwizzer@gmail.com> |
|---|---|
| Date | 2016-09-29 17:22 -0700 |
| Message-ID | <47dacb69-50b3-400f-9597-f57adedb6783@googlegroups.com> |
| In reply to | #373505 |
On Thursday, September 29, 2016 at 5:51:17 PM UTC-6, DFS wrote: > On 9/27/2016 3:24 PM, Steve Carroll wrote: > > > > Excellent stuff! Seriously, thanks again for this! > > > You're welcome. > > To understand the data and how best to store it, I played around with a > few designs in Access (populated via python and pyodbc) before > committing to the final SQLite structure I have now (the DDL to which I > posted the other day). I have to dial in some basic python. Never worked with tuples before so that was interesting. The way you're using one for the static values (I was looking at the nntplib page) is handy in a memory efficient way (cuz they're immutable, I guess). > > One simple design I tried was this: http://imgur.com/a/rmIL9 > > It stores the data essentially as it looks onscreen. It's easy to see > the entire contents of a post, but not recommended whatsoever: it will > grow huge, contain a lot of repeating data, and in general is slow and > difficult to query against (look at that and try to imagine the SQL to > count how many times chrisv said *plonk*, or how to count the number of > posts everyone made in Sep 2015 - when you have 100K posts such queries > probably won't ever finish). > > > Another "master" table design I tried was: http://imgur.com/a/qDjPj > > I populated it with about 5K rows, to see what data was frequently > captured in eternal-september. After reviewing the data, I decided to > not store Organization, Complaints-To, the various 'X-' fields, the > NNTP-Posting-Host, and some others. You could use a table like this > (need to add server and group columns), plus a separate table for the > post body, and that would be a workable design that's easy to query and > populate. Cons are repeating data, and difficulty in accounting for > nymshifts. I have a book on SQL around here somewhere, I should have read it by now. > > I've been using this > > stupid pokemon data and it's OK considering I'm working with REST > > API concepts... but I really wanted to get into some of this stuff you > > and Sandman are doing with SQL databases. The most advanced > > queries I've run to date were simple joins, ex: > > > > SELECT `ID`,`post_title` AS `Product Description`, > > `price`.`meta_value` AS `Price`, `stock`.`meta_value` AS `Stock` > > FROM `wp_posts` > > LEFT JOIN `wp_postmeta` AS `price` ON wp_posts.ID = price.post_id > > AND price.meta_key = 'regular_price' > > LEFT JOIN `wp_postmeta` AS `stock` ON wp_posts.ID = stock.post_id > > AND stock.meta_key = 'stock' > > WHERE (wp_posts.ID > '0') AND post_type = "product" ORDER BY `post_title` > > > > > > It's probably lame but it did the job. > > Standard left join. Nothing lame there, except it refers to 'Pokemon'. > What kind of data is that? There is no Pokemon in that query, that was some REST API stuff I was working on.
[toc] | [prev] | [next] | [standalone]
| From | DFS <nospam@dfs.com> |
|---|---|
| Date | 2016-09-29 23:27 -0400 |
| Message-ID | <nskm1v$nri$4@dont-email.me> |
| In reply to | #373512 |
On 9/29/2016 8:22 PM, Steve Carroll wrote:
> I have to dial in some basic python.
You write JavaScript - you'll be able to pick up python quickly once you
dedicate a few hours to it.
> Never worked with tuples before
> so that was interesting. The way you're using one for the static
> values (I was looking at the nntplib page) is handy in a memory
> efficient way (cuz they're immutable, I guess).
Lists and what they call 'list comprehension' are the coolest features
of python I've used so far. Some of the web scraping and HTML handling
libs are nice, too.
There's a huge boatload of stuff available at
https://pypi.python.org/pypi
> I have a book on SQL around here somewhere, I should have read it by
> now.
Unless you learn SQL, you'll be at the mercy of a QBE system (query by
example). Which isn't so bad - you can do a lot with them, but it's
better to know the language.
If you have Parallels and Windows and MS Office, use Access to get
started. You can switch back and forth between the query designer and
the SQL statement, and it's easy to prototype databases then upsize to a
more powerful database program (Access tables will choke on millions of
rows - and cola alone generates nearly 3 million lines of posts per year).
Or maybe mysql or SQLite for Mac, and find an admin tool that has a
query builder.
Using SQLite with python is straightforward, too.
-----------------------------------------------------------------------
import os, sqlite3
dbName = "db.sqlite"
if os.path.exists(dbName):
response = raw_input(dbName + ' already exists. Overwrite? (y/n):')
if response in ('Y','y'):
os.remove(dbName)
conn = sqlite3.connect(dbName)
db = conn.cursor()
sSQL = " CREATE TABLE If Not Exists PACKAGES " \
" (PackageName,Version,License,Description, " \
" PRIMARY KEY (PackageName,Version)); "
db.execute(sSQL)
db.execute("INSERT or ignore INTO PACKAGES VALUES (?,?,?,?)",
('Biggus','0.7.0','LGPL3','Virtual large arrays and lazy evaluation'))
conn.commit()
db.close()
conn.close()
-----------------------------------------------------------------------
Now you have a SQLite database file - with a table - in the same
directory in which you ran the script.
[toc] | [prev] | [next] | [standalone]
| From | GreyCloud <Cumulus@mist.com> |
|---|---|
| Date | 2016-09-26 18:35 -0600 |
| Message-ID | <nsceru$2dh$5@dont-email.me> |
| In reply to | #372918 |
On 09/26/2016 05:18 PM, DFS wrote: > On 9/26/2016 1:14 PM, Steve Carroll wrote: >> On Monday, September 26, 2016 at 10:58:06 AM UTC-6, DFS wrote: >>> Eastern Europe: Melzzzzz >>> Southern US: DFS, Ahlstrom, Gohde, Octavian, Tattoo >>> Western US: Snit, Carroll, Marek >>> NE US: flattie, -hh, Ezekiel >>> unknown US: chrisv, ronb, Feeb, JED >>> 3rd world: sbd >>> Japan: Taka >>> Canada: Slimer >>> Germany: Kohlmann >>> Great Britain: 7, Desk Rabbit, William Poaster >> >> >> How, exactly, do you get the data? Do you grab it in the terminal >> and pipe it to a file that you then parse and load into a database? >> What are the steps involved? > > > "Social engineering": I read and remember. > > > > * Smelzzzzz said he was from Serbia. > > * I'm from Atlanta Georgia USA > > * Ahlstrom posted his address to Usenet a long time ago: > > Chris Ahlstrom > major league software, llc > 1259 Center Lake Dr. > Mt. Pleasant, SC 29464-7419 > (843)849-0985 > a h l s t r o c @bellsouth.net > > https://groups.google.com/group/comp.std.c++/msg/c64e40426f7f7d53?hl=pt > > > * Gohde said he lived in Richmond VA > > https://sites.google.com/site/johnhgohde/home/biography > > > * Octavian (extremely anonymous and paranoid) fucked up and posted some > specific details about the demographics of his town. > > "68.5% white > 20.3% black" > > cc Googled and revealed it to be Kannapolis NC. > > Hey, how did it feel to fuckup and be outed like that, Octavian? > adrenaline surge? Go into doomsday mode? heh! > > > * You Steve Carroll were outed from CO by lamers in csma I > believe. Or maybe you posted it? > > * Tattoo, Marek, flattie, -hh and Ezekiel all stated their US > residences: WV, CA, NY, NY, MA > > * Snit inadvertently exposed his address a long time ago (before my > time) > > * unknown US: chrisv, ronb, Feeb, JED. > - shitv posted a pic of his actual college diploma from the > "University of 'Covered By White Tape'" > - ronb said he lived in CA at some point > - Feeb talked about working for HP and Intuit > - Nobody but the USA would claim JED > > * 3rd world: sbd is from India, I'm sure of it. A couple years ago he > babbled about 'a massive movement' to Linux in the Indian > countryside. > > * Taka (Takuya Saitoh) is a Japanese guy > https://plus.google.com/105437869953554502665 > > * Slimer's proud to be Canadian - in fact, he won't stop telling us how > great Canada is compared to the US > > * Kohlmann was exposed as being from Mainz Germany way back > > * 7 was exposed as Joseph Michael from London a long time ago. He > still puts "enemygadgets" in his Usenet organization header, and > others found his 'Joseph Michael Inventor of the Year Award' posts > > * Desk Rabbit: he uses the UK spelling of some words (honour and such) > > * William Poaster: a nym - he inadvertently exposed himself as Geoffrey > M. Fitton from the UK a long time ago > > You forgot me! Hungry Horse, MT.
[toc] | [prev] | [next] | [standalone]
| From | "Octavian W. Lagrange" <olagrang@perch.invalid> |
|---|---|
| Date | 2016-09-27 05:38 +0000 |
| Message-ID | <fhjasgdo98.s@perch.invalid> |
| In reply to | #372931 |
GreyCloud <Cumulus@mist.com> wrote: > On 09/26/2016 05:18 PM, DFS wrote: >> >> > You forgot me! > > Hungry Horse, MT. > Awesome name!
[toc] | [prev] | [next] | [standalone]
| From | DFS <nospam@dfs.com> |
|---|---|
| Date | 2016-09-27 01:48 -0400 |
| Message-ID | <nsd171$5rp$1@dont-email.me> |
| In reply to | #372931 |
On 9/26/2016 8:35 PM, GreyCloud wrote: > On 09/26/2016 05:18 PM, DFS wrote: > You forgot me! Sorry! I forgot about Sandman, too (he's from Sweden). > Hungry Horse, MT. Tiny place. pop. 826 at last census. https://www.google.com/maps/place/Hungry+Horse,+MT/@48.338476,-114.0713259,5204a,20y,5.14h,44.23t/data=!3m1!1e3!4m5!3m4!1s0x5366342597338bb3:0xcfc5f9eeb720ecdc!8m2!3d48.3857979!4d-114.060953 The hills around your town look nice. Did you ever hike them?
[toc] | [prev] | [next] | [standalone]
| From | GreyCloud <Cumulus@mist.com> |
|---|---|
| Date | 2016-09-27 12:08 -0600 |
| Message-ID | <nsecj5$p2v$3@dont-email.me> |
| In reply to | #372940 |
On 09/26/2016 11:48 PM, DFS wrote: > On 9/26/2016 8:35 PM, GreyCloud wrote: >> On 09/26/2016 05:18 PM, DFS wrote: > > >> You forgot me! > > Sorry! I forgot about Sandman, too (he's from Sweden). > > > >> Hungry Horse, MT. > > Tiny place. pop. 826 at last census. > > https://www.google.com/maps/place/Hungry+Horse,+MT/@48.338476,-114.0713259,5204a,20y,5.14h,44.23t/data=!3m1!1e3!4m5!3m4!1s0x5366342597338bb3:0xcfc5f9eeb720ecdc!8m2!3d48.3857979!4d-114.060953 > > > > > The hills around your town look nice. Did you ever hike them? > > Yes I have and there are plenty of trails to wander. I just don't bring a dog or peanut butter with me. Grizzlies like dogs and peanut butter.
[toc] | [prev] | [next] | [standalone]
| From | Silver Slimer <.m@nsn.s> |
|---|---|
| Date | 2016-09-27 08:48 -0400 |
| Message-ID | <nsdpqu$ifb$1@dont-email.me> |
| In reply to | #372931 |
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 On 2016-09-26 8:35 PM, GreyCloud wrote: > On 09/26/2016 05:18 PM, DFS wrote: >> On 9/26/2016 1:14 PM, Steve Carroll wrote: >>> On Monday, September 26, 2016 at 10:58:06 AM UTC-6, DFS wrote: >>>> Eastern Europe: Melzzzzz Southern US: DFS, Ahlstrom, Gohde, >>>> Octavian, Tattoo Western US: Snit, Carroll, Marek NE US: >>>> flattie, -hh, Ezekiel unknown US: chrisv, ronb, Feeb, JED 3rd >>>> world: sbd Japan: Taka Canada: Slimer Germany: Kohlmann Great >>>> Britain: 7, Desk Rabbit, William Poaster >>> >>> >>> How, exactly, do you get the data? Do you grab it in the >>> terminal and pipe it to a file that you then parse and load >>> into a database? What are the steps involved? >> >> >> "Social engineering": I read and remember. >> >> >> >> * Smelzzzzz said he was from Serbia. >> >> * I'm from Atlanta Georgia USA >> >> * Ahlstrom posted his address to Usenet a long time ago: >> >> Chris Ahlstrom major league software, llc 1259 Center Lake Dr. >> Mt. Pleasant, SC 29464-7419 (843)849-0985 a h l s t r o c >> @bellsouth.net >> >> https://groups.google.com/group/comp.std.c++/msg/c64e40426f7f7d53?hl= pt >> >> >> >> * Gohde said he lived in Richmond VA >> >> https://sites.google.com/site/johnhgohde/home/biography >> >> >> * Octavian (extremely anonymous and paranoid) fucked up and >> posted some specific details about the demographics of his town. >> >> "68.5% white 20.3% black" >> >> cc Googled and revealed it to be Kannapolis NC. >> >> Hey, how did it feel to fuckup and be outed like that, Octavian? >> adrenaline surge? Go into doomsday mode? heh! >> >> >> * You Steve Carroll were outed from CO by lamers in csma I >> believe. Or maybe you posted it? >> >> * Tattoo, Marek, flattie, -hh and Ezekiel all stated their US >> residences: WV, CA, NY, NY, MA >> >> * Snit inadvertently exposed his address a long time ago (before >> my time) >> >> * unknown US: chrisv, ronb, Feeb, JED. - shitv posted a pic of >> his actual college diploma from the "University of 'Covered By >> White Tape'" - ronb said he lived in CA at some point - Feeb >> talked about working for HP and Intuit - Nobody but the USA would >> claim JED >> >> * 3rd world: sbd is from India, I'm sure of it. A couple years >> ago he babbled about 'a massive movement' to Linux in the Indian >> countryside. >> >> * Taka (Takuya Saitoh) is a Japanese guy >> https://plus.google.com/105437869953554502665 >> >> * Slimer's proud to be Canadian - in fact, he won't stop telling >> us how great Canada is compared to the US >> >> * Kohlmann was exposed as being from Mainz Germany way back >> >> * 7 was exposed as Joseph Michael from London a long time ago. >> He still puts "enemygadgets" in his Usenet organization header, >> and others found his 'Joseph Michael Inventor of the Year Award' >> posts >> >> * Desk Rabbit: he uses the UK spelling of some words (honour and >> such) >> >> * William Poaster: a nym - he inadvertently exposed himself as >> Geoffrey M. Fitton from the UK a long time ago >> >> > You forgot me! > > Hungry Horse, MT. What a cool name for a town. - -- Silver Slimer Islam is a disease -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQEcBAEBCAAGBQJX6mqoAAoJEIwFfgf/rr+uo7QH/30K3eEn20uypXGoLZYK5hA8 NU3V5rcm7ALDTflo++kaotmiO1oR7jUcQvFzaqFFc6L3obSaqRT5m7Pwa0nJm07h Xn0p4Nh+mhiEbpXU0zhygG7CrO1q5oKHUHDX1qdBSpdm1G9TJzJl/85d9yG2CjX9 zRIJsX2FbA5BC2mDQFWOH9AmZ/NN6AVhjBsh7Vw/lqIqVo7hRCnxZHAbO5+ceXV6 u6XPqB4GH0NQp0LjT/oa0E50+v5dFoohfyzZ0eaFOiaEw3qSflP1suAw8MG/Y+Eh xgOEQHso0s4XskqUtaw6dK5TuMDeHKzho0vD7ciU+nDbIfHLwm9orqptd7rJ27A= =qOhh -----END PGP SIGNATURE-----
[toc] | [prev] | [next] | [standalone]
| From | GreyCloud <Cumulus@mist.com> |
|---|---|
| Date | 2016-09-27 12:10 -0600 |
| Message-ID | <nseclj$p2v$4@dont-email.me> |
| In reply to | #372945 |
On 09/27/2016 06:48 AM, Silver Slimer wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA256 > > On 2016-09-26 8:35 PM, GreyCloud wrote: >> On 09/26/2016 05:18 PM, DFS wrote: >>> On 9/26/2016 1:14 PM, Steve Carroll wrote: >>>> On Monday, September 26, 2016 at 10:58:06 AM UTC-6, DFS wrote: >>>>> Eastern Europe: Melzzzzz Southern US: DFS, Ahlstrom, Gohde, >>>>> Octavian, Tattoo Western US: Snit, Carroll, Marek NE US: >>>>> flattie, -hh, Ezekiel unknown US: chrisv, ronb, Feeb, JED 3rd >>>>> world: sbd Japan: Taka Canada: Slimer Germany: Kohlmann Great >>>>> Britain: 7, Desk Rabbit, William Poaster >>>> >>>> >>>> How, exactly, do you get the data? Do you grab it in the >>>> terminal and pipe it to a file that you then parse and load >>>> into a database? What are the steps involved? >>> >>> >>> "Social engineering": I read and remember. >>> >>> >>> >>> * Smelzzzzz said he was from Serbia. >>> >>> * I'm from Atlanta Georgia USA >>> >>> * Ahlstrom posted his address to Usenet a long time ago: >>> >>> Chris Ahlstrom major league software, llc 1259 Center Lake Dr. >>> Mt. Pleasant, SC 29464-7419 (843)849-0985 a h l s t r o c >>> @bellsouth.net >>> >>> https://groups.google.com/group/comp.std.c++/msg/c64e40426f7f7d53?hl= > pt >>> >>> >>> >>> > * Gohde said he lived in Richmond VA >>> >>> https://sites.google.com/site/johnhgohde/home/biography >>> >>> >>> * Octavian (extremely anonymous and paranoid) fucked up and >>> posted some specific details about the demographics of his town. >>> >>> "68.5% white 20.3% black" >>> >>> cc Googled and revealed it to be Kannapolis NC. >>> >>> Hey, how did it feel to fuckup and be outed like that, Octavian? >>> adrenaline surge? Go into doomsday mode? heh! >>> >>> >>> * You Steve Carroll were outed from CO by lamers in csma I >>> believe. Or maybe you posted it? >>> >>> * Tattoo, Marek, flattie, -hh and Ezekiel all stated their US >>> residences: WV, CA, NY, NY, MA >>> >>> * Snit inadvertently exposed his address a long time ago (before >>> my time) >>> >>> * unknown US: chrisv, ronb, Feeb, JED. - shitv posted a pic of >>> his actual college diploma from the "University of 'Covered By >>> White Tape'" - ronb said he lived in CA at some point - Feeb >>> talked about working for HP and Intuit - Nobody but the USA would >>> claim JED >>> >>> * 3rd world: sbd is from India, I'm sure of it. A couple years >>> ago he babbled about 'a massive movement' to Linux in the Indian >>> countryside. >>> >>> * Taka (Takuya Saitoh) is a Japanese guy >>> https://plus.google.com/105437869953554502665 >>> >>> * Slimer's proud to be Canadian - in fact, he won't stop telling >>> us how great Canada is compared to the US >>> >>> * Kohlmann was exposed as being from Mainz Germany way back >>> >>> * 7 was exposed as Joseph Michael from London a long time ago. >>> He still puts "enemygadgets" in his Usenet organization header, >>> and others found his 'Joseph Michael Inventor of the Year Award' >>> posts >>> >>> * Desk Rabbit: he uses the UK spelling of some words (honour and >>> such) >>> >>> * William Poaster: a nym - he inadvertently exposed himself as >>> Geoffrey M. Fitton from the UK a long time ago >>> >>> >> You forgot me! >> >> Hungry Horse, MT. > > What a cool name for a town. > It was named that way because when some settlers moved in they found one hungry horse that was reduced to skin and bones, so they fed the horse and then liked the area. Hence its name.
[toc] | [prev] | [next] | [standalone]
| From | Silver Slimer <.m@nsn.s> |
|---|---|
| Date | 2016-09-27 20:09 -0400 |
| Message-ID | <nsf1oc$5q5$1@dont-email.me> |
| In reply to | #372993 |
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 On 2016-09-27 2:10 PM, GreyCloud wrote: > On 09/27/2016 06:48 AM, Silver Slimer wrote: >> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 >> >> On 2016-09-26 8:35 PM, GreyCloud wrote: >>> On 09/26/2016 05:18 PM, DFS wrote: >>>> On 9/26/2016 1:14 PM, Steve Carroll wrote: >>>>> On Monday, September 26, 2016 at 10:58:06 AM UTC-6, DFS >>>>> wrote: >>>>>> Eastern Europe: Melzzzzz Southern US: DFS, Ahlstrom, >>>>>> Gohde, Octavian, Tattoo Western US: Snit, Carroll, Marek >>>>>> NE US: flattie, -hh, Ezekiel unknown US: chrisv, ronb, >>>>>> Feeb, JED 3rd world: sbd Japan: Taka Canada: Slimer >>>>>> Germany: Kohlmann Great Britain: 7, Desk Rabbit, William >>>>>> Poaster >>>>> >>>>> >>>>> How, exactly, do you get the data? Do you grab it in the >>>>> terminal and pipe it to a file that you then parse and >>>>> load into a database? What are the steps involved? >>>> >>>> >>>> "Social engineering": I read and remember. >>>> >>>> >>>> >>>> * Smelzzzzz said he was from Serbia. >>>> >>>> * I'm from Atlanta Georgia USA >>>> >>>> * Ahlstrom posted his address to Usenet a long time ago: >>>> >>>> Chris Ahlstrom major league software, llc 1259 Center Lake >>>> Dr. Mt. Pleasant, SC 29464-7419 (843)849-0985 a h l s t r o >>>> c @bellsouth.net >>>> >>>> https://groups.google.com/group/comp.std.c++/msg/c64e40426f7f7d53?h l= >> >>>> pt >>>> >>>> >>>> >>>> >> * Gohde said he lived in Richmond VA >>>> >>>> https://sites.google.com/site/johnhgohde/home/biography >>>> >>>> >>>> * Octavian (extremely anonymous and paranoid) fucked up and >>>> posted some specific details about the demographics of his >>>> town. >>>> >>>> "68.5% white 20.3% black" >>>> >>>> cc Googled and revealed it to be Kannapolis NC. >>>> >>>> Hey, how did it feel to fuckup and be outed like that, >>>> Octavian? adrenaline surge? Go into doomsday mode? heh! >>>> >>>> >>>> * You Steve Carroll were outed from CO by lamers in csma I >>>> believe. Or maybe you posted it? >>>> >>>> * Tattoo, Marek, flattie, -hh and Ezekiel all stated their >>>> US residences: WV, CA, NY, NY, MA >>>> >>>> * Snit inadvertently exposed his address a long time ago >>>> (before my time) >>>> >>>> * unknown US: chrisv, ronb, Feeb, JED. - shitv posted a pic >>>> of his actual college diploma from the "University of >>>> 'Covered By White Tape'" - ronb said he lived in CA at some >>>> point - Feeb talked about working for HP and Intuit - Nobody >>>> but the USA would claim JED >>>> >>>> * 3rd world: sbd is from India, I'm sure of it. A couple >>>> years ago he babbled about 'a massive movement' to Linux in >>>> the Indian countryside. >>>> >>>> * Taka (Takuya Saitoh) is a Japanese guy >>>> https://plus.google.com/105437869953554502665 >>>> >>>> * Slimer's proud to be Canadian - in fact, he won't stop >>>> telling us how great Canada is compared to the US >>>> >>>> * Kohlmann was exposed as being from Mainz Germany way back >>>> >>>> * 7 was exposed as Joseph Michael from London a long time >>>> ago. He still puts "enemygadgets" in his Usenet organization >>>> header, and others found his 'Joseph Michael Inventor of the >>>> Year Award' posts >>>> >>>> * Desk Rabbit: he uses the UK spelling of some words (honour >>>> and such) >>>> >>>> * William Poaster: a nym - he inadvertently exposed himself >>>> as Geoffrey M. Fitton from the UK a long time ago >>>> >>>> >>> You forgot me! >>> >>> Hungry Horse, MT. >> >> What a cool name for a town. >> > > It was named that way because when some settlers moved in they > found one hungry horse that was reduced to skin and bones, so they > fed the horse and then liked the area. Hence its name. And an even cuter story! :) - -- Silver Slimer Islam is a disease -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQEcBAEBCAAGBQJX6wpXAAoJEIwFfgf/rr+uOCgH/1JH+qxsMtuU5V934Z3kKBbI fSEwC8z94FpVG9V+dS6fKysvApv7BE/Hcb3UCuLeKCLTHBo+0jODYrtVkpmpyLtA G3MB01yI9IhRWBIZBs7YtydquT4/Muy1LWQ3diY71rEtbm33gnxU+QszLIWHg0V7 7DWG3Jbehj0CbvBgJT/S5b6ppp2JBxY0lXCAXquOHXwaMnwagcqrdTPOS5DWCQpV isy5F/e15jM/ekqHVWROGfvxmXSQL5E1fWdIa3gY2XcLNgoXi9rLoNWqqQD13i72 91vbiH5uv+Tw2WEYD0FEgxcMUgs9U2AWKUEvLQkcA31tCx7lMEhJ7rkTRuiLwGQ= =3t41 -----END PGP SIGNATURE-----
[toc] | [prev] | [next] | [standalone]
| From | "Octavian W. Lagrange" <olagrang@perch.invalid> |
|---|---|
| Date | 2016-09-27 05:57 +0000 |
| Message-ID | <hjasugooe.e99@perch.invalid> |
| In reply to | #372918 |
DFS <nospam@dfs.com> wrote: > On 9/26/2016 1:14 PM, Steve Carroll wrote: >> On Monday, September 26, 2016 at 10:58:06 AM UTC-6, DFS wrote: >>> Eastern Europe: Melzzzzz >>> Southern US: DFS, Ahlstrom, Gohde, Octavian, Tattoo >>> Western US: Snit, Carroll, Marek >>> NE US: flattie, -hh, Ezekiel >>> unknown US: chrisv, ronb, Feeb, JED >>> 3rd world: sbd >>> Japan: Taka >>> Canada: Slimer >>> Germany: Kohlmann >>> Great Britain: 7, Desk Rabbit, William Poaster >> >> >> How, exactly, do you get the data? Do you grab it in the terminal >> and pipe it to a file that you then parse and load into a database? >> What are the steps involved? > > > "Social engineering": I read and remember. > > > > * Smelzzzzz said he was from Serbia. > > * I'm from Atlanta Georgia USA > > * Ahlstrom posted his address to Usenet a long time ago: > > Chris Ahlstrom > major league software, llc > 1259 Center Lake Dr. > Mt. Pleasant, SC 29464-7419 > (843)849-0985 > a h l s t r o c @bellsouth.net > > https://groups.google.com/group/comp.std.c++/msg/c64e40426f7f7d53?hl=pt > > > * Gohde said he lived in Richmond VA > > https://sites.google.com/site/johnhgohde/home/biography > > > * Octavian (extremely anonymous and paranoid) fucked up and posted some > specific details about the demographics of his town. > > "68.5% white > 20.3% black" > > cc Googled and revealed it to be Kannapolis NC. > > Hey, how did it feel to fuckup and be outed like that, Octavian? > adrenaline surge? Go into doomsday mode? heh! > LOL Did I tell you I lived in Decatur in the sixties? Went to Grant Park Zoo a lot. I remember Willie B. Was sad to hear of his death, but it's good to know they finally let him out of that fucking glass and concrete prison he was in back then. https://en.wikipedia.org/wiki/Willie_B.
[toc] | [prev] | [next] | [standalone]
| From | DFS <nospam@dfs.com> |
|---|---|
| Date | 2016-09-27 11:10 -0400 |
| Message-ID | <nse25k$hh7$4@dont-email.me> |
| In reply to | #372942 |
On 9/27/2016 1:57 AM, Octavian W. Lagrange wrote: > DFS <nospam@dfs.com> wrote: >> * Octavian (extremely anonymous and paranoid) fucked up and posted some >> specific details about the demographics of his town. >> >> "68.5% white >> 20.3% black" >> >> cc Googled and revealed it to be Kannapolis NC. >> >> Hey, how did it feel to fuckup and be outed like that, Octavian? >> adrenaline surge? Go into doomsday mode? heh! >> > > LOL > > Did I tell you I lived in Decatur in the sixties? Went to Grant Park Zoo a lot. > I remember Willie B. Was sad to hear of his death, but it's good to know they > finally let him out of that fucking glass and concrete prison he was in back then. > > https://en.wikipedia.org/wiki/Willie_B. Yeah, Willie B was awesome. They eventually let him outside and he did well. It's now 'Zoo Atlanta'. Haven't been there in a long time - I don't like to see animals in captivity. For a while in the late sixties/early seventies I lived a few miles from Decatur, and used to go to downtown Decatur to a hobby shop where you could race little slot cars around a track. http://slotblog.net/topic/41997-hobby-housedecatur-speedway/
[toc] | [prev] | [next] | [standalone]
| From | "Octavian W. Lagrange" <olagrang@perch.invalid> |
|---|---|
| Date | 2016-09-27 15:46 +0000 |
| Message-ID | <hjasgud83.jgu@perch.invalid> |
| In reply to | #372960 |
DFS <nospam@dfs.com> wrote: > On 9/27/2016 1:57 AM, Octavian W. Lagrange wrote: >> DFS <nospam@dfs.com> wrote: > > >>> * Octavian (extremely anonymous and paranoid) fucked up and posted some >>> specific details about the demographics of his town. >>> >>> "68.5% white >>> 20.3% black" >>> >>> cc Googled and revealed it to be Kannapolis NC. >>> >>> Hey, how did it feel to fuckup and be outed like that, Octavian? >>> adrenaline surge? Go into doomsday mode? heh! >>> >> >> LOL >> >> Did I tell you I lived in Decatur in the sixties? Went to Grant Park Zoo a lot. >> I remember Willie B. Was sad to hear of his death, but it's good to know they >> finally let him out of that fucking glass and concrete prison he was in back then. >> >> https://en.wikipedia.org/wiki/Willie_B. > > > > Yeah, Willie B was awesome. They eventually let him outside and he did > well. It's now 'Zoo Atlanta'. Haven't been there in a long time - I > don't like to see animals in captivity. > > For a while in the late sixties/early seventies I lived a few miles from > Decatur, and used to go to downtown Decatur to a hobby shop where you > could race little slot cars around a track. > > http://slotblog.net/topic/41997-hobby-housedecatur-speedway/ > I think I went there once. Some friends and I were into building models, and I remember one day a buddy's mom drove us to some store to get one and it had an area with these big tables with slot car tracks. If that's the place, maybe they have parking in back or something, because it seems like we pulled the car in facing the building directly. It might have been a different place though.
[toc] | [prev] | [next] | [standalone]
| From | Incubus <incubus9536612@gmail.com> |
|---|---|
| Date | 2016-09-27 07:54 -0700 |
| Message-ID | <4efcfe14-e069-44b2-9b58-19c4a0058ae4@googlegroups.com> |
| In reply to | #372918 |
On Monday, September 26, 2016 at 11:19:06 PM UTC, DFS wrote: > * 7 was exposed as Joseph Michael from London a long time ago. He > still puts "enemygadgets" in his Usenet organization header, and > others found his 'Joseph Michael Inventor of the Year Award' posts 7 is what comes to Britain when a Labour government gets voted in... > * Desk Rabbit: he uses the UK spelling of some words (honour and such) So do people from Australia and New Zealand.
[toc] | [prev] | [next] | [standalone]
| From | Silver Slimer <.m@nsn.s> |
|---|---|
| Date | 2016-09-27 11:18 -0400 |
| Message-ID | <nse2j8$k06$1@dont-email.me> |
| In reply to | #372956 |
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 On 2016-09-27 10:54 AM, Incubus wrote: > On Monday, September 26, 2016 at 11:19:06 PM UTC, DFS wrote: > >> * 7 was exposed as Joseph Michael from London a long time ago. >> He still puts "enemygadgets" in his Usenet organization header, >> and others found his 'Joseph Michael Inventor of the Year Award' >> posts > > 7 is what comes to Britain when a Labour government gets voted > in... > >> * Desk Rabbit: he uses the UK spelling of some words (honour and >> such) > > So do people from Australia and New Zealand. And self-respecting Canadians. - -- Silver Slimer Islam is a disease -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQEcBAEBCAAGBQJX6o2zAAoJEIwFfgf/rr+uigcH/1K1CzlFPifocp+42WQbWnqq HDcxWy2jPE/P/5I73Q/KTKb0b/vpTNZ9APMQhuKFZADRfOo/QkEAOlb6ZWX1ucuE PHX1PuzkyREQXgGXYv63UDsDEdmvFfrnEbFq18DQYqHScVwHSnuhXeMaEBQ3MdYJ v9YVrD0SsxV2u7SfixDN7ge8Iz3qXHlZkfsPP6T2U3Z79lBoqB1ysBpWmUUJVerI sknKzxiiv5YEmLR67rXHanmqfTOGxpbH01/W+9tkxh0VTqNNXiM/YhulTaoqtCLn 22B/1M9e2PTAhy0HIt2JNVJXB13dG1MufSdT24T0V26M7DyZfwaviW3/DOdcpVU= =8lrn -----END PGP SIGNATURE-----
[toc] | [prev] | [next] | [standalone]
| From | DFS <nospam@dfs.com> |
|---|---|
| Date | 2016-09-27 11:28 -0400 |
| Message-ID | <nse375$mdc$1@dont-email.me> |
| In reply to | #372961 |
On 9/27/2016 11:18 AM, Silver Slimer wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA256 > > On 2016-09-27 10:54 AM, Incubus wrote: >> On Monday, September 26, 2016 at 11:19:06 PM UTC, DFS wrote: >> >>> * 7 was exposed as Joseph Michael from London a long time ago. >>> He still puts "enemygadgets" in his Usenet organization header, >>> and others found his 'Joseph Michael Inventor of the Year Award' >>> posts >> >> 7 is what comes to Britain when a Labour government gets voted >> in... >> >>> * Desk Rabbit: he uses the UK spelling of some words (honour and >>> such) >> >> So do people from Australia and New Zealand. > > And self-respecting Canadians. You found one? :)
[toc] | [prev] | [next] | [standalone]
| From | fr314159@gmail.com |
|---|---|
| Date | 2016-09-26 10:23 -0700 |
| Message-ID | <70989519-c4c0-43cb-b8fd-05d63da42517@googlegroups.com> |
| In reply to | #372861 |
On Monday, September 26, 2016 at 12:58:06 PM UTC-4, DFS wrote: > > [snip boring and useless pseudo-contribution] > What, no Swedes? Is no one from the Feminist Republic of Sweden? In Sweden, the women rule and the men smooch their asses like wimpy, toady fawns. One would therefore believe that this NG would be overrun by Swedish idiots. Maybe, out of shame, they all attempt to disguise the fact. But don't fear. In 10 years Swedes will be extinct. There's only a few million left and they are dwindling fast.
[toc] | [prev] | [next] | [standalone]
Page 3 of 4 — ← Prev page 1 2 [3] 4 Next page →
Back to top | Article view | comp.os.linux.advocacy
csiph-web