Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]
Groups > comp.os.linux.advocacy > #470591 > unrolled thread
| Started by | DFS <nospam@nospam.com> |
|---|---|
| First post | 2018-10-04 10:08 -0400 |
| Last post | 2018-10-10 10:36 -0400 |
| Articles | 20 on this page of 158 — 15 participants |
Back to article view | Back to comp.os.linux.advocacy
This discussion starts older than the indexed window; earlier articles aren't shown. The article labeled Started by
below is the oldest one visible, not the original post.
Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-04 10:08 -0400
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-04 08:51 -0700
Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-04 13:50 -0400
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-04 11:59 -0700
Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-04 21:23 -0400
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-05 08:12 -0700
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-05 08:21 -0700
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-05 09:55 -0700
Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-05 13:51 -0400
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-05 11:16 -0700
"Path:" is the only line that's never fake. Jeff-Relf.Me @. - 2018-10-14 01:41 -0700
Re: "Path:" is the only line that's never fake. "Sir Gregory Hall, Esq." <greghall@yacht_maester.fake> - 2018-10-14 11:16 -0400
Re: "Path:" is the only line that's never fake. Steve Carroll <frelwizzen@gmail.com> - 2018-10-14 08:38 -0700
Re: "Path:" is the only line that's never fake. snipeco.2@gmail.com (Sn!pe) - 2018-10-14 16:40 +0100
Re: "Path:" is the only line that's never fake. "Sir Gregory Hall, Esq." <greghall@yacht_maester.fake> - 2018-10-14 11:43 -0400
Re: "Path:" is the only line that's never fake. snipeco.2@gmail.com (Sn!pe) - 2018-10-14 17:12 +0100
Re: "Path:" is the only line that's never fake. "Sir Gregory Hall, Esq." <greghall@yacht_maester.fake> - 2018-10-14 12:23 -0400
Re: "Path:" is the only line that's never fake. snipeco.2@gmail.com (Wader of Doom) - 2018-10-14 18:01 +0100
No one can do "a perfect forgery" of my posts. Jeff-Relf.Me @. - 2018-10-14 14:29 -0700
Re: No one can do "a perfect forgery" of my posts. "Sir Gregory Hall, Esq." <greghall@yacht_maester.fake> - 2018-10-14 17:33 -0400
Re: No one can do "a perfect forgery" of my posts. snipeco.2@gmail.com (Sn!pe) - 2018-10-14 22:47 +0100
Re: No one can do "a perfect forgery" of my posts. "Sir Gregory Hall, Esq." <greghall@yacht_maester.fake> - 2018-10-14 17:53 -0400
Re: No one can do "a perfect forgery" of my posts. snipeco.2@gmail.com (Sn!pe) - 2018-10-14 22:58 +0100
Re: No one can do "a perfect forgery" of my posts. Steve Carroll <frelwizzen@gmail.com> - 2018-10-14 14:56 -0700
Re: No one can do "a perfect forgery" of my posts. Steve Carroll <frelwizzen@gmail.com> - 2018-10-14 14:41 -0700
Re: "Path:" is the only line that's never fake. Steve Carroll <frelwizzen@gmail.com> - 2018-10-14 08:54 -0700
Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-14 11:26 -0400
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-14 09:23 -0700
Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-14 18:53 +0000
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-14 13:27 -0700
Re: slrn is trembling Melzzzzz <Melzzzzz@zzzzz.com> - 2018-10-14 20:55 +0000
Pipelining "Article" commands. Jeff-Relf.Me @. - 2018-10-14 14:23 -0700
Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-15 13:49 +0000
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-15 07:34 -0700
Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-15 21:54 -0400
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-15 19:15 -0700
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-15 21:51 -0700
Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-16 03:16 +0000
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-15 20:33 -0700
Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-16 10:26 -0400
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-16 07:44 -0700
Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-16 15:17 +0000
Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-16 12:26 -0400
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-16 09:46 -0700
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-16 10:21 -0700
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-16 14:00 -0700
Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-16 16:49 +0000
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-04 12:35 -0700
Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-04 20:44 +0000
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-04 14:09 -0700
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-04 14:50 -0700
Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-04 22:32 +0000
Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-04 23:03 +0000
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-04 16:28 -0700
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-04 16:54 -0700
Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 00:02 +0000
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-04 17:20 -0700
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-04 17:31 -0700
Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 00:32 +0000
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-04 17:41 -0700
Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 00:54 +0000
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-04 18:02 -0700
Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 01:07 +0000
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-04 18:11 -0700
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-04 18:48 -0700
Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 02:06 +0000
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-05 08:01 -0700
Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 15:35 +0000
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-05 08:37 -0700
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-05 08:53 -0700
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-05 08:57 -0700
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-05 09:17 -0700
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-05 09:19 -0700
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-05 09:41 -0700
Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 16:19 +0000
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-05 09:23 -0700
Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 16:40 +0000
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-05 09:41 -0700
Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 17:39 +0000
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-05 11:07 -0700
Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 18:14 +0000
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-05 11:41 -0700
Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 18:52 +0000
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-06 08:46 -0700
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-06 11:29 -0700
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-06 11:48 -0700
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-06 11:51 -0700
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-06 12:19 -0700
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-06 15:34 -0700
Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-08 21:27 +0000
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-08 17:49 -0700
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-08 18:13 -0700
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-09 07:31 -0700
Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-09 13:45 +0000
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-09 07:55 -0700
Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-09 15:55 +0000
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-09 09:20 -0700
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-09 09:39 -0700
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-09 09:41 -0700
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-09 10:23 -0700
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-09 23:38 -0700
Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-09 17:47 +0000
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-09 11:09 -0700
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-10 09:04 -0700
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-10 13:56 -0700
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-11 05:02 -0700
Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-10 10:33 -0400
Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-10 19:21 +0000
Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-12 20:46 -0400
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-12 23:50 -0700
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-08 18:44 -0700
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-06 14:08 -0700
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-05 11:32 -0700
Re: slrn is trembling "F. Russell" <fr@random.info> - 2018-10-05 00:32 +0000
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-04 17:46 -0700
Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 00:55 +0000
Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 01:17 +0000
Re: slrn is trembling chrisv <chrisv@nospam.invalid> - 2018-10-05 06:59 -0500
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-05 05:14 -0700
Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 12:48 +0000
Re: slrn is trembling chrisv <chrisv@nospam.invalid> - 2018-10-05 11:17 -0500
Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-05 13:35 -0400
Re: slrn is trembling Silicon Vee <siliconvee1945@yahoo.com> - 2018-10-11 01:36 +0200
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-04 17:07 -0700
Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 00:12 +0000
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-04 17:21 -0700
Re: slrn is trembling SilverSlimer <silver@slim.er> - 2018-10-05 12:01 +0000
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-05 05:30 -0700
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-05 08:13 -0700
Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-05 12:50 -0400
Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-05 10:35 -0700
Re: slrn is trembling chrisv <chrisv@nospam.invalid> - 2018-10-10 08:51 -0500
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-10 07:09 -0700
Re: slrn is trembling Sam O'Nella <poison@donteatit.net> - 2018-10-05 16:43 -0400
Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-10 10:34 -0400
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-10 07:56 -0700
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-10 12:38 -0700
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-11 02:12 -0700
Re: slrn is trembling Snit <usenet@gallopinginsanity.com> - 2018-10-12 12:27 -0700
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-12 12:42 -0700
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-12 21:47 -0700
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-14 03:28 -0700
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-12 20:45 -0700
Re: slrn is trembling Snit <usenet@gallopinginsanity.com> - 2018-10-05 15:15 -0700
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-05 15:41 -0700
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-05 19:21 -0700
Re: slrn is trembling Snit <usenet@gallopinginsanity.com> - 2018-10-05 13:44 -0700
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-05 17:48 -0700
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-04 17:15 -0700
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-04 16:13 -0700
Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-04 20:47 -0400
Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 01:09 +0000
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-04 18:18 -0700
Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-04 21:38 -0400
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-04 19:04 -0700
Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 02:05 +0000
Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-04 19:35 -0700
Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-10 10:36 -0400
Page 6 of 8 — ← Prev page 1 2 3 4 5 [6] 7 8 Next page →
| From | Steve Carroll <frelwizzen@gmail.com> |
|---|---|
| Date | 2018-10-09 23:38 -0700 |
| Message-ID | <21ba458c-be4b-4f98-9fc7-d6fae2dbdc3c@googlegroups.com> |
| In reply to | #471304 |
On Tuesday, October 9, 2018 at 10:23:36 AM UTC-7, Steve Carroll wrote: > On Tuesday, October 9, 2018 at 9:39:36 AM UTC-7, Steve Carroll wrote: > > On Tuesday, October 9, 2018 at 9:55:11 AM UTC-6, owl wrote: > > > Steve Carroll <fretwizzer@gmail.com> wrote: > > > > On Tuesday, October 9, 2018 at 7:45:21 AM UTC-6, owl wrote: > > > >> Steve Carroll <fretwizzer@gmail.com> wrote: > > > >> > On Monday, October 8, 2018 at 3:27:41 PM UTC-6, owl wrote: > > > >> >> Steve Carroll <fretwizzer@gmail.com> wrote: > > > >> > > > > > > > >> > > > >> > > > >> It doesn't work right for a large number of posts, and there's a problem > > > >> with the csplit regex, so I'm scrapping the whole shell approach. Too > > > >> much labor to make it not messy, and I don't trust bash arrays for > > > >> large amounts of big data. > > > > > > > > I was thinking of refreshing the array with the processing and writing > > > > of each record but I haven't yet figured out how while keeping things > > > > in sync. > > > > > > > > > I got all the data in an array of structs that have integer member > > > for the article id. > > > > Even the bodies? How'd you determine how to size the structs for those > > (don't structs need to be sized up front)? > > > > > > What's the problem with large bash arrays? > > > > > > > > > > They're just messy. And I don't know if they are go on the stack > > > or not. > > > > > > > > > >> I'm working on one in C, with everything in RAM. > > > > > > > > To me that makes more sense (why pound a drive when you have RAM > > > > which is faster anyway?). I was messing with C before I started with this > > > > stuff again but, from what little I saw, the syntax wasn't as grueling as > > > > Bash. I was on step one with C... I didn't get to the point where I was > > > > using system() or anything like that so I'd have to figure out how to get > > > > all these little utility apps (awk, sed, cut, etc.) working in it if I were to > > > > go this route. If you are giving up on Bash for this that tells me a lot. > > > > In any event, I don't regret having spent time with it as it's always > > > > been on a list of things to mess with. I read your post where you say > > > > you get drawn off to the next thing... I know that feeling well. > > > > > > > > > > Not using system(). The code does all parsing and writes. > > > Right now it's just walking the bytes and comparing, but > > > I'm considering using the regex library. Header extraction > > > is easy enough without it though. > > > > Are you comparing to the header labels and the newline char? What > > about References: and the body content? Many of the posts have a > > line that begins: On... (some date, someone) wrote: > > > > But there are posts that don't have it or anything you could use. I was > > thinking about blanks lines after the final header, which all seem to use > > angle brackets (but I could be wrong about that). > > > > > >> With a 1000-post file, > > > >> it does inserts to the fromtable and headers table, and takes about > > > >> 1.5 minutes for the 2000 inserts. That doesn't seem very good to me. > > > >> The inserts are a real performance bottleneck. How do JS and Python > > > >> do for insert time? > > > > > > > > I dunno, I've never done this much data so I've had no need to check. > > > > DFS is the guy to ask for Python. I've heard the current version of Php > > > > is relatively fast at this, Sandman could weigh in on specifics for it. > > > > > > > > It seems MySQL's 'LOAD DATA INFILE' is the way, this guy claims: > > > > "To my surprise, LOAD DATA INFILE proves faster than a table copy:" > > > > > > > > <https://medium.com/@benmorel/high-speed-inserts-with-mysql-9d3dcd76f723> > > > > > > Holy shit! I wrapped the inserts in a transaction and now it does 2000 > > > inserts in half a second. > > > > From 22/sec to 1000/sec increase, not too shabby. > > > > > And that's big inserts -- full headers in each > > > record for 1000 of them. > > > > To multiple tables? > > > > > I think DFS gave me that pointer once before, > > > and I forgot it. > > > > Getting them as fast as you can via a shell script and writing them > > like this is definitely a solid way to go for speed. It's sorta looking > > like you could get a year's worth of posts, process 'em and write it > > all to a DB in under a minute. > > > > > anon@lowtide:~/usenet/database$ ./dropdb > > > anon@lowtide:~/usenet/database$ ./createdb > > > anon@lowtide:~/usenet/database$ time ./blah > > > > > > real 0m0.482s > > > user 0m0.168s > > > sys 0m0.080s > > > anon@lowtide:~/usenet/database$ mysql -pblah --silent usenetdb > > > mysql> select count(*) from headers; > > > count(*) > > > 998 > > > mysql> select count(*) from fromtable; > > > count(*) > > > 998 > > > mysql> select * from fromtable limit 5; > > > id content > > > 2364171 Steve Carroll <frelwizzen@gmail.com>\n > > > 2364172 RonB <ronb02NOSPAM@gmail.com>\n > > > 2364173 Steve Carroll <frelwizzen@gmail.com>\n > > > 2364174 Steve Carroll <frelwizzen@gmail.com>\n > > > 2364175 benj <benj.fake@gmail.com>\n > > > mysql> quit > > > anon@lowtide:~/usenet/database$ > > > > > > I need to strip those trailing newlines out somewhere in the code. > > > > This is just a pastime of mine. I won't ask Steve Carroll how any part of Klaus Schadenfreude's rear tastes no matter how often Steve Carroll kisses it. Yup. Sadly this is what we have to put up with. Cretins who have no reason for being here other than to flood. > > Until or unless Steve Carroll offers up his 'top-of-the-line' Linux system for assessment, there is no challenge, just insane contentions. > > The whole buffonery is chock-full of ridiculous cracks and counts heavily on Steve Carroll's 'liberal education' shenanigans. Sheer BS by an ignorant, misleading, conniving, conspiring peabrain who couldn't tell the truth no matter what his socks/shills say. > > The Mac has more automation options. > > -- > Puppy Videos > https://www.reddit.com/r/linux/comments/6sfkup/what_desktop_tasks_does_linux_handle_better_than/= > http://www.5z8.info/hack-outlook_c6c9in_michaelangelo-virus > Jonas Eklundh Communication Klaus Schadenfreude asked to be rated according to objective trolling criteria, which I obliged him with. Where did you find your scripts? You ran it and took it for a test drive and your "amazing brain powers" lead you to that verdict, did they? Unity is only free if your time has no value. Snit messed with Klaus Schadenfreude a bit, big fucking deal. No need to be a yowling schmuck about it? A sucking vacuum of ideas, magnified by the reciprocal of a limitless imagination, demonstrating the vast nothingness of the main character's so-called thought process. -- Puppy Videos!! http://www.5z8.info/racist-raps_r6r3wf_best-russian-sites-for-bootleg-everything Jonas Eklundh Communication AB
[toc] | [prev] | [next] | [standalone]
| From | owl <owl@rooftop.invalid> |
|---|---|
| Date | 2018-10-09 17:47 +0000 |
| Message-ID | <yuta77a.e29ga@rooftop.invalid> |
| In reply to | #471300 |
Steve Carroll <fretwizzer@gmail.com> wrote:
> On Tuesday, October 9, 2018 at 9:55:11 AM UTC-6, owl wrote:
>> Steve Carroll <fretwizzer@gmail.com> wrote:
>> > On Tuesday, October 9, 2018 at 7:45:21 AM UTC-6, owl wrote:
>> >> Steve Carroll <fretwizzer@gmail.com> wrote:
>> >> > On Monday, October 8, 2018 at 3:27:41 PM UTC-6, owl wrote:
>> >> >> Steve Carroll <fretwizzer@gmail.com> wrote:
>> >> >
>>
>> >>
>> >>
>> >> It doesn't work right for a large number of posts, and there's a problem
>> >> with the csplit regex, so I'm scrapping the whole shell approach. Too
>> >> much labor to make it not messy, and I don't trust bash arrays for
>> >> large amounts of big data.
>> >
>> > I was thinking of refreshing the array with the processing and writing
>> > of each record but I haven't yet figured out how while keeping things
>> > in sync.
>>
>>
>> I got all the data in an array of structs that have integer member
>> for the article id.
>
> Even the bodies? How'd you determine how to size the structs for those
> (don't structs need to be sized up front)?
>
I'm just massively over-allocating right now. I've been focusing on
other parts of the code. I'll go back later and size everything closer
to what's necessary.
struct post
{
int articleid;
char *fromheader;
char *article;
char *headers;
char *body;
};
struct post *parray;
I'll expand the struct later for more stuff later.
>> > What's the problem with large bash arrays?
>> >
>>
>> They're just messy. And I don't know if they are go on the stack
>> or not.
>>
>>
>> >> I'm working on one in C, with everything in RAM.
>> >
>> > To me that makes more sense (why pound a drive when you have RAM
>> > which is faster anyway?). I was messing with C before I started with this
>> > stuff again but, from what little I saw, the syntax wasn't as grueling as
>> > Bash. I was on step one with C... I didn't get to the point where I was
>> > using system() or anything like that so I'd have to figure out how to get
>> > all these little utility apps (awk, sed, cut, etc.) working in it if I were to
>> > go this route. If you are giving up on Bash for this that tells me a lot.
>> > In any event, I don't regret having spent time with it as it's always
>> > been on a list of things to mess with. I read your post where you say
>> > you get drawn off to the next thing... I know that feeling well.
>> >
>>
>> Not using system(). The code does all parsing and writes.
>> Right now it's just walking the bytes and comparing, but
>> I'm considering using the regex library. Header extraction
>> is easy enough without it though.
>
> Are you comparing to the header labels and the newline char? What
> about References: and the body content? Many of the posts have a
> line that begins: On... (some date, someone) wrote:
>
I'm basically just walking to a newline in the headers, then looking
char-by-char for a header match after the newline. At that point, I've
already split the posts into headers and body in a struct (based on
'^.$' delimiter), so there's only going to be one header match for each
struct's headers member. For example, parray[0].headers will contain
only one "From:" header match. The code is a tad wordy this way,
but it works. Like I said, I may go back and do it with the regex
library. I need some practice with that anyway.
> But there are posts that don't have it or anything you could use. I was
> thinking about blanks lines after the final header, which all seem to use
> angle brackets (but I could be wrong about that).
>
It doesn't matter. It reads the file into a struct's article member
until it hits a newline, then checks if the next char is a '.', and
if so, then is the next char another newline. If so, it increments
the article count and goes to the next struct. Once all the structs
have their article members filled, it goes back and parses the articles
into headers and body (breaking on the first blank line) and fills the
headers and body members. After that, it's just a matter of walking each
struct's headers member and testing for whatever header you want to match.
That's my approach, anyway. There may be a better way.
>> >> With a 1000-post file,
>> >> it does inserts to the fromtable and headers table, and takes about
>> >> 1.5 minutes for the 2000 inserts. That doesn't seem very good to me.
>> >> The inserts are a real performance bottleneck. How do JS and Python
>> >> do for insert time?
>> >
>> > I dunno, I've never done this much data so I've had no need to check.
>> > DFS is the guy to ask for Python. I've heard the current version of Php
>> > is relatively fast at this, Sandman could weigh in on specifics for it.
>> >
>> > It seems MySQL's 'LOAD DATA INFILE' is the way, this guy claims:
>> > "To my surprise, LOAD DATA INFILE proves faster than a table copy:"
>> >
>> > <https://medium.com/@benmorel/high-speed-inserts-with-mysql-9d3dcd76f723>
>>
>> Holy shit! I wrapped the inserts in a transaction and now it does 2000
>> inserts in half a second.
>
> From 22/sec to 1000/sec increase, not too shabby.
>
>> And that's big inserts -- full headers in each
>> record for 1000 of them.
>
> To multiple tables?
>
Yes. I added full body inserts, giving it another 1000 or so big inserts,
and it pushed the time up to 0.5 seconds. :( :)
>> I think DFS gave me that pointer once before,
>> and I forgot it.
>
> Getting them as fast as you can via a shell script and writing them
> like this is definitely a solid way to go for speed. It's sorta looking
> like you could get a year's worth of posts, process 'em and write it
> all to a DB in under a minute.
>
Could be.
[toc] | [prev] | [next] | [standalone]
| From | Steve Carroll <frelwizzen@gmail.com> |
|---|---|
| Date | 2018-10-09 11:09 -0700 |
| Message-ID | <fd8e10a8-f958-4e94-9e66-987242118186@googlegroups.com> |
| In reply to | #471306 |
On Tuesday, October 9, 2018 at 10:47:52 AM UTC-7, owl wrote:
> Steve Carroll <fretwizzer@gmail.com> wrote:
> > On Tuesday, October 9, 2018 at 9:55:11 AM UTC-6, owl wrote:
> >> Steve Carroll <fretwizzer@gmail.com> wrote:
> >> > On Tuesday, October 9, 2018 at 7:45:21 AM UTC-6, owl wrote:
> >> >> Steve Carroll <fretwizzer@gmail.com> wrote:
> >> >> > On Monday, October 8, 2018 at 3:27:41 PM UTC-6, owl wrote:
> >> >> >> Steve Carroll <fretwizzer@gmail.com> wrote:
> >> >> >
> >>
> >> >>
> >> >>
> >> >> It doesn't work right for a large number of posts, and there's a problem
> >> >> with the csplit regex, so I'm scrapping the whole shell approach. Too
> >> >> much labor to make it not messy, and I don't trust bash arrays for
> >> >> large amounts of big data.
> >> >
> >> > I was thinking of refreshing the array with the processing and writing
> >> > of each record but I haven't yet figured out how while keeping things
> >> > in sync.
> >>
> >>
> >> I got all the data in an array of structs that have integer member
> >> for the article id.
> >
> > Even the bodies? How'd you determine how to size the structs for those
> > (don't structs need to be sized up front)?
> >
>
> I'm just massively over-allocating right now. I've been focusing on
> other parts of the code. I'll go back later and size everything closer
> to what's necessary.
>
> struct post
> {
> int articleid;
> char *fromheader;
> char *article;
> char *headers;
> char *body;
> };
>
> struct post *parray;
>
> I'll expand the struct later for more stuff later.
>
>
> >> > What's the problem with large bash arrays?
> >> >
> >>
> >> They're just messy. And I don't know if they are go on the stack
> >> or not.
> >>
> >>
> >> >> I'm working on one in C, with everything in RAM.
> >> >
> >> > To me that makes more sense (why pound a drive when you have RAM
> >> > which is faster anyway?). I was messing with C before I started with this
> >> > stuff again but, from what little I saw, the syntax wasn't as grueling as
> >> > Bash. I was on step one with C... I didn't get to the point where I was
> >> > using system() or anything like that so I'd have to figure out how to get
> >> > all these little utility apps (awk, sed, cut, etc.) working in it if I were to
> >> > go this route. If you are giving up on Bash for this that tells me a lot.
> >> > In any event, I don't regret having spent time with it as it's always
> >> > been on a list of things to mess with. I read your post where you say
> >> > you get drawn off to the next thing... I know that feeling well.
> >> >
> >>
> >> Not using system(). The code does all parsing and writes.
> >> Right now it's just walking the bytes and comparing, but
> >> I'm considering using the regex library. Header extraction
> >> is easy enough without it though.
> >
> > Are you comparing to the header labels and the newline char? What
> > about References: and the body content? Many of the posts have a
> > line that begins: On... (some date, someone) wrote:
> >
>
> I'm basically just walking to a newline in the headers, then looking
> char-by-char for a header match after the newline. At that point, I've
> already split the posts into headers and body in a struct (based on
> '^.$' delimiter), so there's only going to be one header match for each
> struct's headers member. For example, parray[0].headers will contain
> only one "From:" header match. The code is a tad wordy this way,
> but it works. Like I said, I may go back and do it with the regex
> library. I need some practice with that anyway.
>
>
> > But there are posts that don't have it or anything you could use. I was
> > thinking about blanks lines after the final header, which all seem to use
> > angle brackets (but I could be wrong about that).
> >
>
> It doesn't matter. It reads the file into a struct's article member
> until it hits a newline, then checks if the next char is a '.', and
> if so, then is the next char another newline. If so, it increments
> the article count and goes to the next struct. Once all the structs
> have their article members filled, it goes back and parses the articles
> into headers and body (breaking on the first blank line) and fills the
> headers and body members. After that, it's just a matter of walking each
> struct's headers member and testing for whatever header you want to match.
> That's my approach, anyway. There may be a better way.
>
>
> >> >> With a 1000-post file,
> >> >> it does inserts to the fromtable and headers table, and takes about
> >> >> 1.5 minutes for the 2000 inserts. That doesn't seem very good to me.
> >> >> The inserts are a real performance bottleneck. How do JS and Python
> >> >> do for insert time?
> >> >
> >> > I dunno, I've never done this much data so I've had no need to check.
> >> > DFS is the guy to ask for Python. I've heard the current version of Php
> >> > is relatively fast at this, Sandman could weigh in on specifics for it.
> >> >
> >> > It seems MySQL's 'LOAD DATA INFILE' is the way, this guy claims:
> >> > "To my surprise, LOAD DATA INFILE proves faster than a table copy:"
> >> >
> >> > <https://medium.com/@benmorel/high-speed-inserts-with-mysql-9d3dcd76f723>
> >>
> >> Holy shit! I wrapped the inserts in a transaction and now it does 2000
> >> inserts in half a second.
> >
> > From 22/sec to 1000/sec increase, not too shabby.
> >
> >> And that's big inserts -- full headers in each
> >> record for 1000 of them.
> >
> > To multiple tables?
> >
>
> Yes. I added full body inserts, giving it another 1000 or so big inserts,
> and it pushed the time up to 0.5 seconds. :( :)
>
>
> >> I think DFS gave me that pointer once before,
> >> and I forgot it.
> >
> > Getting them as fast as you can via a shell script and writing them
> > like this is definitely a solid way to go for speed. It's sorta looking
> > like you could get a year's worth of posts, process 'em and write it
> > all to a DB in under a minute.
> >
>
> Could be.
Another successful Scrivener test. That is if you count the lowest common denominator of usage as a success.
I have a program I use as well, but it's better than yours. LOL! C'mon, dog... even you have kill filtered that moron. Given what Peter the Cöwardly Liön is nobody could blame me for seeking to be rid of his monstrous type of stupidity.
--
What Every Entrepreneur Must Know
https://youtu.be/u4xD43Khhkw
http://tmp.gallopinginsanity.com/BilkHelp.html
http://tinyurl.com/gsleb4p
Jonas Eklundh Communication AB
[toc] | [prev] | [next] | [standalone]
| From | Steve Carroll <fretwizzer@gmail.com> |
|---|---|
| Date | 2018-10-10 09:04 -0700 |
| Message-ID | <058020b1-da8b-4bd7-813d-a7105445930d@googlegroups.com> |
| In reply to | #471306 |
On Tuesday, October 9, 2018 at 11:47:52 AM UTC-6, owl wrote: (snip) > > Are you comparing to the header labels and the newline char? What > > about References: and the body content? Many of the posts have a > > line that begins: On... (some date, someone) wrote: > > > > I'm basically just walking to a newline in the headers, then looking > char-by-char for a header match after the newline. At that point, I've > already split the posts into headers and body in a struct (based on > '^.$' delimiter), so there's only going to be one header match for each > struct's headers member. For example, parray[0].headers will contain > only one "From:" header match. This is what I was trying to do in Bash earlier. I was able to iterate a large file of posts (that were not split into headers and bodies) and put them into vars using the previous if/elif block I posted. I stopped at the point where I put the vars into arrays (Bash arrays are weird). Like you, I'm thinking I'll not continuing using Bash. I'd like to try with C but I need to learn more of the language first. > The code is a tad wordy this way, > but it works. Like I said, I may go back and do it with the regex > library. I need some practice with that anyway. Why bother if it works without it (and using it may slow things)? > > But there are posts that don't have it or anything you could use. I was > > thinking about blanks lines after the final header, which all seem to use > > angle brackets (but I could be wrong about that). > > > > It doesn't matter. It reads the file into a struct's article member > until it hits a newline, then checks if the next char is a '.', and > if so, then is the next char another newline. If so, it increments > the article count and goes to the next struct. Once all the structs > have their article members filled, it goes back and parses the articles > into headers and body (breaking on the first blank line) and fills the > headers and body members. After that, it's just a matter of walking each > struct's headers member and testing for whatever header you want to match. > That's my approach, anyway. There may be a better way. Seems like a good way. > >> >> With a 1000-post file, > >> >> it does inserts to the fromtable and headers table, and takes about > >> >> 1.5 minutes for the 2000 inserts. That doesn't seem very good to me. > >> >> The inserts are a real performance bottleneck. How do JS and Python > >> >> do for insert time? > >> > > >> > I dunno, I've never done this much data so I've had no need to check. > >> > DFS is the guy to ask for Python. I've heard the current version of Php > >> > is relatively fast at this, Sandman could weigh in on specifics for it. > >> > > >> > It seems MySQL's 'LOAD DATA INFILE' is the way, this guy claims: > >> > "To my surprise, LOAD DATA INFILE proves faster than a table copy:" > >> > > >> > <https://medium.com/@benmorel/high-speed-inserts-with-mysql-9d3dcd76f723> > >> > >> Holy shit! I wrapped the inserts in a transaction and now it does 2000 > >> inserts in half a second. > > > > From 22/sec to 1000/sec increase, not too shabby. > > > >> And that's big inserts -- full headers in each > >> record for 1000 of them. > > > > To multiple tables? > > > > Yes. I added full body inserts, giving it another 1000 or so big inserts, > and it pushed the time up to 0.5 seconds. :( :) So it's 1000 posts/sec? Try it with 5 thousand... my time improved (with what I was doing) when I tried that many.
[toc] | [prev] | [next] | [standalone]
| From | Steve Carroll <frelwizzen@gmail.com> |
|---|---|
| Date | 2018-10-10 13:56 -0700 |
| Message-ID | <70ccd162-445f-47d4-a85f-1f7d5650efad@googlegroups.com> |
| In reply to | #471391 |
On Wednesday, October 10, 2018 at 9:04:16 AM UTC-7, Steve Carroll wrote: > On Tuesday, October 9, 2018 at 11:47:52 AM UTC-6, owl wrote: > > (snip) > > > > Are you comparing to the header labels and the newline char? What > > > about References: and the body content? Many of the posts have a > > > line that begins: On... (some date, someone) wrote: > > > > > > > I'm basically just walking to a newline in the headers, then looking > > char-by-char for a header match after the newline. At that point, I've > > already split the posts into headers and body in a struct (based on > > '^.$' delimiter), so there's only going to be one header match for each > > struct's headers member. For example, parray[0].headers will contain > > only one "From:" header match. > > This is what I was trying to do in Bash earlier. I was able to iterate > a large file of posts (that were not split into headers and bodies) > and put them into vars using the previous if/elif block I posted. I > stopped at the point where I put the vars into arrays (Bash arrays > are weird). Like you, I'm thinking I'll not continuing using Bash. I'd > like to try with C but I need to learn more of the language first. > > > The code is a tad wordy this way, > > but it works. Like I said, I may go back and do it with the regex > > library. I need some practice with that anyway. > > Why bother if it works without it (and using it may slow things)? > > > > But there are posts that don't have it or anything you could use. I was > > > thinking about blanks lines after the final header, which all seem to use > > > angle brackets (but I could be wrong about that). > > > > > > > It doesn't matter. It reads the file into a struct's article member > > until it hits a newline, then checks if the next char is a '.', and > > if so, then is the next char another newline. If so, it increments > > the article count and goes to the next struct. Once all the structs > > have their article members filled, it goes back and parses the articles > > into headers and body (breaking on the first blank line) and fills the > > headers and body members. After that, it's just a matter of walking each > > struct's headers member and testing for whatever header you want to match. > > That's my approach, anyway. There may be a better way. > > Seems like a good way. > > > >> >> With a 1000-post file, > > >> >> it does inserts to the fromtable and headers table, and takes about > > >> >> 1.5 minutes for the 2000 inserts. That doesn't seem very good to me. > > >> >> The inserts are a real performance bottleneck. How do JS and Python > > >> >> do for insert time? > > >> > > > >> > I dunno, I've never done this much data so I've had no need to check. > > >> > DFS is the guy to ask for Python. I've heard the current version of Php > > >> > is relatively fast at this, Sandman could weigh in on specifics for it. > > >> > > > >> > It seems MySQL's 'LOAD DATA INFILE' is the way, this guy claims: > > >> > "To my surprise, LOAD DATA INFILE proves faster than a table copy:" > > >> > > > >> > <https://medium.com/@benmorel/high-speed-inserts-with-mysql-9d3dcd76f723> > > >> > > >> Holy shit! I wrapped the inserts in a transaction and now it does 2000 > > >> inserts in half a second. > > > > > > From 22/sec to 1000/sec increase, not too shabby. > > > > > >> And that's big inserts -- full headers in each > > >> record for 1000 of them. > > > > > > To multiple tables? > > > > > > > Yes. I added full body inserts, giving it another 1000 or so big inserts, > > and it pushed the time up to 0.5 seconds. :( :) > > So it's 1000 posts/sec? Try it with 5 thousand... my time improved > (with what I was doing) when I tried that many. An unceasing, fierce, posting itch, while suffering from an empty mind - essentially slimy Mac-using prostitutes, and satisfactorily-waxed fish, hung from the ceiling for his own individual yearnings. Deplorable Owl claims to be the Linux-expert. Let us see him put up an example minus the shipping/handling constructs.At times, fancy is more valuable than facts. iOS runs on the Wayland kernel. So yeah, Wayland is mobile. Wayland is a super computer. Wayland is a server. Wayland is a desktop. Wayland is growing in market share. -- My Snoring Solution!! https://www.facebook.com/profile.php?id=100012978552519 http://prescottcomputerguy.com/screenflow http://tmp.gallopinginsanity.com/BilkHelp.html Jonas Eklundh Communication
[toc] | [prev] | [next] | [standalone]
| From | Steve Carroll <frelwizzen@gmail.com> |
|---|---|
| Date | 2018-10-11 05:02 -0700 |
| Message-ID | <9ddbd950-026e-4519-9d06-c8d00875e78d@googlegroups.com> |
| In reply to | #471436 |
On Wednesday, October 10, 2018 at 1:57:02 PM UTC-7, Steve Carroll wrote: > On Wednesday, October 10, 2018 at 9:04:16 AM UTC-7, Steve Carroll wrote: > > On Tuesday, October 9, 2018 at 11:47:52 AM UTC-6, owl wrote: > > > > (snip) > > > > > > Are you comparing to the header labels and the newline char? What > > > > about References: and the body content? Many of the posts have a > > > > line that begins: On... (some date, someone) wrote: > > > > > > > > > > I'm basically just walking to a newline in the headers, then looking > > > char-by-char for a header match after the newline. At that point, I've > > > already split the posts into headers and body in a struct (based on > > > '^.$' delimiter), so there's only going to be one header match for each > > > struct's headers member. For example, parray[0].headers will contain > > > only one "From:" header match. > > > > This is what I was trying to do in Bash earlier. I was able to iterate > > a large file of posts (that were not split into headers and bodies) > > and put them into vars using the previous if/elif block I posted. I > > stopped at the point where I put the vars into arrays (Bash arrays > > are weird). Like you, I'm thinking I'll not continuing using Bash. I'd > > like to try with C but I need to learn more of the language first. > > > > > The code is a tad wordy this way, > > > but it works. Like I said, I may go back and do it with the regex > > > library. I need some practice with that anyway. > > > > Why bother if it works without it (and using it may slow things)? > > > > > > But there are posts that don't have it or anything you could use. I was > > > > thinking about blanks lines after the final header, which all seem to use > > > > angle brackets (but I could be wrong about that). > > > > > > > > > > It doesn't matter. It reads the file into a struct's article member > > > until it hits a newline, then checks if the next char is a '.', and > > > if so, then is the next char another newline. If so, it increments > > > the article count and goes to the next struct. Once all the structs > > > have their article members filled, it goes back and parses the articles > > > into headers and body (breaking on the first blank line) and fills the > > > headers and body members. After that, it's just a matter of walking each > > > struct's headers member and testing for whatever header you want to match. > > > That's my approach, anyway. There may be a better way. > > > > Seems like a good way. > > > > > >> >> With a 1000-post file, > > > >> >> it does inserts to the fromtable and headers table, and takes about > > > >> >> 1.5 minutes for the 2000 inserts. That doesn't seem very good to me. > > > >> >> The inserts are a real performance bottleneck. How do JS and Python > > > >> >> do for insert time? > > > >> > > > > >> > I dunno, I've never done this much data so I've had no need to check. > > > >> > DFS is the guy to ask for Python. I've heard the current version of Php > > > >> > is relatively fast at this, Sandman could weigh in on specifics for it. > > > >> > > > > >> > It seems MySQL's 'LOAD DATA INFILE' is the way, this guy claims: > > > >> > "To my surprise, LOAD DATA INFILE proves faster than a table copy:" > > > >> > > > > >> > <https://medium.com/@benmorel/high-speed-inserts-with-mysql-9d3dcd76f723> > > > >> > > > >> Holy shit! I wrapped the inserts in a transaction and now it does 2000 > > > >> inserts in half a second. > > > > > > > > From 22/sec to 1000/sec increase, not too shabby. > > > > > > > >> And that's big inserts -- full headers in each > > > >> record for 1000 of them. > > > > > > > > To multiple tables? > > > > > > > > > > Yes. I added full body inserts, giving it another 1000 or so big inserts, > > > and it pushed the time up to 0.5 seconds. :( :) > > > > So it's 1000 posts/sec? Try it with 5 thousand... my time improved > > (with what I was doing) when I tried that many. > > > > An unceasing, fierce, posting itch, while suffering from an empty mind - essentially slimy Mac-using prostitutes, and satisfactorily-waxed fish, hung from the ceiling for his own individual yearnings. > > Deplorable Owl claims to be the Linux-expert. Let us see him put up an example minus the shipping/handling constructs.At times, fancy is more valuable than facts. > > iOS runs on the Wayland kernel. So yeah, Wayland is mobile. Wayland is a super computer. Wayland is a server. Wayland is a desktop. Wayland is growing in market share. > > > > -- > My Snoring Solution!! > https://www.facebook.com/profile.php?id=100012978552519 > http://prescottcomputerguy.com/screenflow > http://tmp.gallopinginsanity.com/BilkHelp.html > Jonas Eklundh Communication I suspect Troll Master Steve Carroll does not even know what is wrong with Clinton. A sucking vacuum of ideas, magnified by the reciprocal of a limitless imagination, demonstrating the vast nothingness of the main character's so-called thought process. Everyone is Troll Master Steve Carroll -- the oldest gag in the book. -- This broke the Internet https://youtu.be/qwb1Ez0GWMA https://youtu.be/5OfWsoPAg7o http://prescottcomputerguy.com Jonas Eklundh
[toc] | [prev] | [next] | [standalone]
| From | DFS <nospam@nospam.com> |
|---|---|
| Date | 2018-10-10 10:33 -0400 |
| Message-ID | <C4ovD.59004$UI2.10174@fx18.iad> |
| In reply to | #471296 |
On 10/9/2018 11:55 AM, owl wrote:
> Holy shit! I wrapped the inserts in a transaction and now it does 2000
> inserts in half a second.
That's blazing.
MySQL? You timed it from BEGIN TRANSACTION through commit()?
python and SQLite on my older computer:
0.12s to do 2K inserts of a 1626-byte header string
2.11s to commit the data
import sqlite3,time,DFS_dbset
conn,db,dbName,ps = DFS_dbset.openconnection('sqlite')
db.execute("DROP TABLE IF EXISTS TESTHDR;")
db.execute("CREATE TABLE TESTHDR (HDRID INTEGER PRIMARY KEY
AUTOINCREMENT, HDRVAL TEXT);")
header = <snipped for brevity>
start = time.clock()
db.execute("BEGIN TRANSACTION;")
for i in range(0,2000):
db.execute("INSERT INTO TESTHDR (HDRVAL) VALUES(?);",(header,))
print "%.2fs to insert data" % (time.clock() - start)
start = time.clock()
conn.commit()
print "%.2fs to commit data" % (time.clock() - start)
db.close()
conn.close()
[toc] | [prev] | [next] | [standalone]
| From | owl <owl@rooftop.invalid> |
|---|---|
| Date | 2018-10-10 19:21 +0000 |
| Message-ID | <a0z8b0803.ah@rooftop.invalid> |
| In reply to | #471380 |
DFS <nospam@nospam.com> wrote:
> On 10/9/2018 11:55 AM, owl wrote:
>
>> Holy shit! I wrapped the inserts in a transaction and now it does 2000
>> inserts in half a second.
>
> That's blazing.
>
> MySQL?
Yes.
> You timed it from BEGIN TRANSACTION through commit()?
>
That was run time for the whole program.
> python and SQLite on my older computer:
> 0.12s to do 2K inserts of a 1626-byte header string
> 2.11s to commit the data
>
>
> import sqlite3,time,DFS_dbset
> conn,db,dbName,ps = DFS_dbset.openconnection('sqlite')
> db.execute("DROP TABLE IF EXISTS TESTHDR;")
> db.execute("CREATE TABLE TESTHDR (HDRID INTEGER PRIMARY KEY
> AUTOINCREMENT, HDRVAL TEXT);")
> header = <snipped for brevity>
> start = time.clock()
> db.execute("BEGIN TRANSACTION;")
> for i in range(0,2000):
> db.execute("INSERT INTO TESTHDR (HDRVAL) VALUES(?);",(header,))
> print "%.2fs to insert data" % (time.clock() - start)
> start = time.clock()
> conn.commit()
> print "%.2fs to commit data" % (time.clock() - start)
> db.close()
> conn.close()
Had to modify your code a bit since I don't have "DFS_dbset".
Using 2000 inserts of 1626-byte header:
anon@lowtide:~/usenet/database$ ./times
python sqlite3:
0.07s to insert data
0.01s to commit data
real 0m1.079s
user 0m0.080s
sys 0m0.084s
C sqlite3:
0.08s to insert data
0.01s to commit data
real 0m1.065s
user 0m0.100s
sys 0m0.048s
C mysql:
0.03s to insert data
0.00s to commit data
real 0m0.441s
user 0m0.012s
sys 0m0.016s
anon@lowtide:~/usenet/database$
[toc] | [prev] | [next] | [standalone]
| From | DFS <nospam@nospam.com> |
|---|---|
| Date | 2018-10-12 20:46 -0400 |
| Message-ID | <MfbwD.95808$fE2.90028@fx30.iad> |
| In reply to | #471428 |
On 10/10/2018 3:21 PM, owl wrote:
> DFS <nospam@nospam.com> wrote:
>> On 10/9/2018 11:55 AM, owl wrote:
>>
>>> Holy shit! I wrapped the inserts in a transaction and now it does 2000
>>> inserts in half a second.
>>
>> That's blazing.
>>
>> MySQL?
>
> Yes.
>
>> You timed it from BEGIN TRANSACTION through commit()?
>>
>
> That was run time for the whole program.
>
>
>> python and SQLite on my older computer:
>> 0.12s to do 2K inserts of a 1626-byte header string
>> 2.11s to commit the data
That was committing to a table in my 14GB Usenet db. Using a new
sqlite3 db file the results were as fast as:
0.10s to insert data
0.26s to commit data
>> import sqlite3,time,DFS_dbset
>> conn,db,dbName,ps = DFS_dbset.openconnection('sqlite')
>> db.execute("DROP TABLE IF EXISTS TESTHDR;")
>> db.execute("CREATE TABLE TESTHDR (HDRID INTEGER PRIMARY KEY
>> AUTOINCREMENT, HDRVAL TEXT);")
>> header = <snipped for brevity>
>> start = time.clock()
>> db.execute("BEGIN TRANSACTION;")
>> for i in range(0,2000):
>> db.execute("INSERT INTO TESTHDR (HDRVAL) VALUES(?);",(header,))
>> print "%.2fs to insert data" % (time.clock() - start)
>> start = time.clock()
>> conn.commit()
>> print "%.2fs to commit data" % (time.clock() - start)
>> db.close()
>> conn.close()
>
> Had to modify your code a bit since I don't have "DFS_dbset".
It's just a generic connection manager routine used to shorten the
database login/connection in the calling program.
===================================================================
DFS_dbset.py
===================================================================
import sqlite3, psycopg2, mysql.connector
def openconnection(dbtype):
if dbtype == "sqlite":
dbDir = "D:\\development\\SQLite\\"
dbName = "USENET.sqlite"
conn = sqlite3.connect(dbDir + dbName)
ps = '?' #query parameter symbol
if dbtype == "postgres":
dbName = "USENET on PostgreSQL"
connectstring = "" \
" host = 'localhost' " \
" dbname = 'USENET' " \
" user = 'user' " \
" password = 'pw' "
conn = psycopg2.connect(connectstring)
ps = '%s' #query parameter symbol
if dbtype == "mysql":
dbName = "USENET on MySQL"
connectstring = {
'host' : '127.0.0.1',
'database': 'USENET',
'user' : 'user',
'password': 'pw',
}
conn = mysql.connector.connect(connectstring)
ps = '%s' #query parameter symbol
db = conn.cursor()
return [conn,db,dbName,ps]
===================================================================
> Using 2000 inserts of 1626-byte header:
>
> anon@lowtide:~/usenet/database$ ./times
>
> python sqlite3:
>
> 0.07s to insert data
> 0.01s to commit data
>
> real 0m1.079s
> user 0m0.080s
> sys 0m0.084s
>
> C sqlite3:
>
> 0.08s to insert data
> 0.01s to commit data
>
> real 0m1.065s
> user 0m0.100s
> sys 0m0.048s
> C mysql:
>
> 0.03s to insert data
> 0.00s to commit data
>
> real 0m0.441s
> user 0m0.012s
> sys 0m0.016s
>
> anon@lowtide:~/usenet/database$
>
[toc] | [prev] | [next] | [standalone]
| From | Steve Carroll <frelwizzen@gmail.com> |
|---|---|
| Date | 2018-10-12 23:50 -0700 |
| Message-ID | <40b631e1-2145-4641-b72d-f4edf5b24227@googlegroups.com> |
| In reply to | #471761 |
On Friday, October 12, 2018 at 5:46:38 PM UTC-7, DFS wrote:
> On 10/10/2018 3:21 PM, owl wrote:
> > DFS <nospam@nospam.com> wrote:
> >> On 10/9/2018 11:55 AM, owl wrote:
> >>
> >>> Holy shit! I wrapped the inserts in a transaction and now it does 2000
> >>> inserts in half a second.
> >>
> >> That's blazing.
> >>
> >> MySQL?
> >
> > Yes.
> >
> >> You timed it from BEGIN TRANSACTION through commit()?
> >>
> >
> > That was run time for the whole program.
> >
> >
> >> python and SQLite on my older computer:
> >> 0.12s to do 2K inserts of a 1626-byte header string
> >> 2.11s to commit the data
>
> That was committing to a table in my 14GB Usenet db. Using a new
> sqlite3 db file the results were as fast as:
>
> 0.10s to insert data
> 0.26s to commit data
>
>
>
> >> import sqlite3,time,DFS_dbset
> >> conn,db,dbName,ps = DFS_dbset.openconnection('sqlite')
> >> db.execute("DROP TABLE IF EXISTS TESTHDR;")
> >> db.execute("CREATE TABLE TESTHDR (HDRID INTEGER PRIMARY KEY
> >> AUTOINCREMENT, HDRVAL TEXT);")
> >> header = <snipped for brevity>
> >> start = time.clock()
> >> db.execute("BEGIN TRANSACTION;")
> >> for i in range(0,2000):
> >> db.execute("INSERT INTO TESTHDR (HDRVAL) VALUES(?);",(header,))
> >> print "%.2fs to insert data" % (time.clock() - start)
> >> start = time.clock()
> >> conn.commit()
> >> print "%.2fs to commit data" % (time.clock() - start)
> >> db.close()
> >> conn.close()
> >
> > Had to modify your code a bit since I don't have "DFS_dbset".
>
>
> It's just a generic connection manager routine used to shorten the
> database login/connection in the calling program.
>
> ===================================================================
> DFS_dbset.py
> ===================================================================
> import sqlite3, psycopg2, mysql.connector
>
> def openconnection(dbtype):
>
> if dbtype == "sqlite":
> dbDir = "D:\\development\\SQLite\\"
> dbName = "USENET.sqlite"
> conn = sqlite3.connect(dbDir + dbName)
> ps = '?' #query parameter symbol
>
> if dbtype == "postgres":
> dbName = "USENET on PostgreSQL"
> connectstring = "" \
> " host = 'localhost' " \
> " dbname = 'USENET' " \
> " user = 'user' " \
> " password = 'pw' "
> conn = psycopg2.connect(connectstring)
> ps = '%s' #query parameter symbol
>
> if dbtype == "mysql":
> dbName = "USENET on MySQL"
> connectstring = {
> 'host' : '127.0.0.1',
> 'database': 'USENET',
> 'user' : 'user',
> 'password': 'pw',
> }
> conn = mysql.connector.connect(connectstring)
> ps = '%s' #query parameter symbol
>
> db = conn.cursor()
> return [conn,db,dbName,ps]
> ===================================================================
>
>
>
> > Using 2000 inserts of 1626-byte header:
> >
> > anon@lowtide:~/usenet/database$ ./times
> >
> > python sqlite3:
> >
> > 0.07s to insert data
> > 0.01s to commit data
> >
> > real 0m1.079s
> > user 0m0.080s
> > sys 0m0.084s
> >
> > C sqlite3:
> >
> > 0.08s to insert data
> > 0.01s to commit data
> >
> > real 0m1.065s
> > user 0m0.100s
> > sys 0m0.048s
>
>
>
>
> > C mysql:
> >
> > 0.03s to insert data
> > 0.00s to commit data
> >
> > real 0m0.441s
> > user 0m0.012s
> > sys 0m0.016s
> >
> > anon@lowtide:~/usenet/database$
> >
Steven Petruzzellis can create a virtual machine. Makes Larry Washington cry because he can not. This is something you should ask Steven Petruzzellis. The Mac has a more consistent interface. Steven Petruzzellis has proved this time and time again. Larry Washington's done a pretty good job with (it appears) the Borůvka's algorithm to regurgitate texts which are hard to distinguish from my posts.
I'm getting more posts hidden then show. I'm guessing the Larry Washington stalker is in its brain damage mode again. It was Larry Washington who stated that he and his college buddies used to trespass all the time and it was harmless fun to his way of thinking.
I have known autobots who argue better than Larry Washington does. When I got here, I wanted to be reasonable and impartial. I gave Larry Washington more than a wise person generally would.
--
Top 15 Ways Larry Washington Trolls
http://www.5z8.info/boobs_j0v3qo_dont-just-drizzle
https://youtu.be/lF8yk7ul4Mw
https://groups.google.com/forum/#!topic/comp.os.linux.advocacy/tzMH39QmAmU
Jonas Eklundh Communication
[toc] | [prev] | [next] | [standalone]
| From | Steve Carroll <frelwizzen@gmail.com> |
|---|---|
| Date | 2018-10-08 18:44 -0700 |
| Message-ID | <79e61763-7456-489d-b0fa-69836c2f41f4@googlegroups.com> |
| In reply to | #471011 |
On Saturday, October 6, 2018 at 3:35:02 PM UTC-7, Steve Carroll wrote: > On Saturday, October 6, 2018 at 12:51:15 PM UTC-6, Steve Carroll wrote: > > On Saturday, October 6, 2018 at 12:48:12 PM UTC-6, Steve Carroll wrote: > > > On Saturday, October 6, 2018 at 12:29:22 PM UTC-6, Steve Carroll wrote: > > > > On Friday, October 5, 2018 at 12:14:57 PM UTC-6, owl wrote: > > > > > Steve Carroll <fretwizzer@gmail.com> wrote: > > > > > > On Friday, October 5, 2018 at 11:39:47 AM UTC-6, owl wrote: > > > > > > > > > > > > (snip) > > > > > > > > > > > >> You're sending that "--START/END OF POST--" to the server. > > > > > > > > > > > > Again... DOH! (lifts track shoe off of dick) > > > > > > > > > > > >> It doesn't > > > > > >> know what you're asking. There are delimiters in the article file > > > > > >> already. A '.' on a line by itself marks the end of an article. > > > > > > > > > > > > I saw those. They can never be carried over from an actual line of text? > > > > > > IOW, are they 100% reliable for delineation? > > > > > > > > > > > > > > > > Yes. A lone '.' is how you end a post when you talk to the server. > > > > > https://tools.ietf.org/html/rfc3977.html#section-6.3.1.3 > > > > > > > > > > > > Off topic, if I can pick your brain again... and I know I said I was gonna > > > > do this in Python first but you know how it is ;) > > > > > > > > I had an issue where I had to use sudo to login to mysql, I seem to > > > > have fixed it with by updating the plugin to... > > > > > > > > SET plugin = 'mysql_native_password' > > > > > > > > ... and flushing privileges. Anyway, to the point... shouldn't I be able to > > > > use the following in a shell script to login to mysql with: > > > > > > > > mysql -h 'localhost' -u 'user_name' -p 'pass_word' -D 'database_name' -t 'table_name' -e 'SELECT * FROM table_name' > > > > > > > > When I try it (and variations) I get... > > > > > > > > mysql Ver 14.14 Distrib 5.7.18, for macos10.12 (x86_64) using EditLine wrapper > > > > Copyright (c) 2000, 2017, Oracle and/or its affiliates. All rights reserved. > > > > > > > > Oracle is a registered trademark of Oracle Corporation and/or its > > > > affiliates. Other names may be trademarks of their respective > > > > owners. > > > > > > > > Usage: mysql [OPTIONS] [database] > > > > > > > > ... and the list of available options which I won't include here. Have > > > > you ever successfully connected to a MySQL db with a shell script? > > > > > > > > Seems I can't get it to accept the password in the script. If I remove it > > > > from the code I get prompted for it and when I put it in I do get logged > > > > in but now I'm at the mysql prompt. Do I write the remainder of the > > > > script from within mysql (it let's you have shell access)? Do I need > > > > to use read -p (which I've unsuccessfully tried) and just include the > > > > password that way? I need to detect when that mysql prompt comes > > > > up, too. I've only ever used connectors (Python, Php, etc.) I've > > > > never done this from a shell script. If you have *any* info you'd like > > > > to impart I'd appreciate it 'cuz this is something I've always wanted > > > > to try. > > > > > > The following happens in the terminal, when I run: > > > > > > mysql -u 'user_name' -p 'password' > > > > > > or > > > > > > mysql -u 'user_name' --password 'password' > > > > > > I get: > > > ERROR 1049 (42000): Unknown database 'password' > > > > > > > > > However, if I run... > > > > > > mysql -u 'user_name' -p > > > > > > ... and then type in the password at the prompt I get in (same thing > > > in the script, as expected). Is there a config option somewhere that > > > I need to set for mysql? > > > > I found out you can't have any spaces between -p and the password. > > I had to get away from bash so I went to lunch, when I came back I was > just as depressed as I was before ;) BUT... I managed to *finally* piece > together this nightmare syntax. The write is not efficient, yet, but it's > amazing how fast writes are to the db. I'm just grabbing stuff from a file > that has ten posts in it, splitting the output in separate vars and writing: > > <https://streamable.com/pd6hb> > > There are probably much better ways to do this (and I mean besides the > individual writes) but at least I'm starting to climb the mountain now ;) It is obvious this is an insomniac troll writing because some of them are direct responses in very specific ways with clear thought behind them, so not from a computer auto-generator. Off John Gohde goes to the view in the overfull septic tank of my KF. It's trivial to essentially lie by bragging about a small number of exceptions different from what's the norm. What matters more from an honest advocates way of thinking are the regular uses. Ha, ha, ha, ha, ha, ha, ha, ha! -- E-commerce Simplified http://www.5z8.info/horse-slaughter_w8c4en_launchexe Jonas Eklundh Communication
[toc] | [prev] | [next] | [standalone]
| From | Steve Carroll <frelwizzen@gmail.com> |
|---|---|
| Date | 2018-10-06 14:08 -0700 |
| Message-ID | <9707ecba-b7ee-4bb1-a63f-9dca03599570@googlegroups.com> |
| In reply to | #470983 |
On Saturday, October 6, 2018 at 11:48:12 AM UTC-7, Steve Carroll wrote: > On Saturday, October 6, 2018 at 12:29:22 PM UTC-6, Steve Carroll wrote: > > On Friday, October 5, 2018 at 12:14:57 PM UTC-6, owl wrote: > > > Steve Carroll <fretwizzer@gmail.com> wrote: > > > > On Friday, October 5, 2018 at 11:39:47 AM UTC-6, owl wrote: > > > > > > > > (snip) > > > > > > > >> You're sending that "--START/END OF POST--" to the server. > > > > > > > > Again... DOH! (lifts track shoe off of dick) > > > > > > > >> It doesn't > > > >> know what you're asking. There are delimiters in the article file > > > >> already. A '.' on a line by itself marks the end of an article. > > > > > > > > I saw those. They can never be carried over from an actual line of text? > > > > IOW, are they 100% reliable for delineation? > > > > > > > > > > Yes. A lone '.' is how you end a post when you talk to the server. > > > https://tools.ietf.org/html/rfc3977.html#section-6.3.1.3 > > > > > > Off topic, if I can pick your brain again... and I know I said I was gonna > > do this in Python first but you know how it is ;) > > > > I had an issue where I had to use sudo to login to mysql, I seem to > > have fixed it with by updating the plugin to... > > > > SET plugin = 'mysql_native_password' > > > > ... and flushing privileges. Anyway, to the point... shouldn't I be able to > > use the following in a shell script to login to mysql with: > > > > mysql -h 'localhost' -u 'user_name' -p 'pass_word' -D 'database_name' -t 'table_name' -e 'SELECT * FROM table_name' > > > > When I try it (and variations) I get... > > > > mysql Ver 14.14 Distrib 5.7.18, for macos10.12 (x86_64) using EditLine wrapper > > Copyright (c) 2000, 2017, Oracle and/or its affiliates. All rights reserved. > > > > Oracle is a registered trademark of Oracle Corporation and/or its > > affiliates. Other names may be trademarks of their respective > > owners. > > > > Usage: mysql [OPTIONS] [database] > > > > ... and the list of available options which I won't include here. Have > > you ever successfully connected to a MySQL db with a shell script? > > > > Seems I can't get it to accept the password in the script. If I remove it > > from the code I get prompted for it and when I put it in I do get logged > > in but now I'm at the mysql prompt. Do I write the remainder of the > > script from within mysql (it let's you have shell access)? Do I need > > to use read -p (which I've unsuccessfully tried) and just include the > > password that way? I need to detect when that mysql prompt comes > > up, too. I've only ever used connectors (Python, Php, etc.) I've > > never done this from a shell script. If you have *any* info you'd like > > to impart I'd appreciate it 'cuz this is something I've always wanted > > to try. > > The following happens in the terminal, when I run: > > mysql -u 'user_name' -p 'password' > > or > > mysql -u 'user_name' --password 'password' > > I get: > ERROR 1049 (42000): Unknown database 'password' > > > However, if I run... > > mysql -u 'user_name' -p > > ... and then type in the password at the prompt I get in (same thing > in the script, as expected). Is there a config option somewhere that > I need to set for mysql? Anyone familiar with my posts knows it is not written in the manner Troll Killer Snit is saying, and some of them are xxx manually written. These losers get their enjoyment out of provoking angry replies to their insults, which is the very definition of a troll. You likely think Mint handles the desktop well. Nope. Not compared to what normal people use. -- Top Six Ways Jonas Eklundh Communication AB Trolls https://youtu.be/E3m_i-x92D0 https://youtu.be/OffkiSAsYo8 http://www.5z8.info/php-start_GPS_tracking-user_j3m3lg_whitepower Jonas Eklundh Communication
[toc] | [prev] | [next] | [standalone]
| From | Steve Carroll <frelwizzen@gmail.com> |
|---|---|
| Date | 2018-10-05 11:32 -0700 |
| Message-ID | <cfd74bf2-b96a-4e1c-81f0-a312859e828a@googlegroups.com> |
| In reply to | #470830 |
On Friday, October 5, 2018 at 11:07:34 AM UTC-7, Steve Carroll wrote: > On Friday, October 5, 2018 at 11:39:47 AM UTC-6, owl wrote: > > (snip) > > > You're sending that "--START/END OF POST--" to the server. > > Again... DOH! (lifts track shoe off of dick) > > > It doesn't > > know what you're asking. There are delimiters in the article file > > already. A '.' on a line by itself marks the end of an article. > > I saw those. They can never be carried over from an actual line of text? > IOW, are they 100% reliable for delineation? > > > So you can grep for that: '^\.$', but ^From is just easier to type. > > You can also grep for the last article id number (or loop the whole > > sequence), which will be in the Xref header. > > I'm not yet sure what I'm gonna do here as I have to shoot these > various pieces of data into multiple tables. Remember, you're talking > to a guy who didn't even realize he was sending the above text to the > server (I really gotta start looking at this stuff ;) > > > > And twice each time. BTW, if I remove that dash you suggested, the > > > script won't run. Is the Python nntplib really *that* slow? We're talking > > > 150 seconds compared to 5 for this shell script. > > > > I don't know. > > What else could it be (I've run both a number of times, the speeds are > always roughly what I've reported)? It's probably faster to even do the > next step in a shell script but I really do want to learn Python and DFS > has helped me a *lot* with it and MySQL so I'll stay on that path. I may, > after I get that happening, try it in the shell (I assume there's a way to > do it). In any event, thanks for all the help (and to you, too, DFS). I think the point is far from just to get people to listen to him. The point is likely to piss Doomsdrzej aka Sliver Slimer off for flooding outside groups he knows I frequent. Gee, imagine Onion Knight trying to pin his buffoonery on Doomsdrzej aka Sliver Slimer and me, no one has ever seen that before (◔_◔). Why does Onion Knight focus on Doomsdrzej aka Sliver Slimer's self-esteem issues so much? What did Doomsdrzej aka Sliver Slimer expect from the lying imbecile? That Onion Knight schmuck has nothing to lose but time. He has nothing else, especially not confidence. He is as incompetent as Onion Knight. -- I Left My Husband & Daughter At Home And THIS happened http://www.5z8.info/lemon-party-redux_v1o7pm_nakedgrandmas.jpg Jonas Eklundh
[toc] | [prev] | [next] | [standalone]
| From | "F. Russell" <fr@random.info> |
|---|---|
| Date | 2018-10-05 00:32 +0000 |
| Message-ID | <pp6bf00ajj@news4.newsguy.com> |
| In reply to | #470694 |
On Fri, 05 Oct 2018 00:02:50 +0000, owl wrote: > > anon@lowtide:~$ telnet news.eternal-september.org 119 > Trying 85.214.115.223... > Connected to reader02.eternal-september.org. > This is a gas! Here is my session, with telnet from the latest GNU inetutils, which, by the way, most Linux distros no longer include because it is considered too old fashioned: ./telnet news.newsguy.com 119 Trying 74.209.136.92... Connected to news.newsguy.com. Escape character is '^]'. 200 news4.newsguy.com ready (posting ok). authinfo user xxxxxxxxxx 381 PASS required authinfo pass xxxxxxxxx 281 Ok group comp.os.linux.advocacy 211 1421844 2 1421845 comp.os.linux.advocacy xhdr from 1421845 221 from fields follow 1421845 Steve Carroll <fretwizzer@gmail.com> . quit 205 This should also be possible using the functions of glibc because telnet only calls glibc to do its stuff. http://ftp.gnu.org/gnu/inetutils Here are the available commands from help: starttls article [MessageID|Number] body [MessageID|Number] date group newsgroup head [MessageID|Number] help ihave last list [active|newsgroups|distributions|schema] listgroup newsgroup mode reader newgroups yymmdd hhmmss ["GMT"] [<distributions>] next post slave stat [MessageID|Number] xgtitle [group_pattern] xhdr header [range|MessageID] xover [range] xpat header range|MessageID pat [morepat...] xpath xpath MessageID
[toc] | [prev] | [next] | [standalone]
| From | Steve Carroll <frelwizzen@gmail.com> |
|---|---|
| Date | 2018-10-04 17:46 -0700 |
| Message-ID | <f7d121a1-b114-438a-b8e7-e0b8036fc0a4@googlegroups.com> |
| In reply to | #470702 |
On Thursday, October 4, 2018 at 5:33:23 PM UTC-7, F. Russell wrote: > On Fri, 05 Oct 2018 00:02:50 +0000, owl wrote: > > > > > anon@lowtide:~$ telnet news.eternal-september.org 119 > > Trying 85.214.115.223... > > Connected to reader02.eternal-september.org. > > > > This is a gas! > > Here is my session, with telnet from the latest GNU inetutils, > which, by the way, most Linux distros no longer include because > it is considered too old fashioned: > > ./telnet news.newsguy.com 119 > Trying 74.209.136.92... > Connected to news.newsguy.com. > Escape character is '^]'. > 200 news4.newsguy.com ready (posting ok). > authinfo user xxxxxxxxxx > 381 PASS required > authinfo pass xxxxxxxxx > 281 Ok > group comp.os.linux.advocacy > 211 1421844 2 1421845 comp.os.linux.advocacy > xhdr from 1421845 > 221 from fields follow > 1421845 Steve Carroll <fretwizzer@gmail.com> > . > quit > 205 > > This should also be possible using the functions of glibc > because telnet only calls glibc to do its stuff. > > http://ftp.gnu.org/gnu/inetutils > > Here are the available commands from help: > > starttls > article [MessageID|Number] > body [MessageID|Number] > date > group newsgroup > head [MessageID|Number] > help > ihave > last > list [active|newsgroups|distributions|schema] > listgroup newsgroup > mode reader > newgroups yymmdd hhmmss ["GMT"] [<distributions>] > next > post > slave > stat [MessageID|Number] > xgtitle [group_pattern] > xhdr header [range|MessageID] > xover [range] > xpat header range|MessageID pat [morepat...] > xpath xpath MessageID The 'The Flooder' Thing can't get anything else to work, either. Too much glue for you, Gluehead. Having to suffer the use of Elementary OS is not what most want to do. If The 'The Flooder' Thing calls getting his ass kicked hard for over a decade by dozens of people successful 'trolling', then whatever... he is a splendid troll. I can not subscribe to that meaning, I use another term. I call that person a perfect cretin. Ending support for 16 bit apps is obvious. The 'The Flooder' Thing has yet to show how Elementary OS does anything above the LCD on Linux. So, yeah, I buy into my own fantasy, fully knowing The 'The Flooder' Thing has been fooled, because it makes me reconsider my script, improving it. RonB has been here to determine the depths of the guy's turpitude. -- This broke the Internet https://youtu.be/48_DdtLGR9s http://www.5z8.info/killallimmigrants_t8w8io_asian-brides Jonas Eklundh Communication AB
[toc] | [prev] | [next] | [standalone]
| From | owl <owl@rooftop.invalid> |
|---|---|
| Date | 2018-10-05 00:55 +0000 |
| Message-ID | <z8b000b0zb.3gau@rooftop.invalid> |
| In reply to | #470702 |
F. Russell <fr@random.info> wrote: > On Fri, 05 Oct 2018 00:02:50 +0000, owl wrote: > >> >> anon@lowtide:~$ telnet news.eternal-september.org 119 >> Trying 85.214.115.223... >> Connected to reader02.eternal-september.org. >> > > This is a gas! > > Here is my session, with telnet from the latest GNU inetutils, > which, by the way, most Linux distros no longer include because > it is considered too old fashioned: > Yeah, it's fun. You can post with it too. :)
[toc] | [prev] | [next] | [standalone]
| From | owl <owl@rooftop.invalid> |
|---|---|
| Date | 2018-10-05 01:17 +0000 |
| Message-ID | <a9z9bv0ba.3h@rooftop.invalid> |
| In reply to | #470702 |
F. Russell <fr@random.info> wrote:
> On Fri, 05 Oct 2018 00:02:50 +0000, owl wrote:
>
>>
>> anon@lowtide:~$ telnet news.eternal-september.org 119
>> Trying 85.214.115.223...
>> Connected to reader02.eternal-september.org.
>>
>
> This is a gas!
>
> Here is my session, with telnet from the latest GNU inetutils,
> which, by the way, most Linux distros no longer include because
> it is considered too old fashioned:
>
> ./telnet news.newsguy.com 119
> Trying 74.209.136.92...
> Connected to news.newsguy.com.
> Escape character is '^]'.
> 200 news4.newsguy.com ready (posting ok).
> authinfo user xxxxxxxxxx
> 381 PASS required
> authinfo pass xxxxxxxxx
> 281 Ok
> group comp.os.linux.advocacy
> 211 1421844 2 1421845 comp.os.linux.advocacy
> xhdr from 1421845
> 221 from fields follow
> 1421845 Steve Carroll <fretwizzer@gmail.com>
> .
> quit
> 205
>
> This should also be possible using the functions of glibc
> because telnet only calls glibc to do its stuff.
>
Just create a socket read/write to it. There's some skeleton TCP client
code out there somewhere that you can fiddle with if you want to get
into the nitty gritty, but that's what netcat was designed for really.
<quote>
NAME
nc — arbitrary TCP and UDP connections and listens
SYNOPSIS
nc [-46bCDdhklnrStUuvZz] [-I length] [-i interval] [-O length]
[-P proxy_username] [-p source_port] [-q seconds] [-s source]
[-T toskeyword] [-V rtable] [-w timeout] [-X proxy_protocol] [-x
proxy_address[:port]] [destination] [port]
DESCRIPTION
The nc (or netcat) utility is used for just about anything under the sun
involving TCP, UDP, or UNIX-domain sockets. It can open TCP connections,
send UDP packets, listen on arbitrary TCP and UDP ports, do port scan‐
ning, and deal with both IPv4 and IPv6. Unlike telnet(1), nc scripts
nicely, and separates error messages onto standard error instead of send‐
ing them to standard output, as telnet(1) does with some.
Common uses include:
· simple TCP proxies
· shell-script based HTTP clients and servers
· network daemon testing
· a SOCKS or HTTP ProxyCommand for ssh(1)
· and much, much more
</quote>
[toc] | [prev] | [next] | [standalone]
| From | chrisv <chrisv@nospam.invalid> |
|---|---|
| Date | 2018-10-05 06:59 -0500 |
| Message-ID | <e6kerdpaoqva45q97c6c562v7ioh1vuda6@4ax.com> |
| In reply to | #470694 |
owl wrote: >It doesn't matter how you connect. Telnet works too. This is all >that newsreader software does when connecting. It just sends nntp >commands, and the server responds. The server doesn't care how >you connect. It's just listening on the port and responding to >commands. It's the same with HTTP and any other internet service. >Each service has its own set of commands that it understands. >If you succeed in connecting to nntp, type 'help' and the server >will return a list of commands that you can play with. > >anon@lowtide:~$ telnet news.eternal-september.org 119 >Trying 85.214.115.223... >Connected to reader02.eternal-september.org. >Escape character is '^]'. >200 reader02.eternal-september.org InterNetNews NNRP server INN 2.7.0 (20180513 snapshot) ready (posting ok) >authinfo user XXXXXXXXX >381 Enter password >authinfo pass XXXXXXXXX >281 Authentication succeeded >group comp.os.linux.advocacy >211 446788 22199 706009 comp.os.linux.advocacy Cool tech tip! It's not working, for me, though. I get a "200 Welcome to Usenet (fx45.iad)" message, and then nothing. No prompt, no response to any input. -- "Owl is asking for help in a public forum" - some thing, lying shamelessly (but no one can quote it lying)
[toc] | [prev] | [next] | [standalone]
| From | Steve Carroll <frelwizzen@gmail.com> |
|---|---|
| Date | 2018-10-05 05:14 -0700 |
| Message-ID | <fe084550-2258-4e90-b910-f502593d89c8@googlegroups.com> |
| In reply to | #470776 |
On Friday, October 5, 2018 at 4:59:13 AM UTC-7, chrisv wrote: > owl wrote: > > >It doesn't matter how you connect. Telnet works too. This is all > >that newsreader software does when connecting. It just sends nntp > >commands, and the server responds. The server doesn't care how > >you connect. It's just listening on the port and responding to > >commands. It's the same with HTTP and any other internet service. > >Each service has its own set of commands that it understands. > >If you succeed in connecting to nntp, type 'help' and the server > >will return a list of commands that you can play with. > > > >anon@lowtide:~$ telnet news.eternal-september.org 119 > >Trying 85.214.115.223... > >Connected to reader02.eternal-september.org. > >Escape character is '^]'. > >200 reader02.eternal-september.org InterNetNews NNRP server INN 2.7.0 (20180513 snapshot) ready (posting ok) > >authinfo user XXXXXXXXX > >381 Enter password > >authinfo pass XXXXXXXXX > >281 Authentication succeeded > >group comp.os.linux.advocacy > >211 446788 22199 706009 comp.os.linux.advocacy > > Cool tech tip! It's not working, for me, though. I get a "200 > Welcome to Usenet (fx45.iad)" message, and then nothing. No prompt, > no response to any input. > > -- > "Owl is asking for help in a public forum" - some thing, lying > shamelessly (but no one can quote it lying) My view is beyond your understanding. If the content is a bunch of rambling baby sh*t. That points to one person. I quoted specific examples of Takuya Saitoh failing to rise up and instead putting others down -- flat out making things up, etc. His response: to beg your herd to come rescue you. Takuya Saitoh wants to punish the whole group: If he can't get attention here then his flooding crap will. How is FileZilla on Linux doing anything above the lowest common denominator? Complete tripe by an ignorant, fibbing, slippery, conspiring nitwit who would not be honest even if you paid him to. But Takuya Saitoh feels the need to please the cult-like herd of convenient friends. -- I Left My Husband & Daughter At Home And THIS happened!! https://www.facebook.com/jenny.eklund Jonas Eklundh Communication AB
[toc] | [prev] | [next] | [standalone]
| From | owl <owl@rooftop.invalid> |
|---|---|
| Date | 2018-10-05 12:48 +0000 |
| Message-ID | <guxzv883a.ia9@rooftop.invalid> |
| In reply to | #470776 |
chrisv <chrisv@nospam.invalid> wrote: > owl wrote: > >>It doesn't matter how you connect. Telnet works too. This is all >>that newsreader software does when connecting. It just sends nntp >>commands, and the server responds. The server doesn't care how >>you connect. It's just listening on the port and responding to >>commands. It's the same with HTTP and any other internet service. >>Each service has its own set of commands that it understands. >>If you succeed in connecting to nntp, type 'help' and the server >>will return a list of commands that you can play with. >> >>anon@lowtide:~$ telnet news.eternal-september.org 119 >>Trying 85.214.115.223... >>Connected to reader02.eternal-september.org. >>Escape character is '^]'. >>200 reader02.eternal-september.org InterNetNews NNRP server INN 2.7.0 (20180513 snapshot) ready (posting ok) >>authinfo user XXXXXXXXX >>381 Enter password >>authinfo pass XXXXXXXXX >>281 Authentication succeeded >>group comp.os.linux.advocacy >>211 446788 22199 706009 comp.os.linux.advocacy > > Cool tech tip! It's not working, for me, though. I get a "200 > Welcome to Usenet (fx45.iad)" message, and then nothing. No prompt, > no response to any input. > I don't have a fastusenet account, but I was able to interact: anon@lowtide:~$ telnet news.fastusenet.org 119 Trying 69.16.179.46... Connected to fastusenet-us.sslusenet.com. Escape character is '^]'. 200 Welcome to Usenet (fx35.iad) help 100 Legal Commands article [<messageid>|number] authinfo type value body [<messageid>|number] date group newsgroup head [<messageid>|number] help last list [active wildmat|active.times|counts wildmat] list [overview.fmt|newsgroups wildmat] listgroup newsgroup mode reader next post stat [<messageid>|number] xhdr field [range] xover [range] xfeature useragent <client identifier> xfeature compress gzip [terminator] xzver [range] xzhdr field [range] quit . quit 205 Goodbye Connection closed by foreign host. anon@lowtide:~$
[toc] | [prev] | [next] | [standalone]
Page 6 of 8 — ← Prev page 1 2 3 4 5 [6] 7 8 Next page →
Back to top | Article view | comp.os.linux.advocacy
csiph-web