Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.os.linux.advocacy > #472053

Pipelining "Article" commands.

From Jeff-Relf.Me @.
Message-ID <Jeff-Relf.Me@Oct.14--2.23pm.Seattle.2018> (permalink)
References (1 earlier) <0qstD.79312$uJ2.3100@fx27.iad> <055d7376-8773-4ca9-8cd3-4fd8c1a2764f@googlegroups.com> <W1ztD.39291$xo2.777@fx31.iad> <Jeff-Relf.Me@Oct.14--1.41am.Seattle.2018> <ufJwD.316258$Vl2.213729@fx46.iad>
Newsgroups comp.os.linux.advocacy, news.software.readers, alt.free.newsservers
Subject Pipelining "Article" commands.
Organization usenet-news.net
Date 2018-10-14 14:23 -0700

Cross-posted to 3 groups.

Show all headers | View raw


> > I "pipeline" 100 "Article" commands at a time ( all at once ),
> > and I use a 4 MegaByte input buffer -- it's very sophisticated.
> 
> Show us the source!

You've seen it; it's "X.CPP" in "Jeff-Relf.Me/X.ZIP".

  LoopJ( er( 100, ReqArts  ) ) d += _Str( d, "Article %I64d\r\n", artNum-- );

Oddly, "Article %d" doesn't work, even though I'm running x64 code. 
Updating Visual Studio may change the "Windows SDK" and the "14.15.26726"
in "C:\__\EXEs\VisualStudio2017\VC\Tools\MSVC\14.15.26726\lib\x64".

My "text" servers: 

  News5.Open-News-Network.ORG
  News2.Open-News-Network.ORG

> > Upon receiving a chunk ( e.g. a 30 KiloByte Article ),
> > I check for proper line endings -- "\r\n" in the header,
> > "\r" and/or "\n" in the body, if the "Content-Type:" is text.
> 
> You do these checks and still get 1000 posts in 4 seconds?

Yes, posts are converted as they're downloaded.

> > I don't parse the Body UnlessAndUntil I have the full header
> > ( so I know what the "Content-Type:" is ).
> > The body itself may have varios (MIME) "Content-Type:" lines.
> 
> Are you storing all the downloaded data in one big file?

Yes, it updates "Cola.TXT" and/or "Phy.TXT";
I keep what I want to read, discarding the rest; see:

  Jeff-Relf.Me/Cola_Regs.HTM

My posts to Usenet ( since Feb 2012 ): Jeff-Relf.Me/Posts.TXT

Back to comp.os.linux.advocacy | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread


Thread

Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-04 10:08 -0400
  Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-04 08:51 -0700
    Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-04 13:50 -0400
      Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-04 11:59 -0700
        Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-04 21:23 -0400
          Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-05 08:12 -0700
            Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-05 08:21 -0700
          Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-05 09:55 -0700
            Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-05 13:51 -0400
              Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-05 11:16 -0700
          "Path:" is the only line that's never fake. Jeff-Relf.Me  @. - 2018-10-14 01:41 -0700
            Re: "Path:" is the only line that's never fake. "Sir Gregory Hall,  Esq." <greghall@yacht_maester.fake> - 2018-10-14 11:16 -0400
              Re: "Path:" is the only line that's never fake. Steve Carroll <frelwizzen@gmail.com> - 2018-10-14 08:38 -0700
              Re: "Path:" is the only line that's never fake. snipeco.2@gmail.com (Sn!pe) - 2018-10-14 16:40 +0100
                Re: "Path:" is the only line that's never fake. "Sir Gregory Hall,  Esq." <greghall@yacht_maester.fake> - 2018-10-14 11:43 -0400
                Re: "Path:" is the only line that's never fake. snipeco.2@gmail.com (Sn!pe) - 2018-10-14 17:12 +0100
                Re: "Path:" is the only line that's never fake. "Sir Gregory Hall,  Esq." <greghall@yacht_maester.fake> - 2018-10-14 12:23 -0400
                Re: "Path:" is the only line that's never fake. snipeco.2@gmail.com (Wader of Doom) - 2018-10-14 18:01 +0100
                No one can do "a perfect forgery" of my posts. Jeff-Relf.Me  @. - 2018-10-14 14:29 -0700
                Re: No one can do "a perfect forgery" of my posts. "Sir Gregory Hall,  Esq." <greghall@yacht_maester.fake> - 2018-10-14 17:33 -0400
                Re: No one can do "a perfect forgery" of my posts. snipeco.2@gmail.com (Sn!pe) - 2018-10-14 22:47 +0100
                Re: No one can do "a perfect forgery" of my posts. "Sir Gregory Hall,  Esq." <greghall@yacht_maester.fake> - 2018-10-14 17:53 -0400
                Re: No one can do "a perfect forgery" of my posts. snipeco.2@gmail.com (Sn!pe) - 2018-10-14 22:58 +0100
                Re: No one can do "a perfect forgery" of my posts. Steve Carroll <frelwizzen@gmail.com> - 2018-10-14 14:56 -0700
                Re: No one can do "a perfect forgery" of my posts. Steve Carroll <frelwizzen@gmail.com> - 2018-10-14 14:41 -0700
                Re: "Path:" is the only line that's never fake. Steve Carroll <frelwizzen@gmail.com> - 2018-10-14 08:54 -0700
            Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-14 11:26 -0400
              Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-14 09:23 -0700
                Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-14 18:53 +0000
                Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-14 13:27 -0700
                Re: slrn is trembling Melzzzzz <Melzzzzz@zzzzz.com> - 2018-10-14 20:55 +0000
              Pipelining "Article" commands. Jeff-Relf.Me  @. - 2018-10-14 14:23 -0700
              Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-15 13:49 +0000
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-15 07:34 -0700
                Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-15 21:54 -0400
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-15 19:15 -0700
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-15 21:51 -0700
                Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-16 03:16 +0000
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-15 20:33 -0700
                Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-16 10:26 -0400
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-16 07:44 -0700
                Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-16 15:17 +0000
                Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-16 12:26 -0400
                Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-16 09:46 -0700
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-16 10:21 -0700
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-16 14:00 -0700
                Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-16 16:49 +0000
      Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-04 12:35 -0700
      Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-04 20:44 +0000
        Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-04 14:09 -0700
        Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-04 14:50 -0700
          Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-04 22:32 +0000
            Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-04 23:03 +0000
              Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-04 16:28 -0700
              Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-04 16:54 -0700
                Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 00:02 +0000
                Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-04 17:20 -0700
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-04 17:31 -0700
                Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 00:32 +0000
                Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-04 17:41 -0700
                Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 00:54 +0000
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-04 18:02 -0700
                Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 01:07 +0000
                Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-04 18:11 -0700
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-04 18:48 -0700
                Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 02:06 +0000
                Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-05 08:01 -0700
                Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 15:35 +0000
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-05 08:37 -0700
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-05 08:53 -0700
                Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-05 08:57 -0700
                Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-05 09:17 -0700
                Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-05 09:19 -0700
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-05 09:41 -0700
                Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 16:19 +0000
                Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-05 09:23 -0700
                Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 16:40 +0000
                Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-05 09:41 -0700
                Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 17:39 +0000
                Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-05 11:07 -0700
                Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 18:14 +0000
                Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-05 11:41 -0700
                Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 18:52 +0000
                Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-06 08:46 -0700
                Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-06 11:29 -0700
                Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-06 11:48 -0700
                Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-06 11:51 -0700
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-06 12:19 -0700
                Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-06 15:34 -0700
                Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-08 21:27 +0000
                Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-08 17:49 -0700
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-08 18:13 -0700
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-09 07:31 -0700
                Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-09 13:45 +0000
                Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-09 07:55 -0700
                Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-09 15:55 +0000
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-09 09:20 -0700
                Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-09 09:39 -0700
                Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-09 09:41 -0700
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-09 10:23 -0700
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-09 23:38 -0700
                Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-09 17:47 +0000
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-09 11:09 -0700
                Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-10 09:04 -0700
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-10 13:56 -0700
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-11 05:02 -0700
                Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-10 10:33 -0400
                Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-10 19:21 +0000
                Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-12 20:46 -0400
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-12 23:50 -0700
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-08 18:44 -0700
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-06 14:08 -0700
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-05 11:32 -0700
                Re: slrn is trembling "F. Russell" <fr@random.info> - 2018-10-05 00:32 +0000
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-04 17:46 -0700
                Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 00:55 +0000
                Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 01:17 +0000
                Re: slrn is trembling chrisv <chrisv@nospam.invalid> - 2018-10-05 06:59 -0500
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-05 05:14 -0700
                Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 12:48 +0000
                Re: slrn is trembling chrisv <chrisv@nospam.invalid> - 2018-10-05 11:17 -0500
                Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-05 13:35 -0400
                Re: slrn is trembling Silicon Vee <siliconvee1945@yahoo.com> - 2018-10-11 01:36 +0200
                Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-04 17:07 -0700
                Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 00:12 +0000
                Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-04 17:21 -0700
                Re: slrn is trembling SilverSlimer <silver@slim.er> - 2018-10-05 12:01 +0000
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-05 05:30 -0700
                Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-05 08:13 -0700
                Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-05 12:50 -0400
                Re: slrn is trembling Steve Carroll <fretwizzer@gmail.com> - 2018-10-05 10:35 -0700
                Re: slrn is trembling chrisv <chrisv@nospam.invalid> - 2018-10-10 08:51 -0500
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-10 07:09 -0700
                Re: slrn is trembling Sam O'Nella <poison@donteatit.net> - 2018-10-05 16:43 -0400
                Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-10 10:34 -0400
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-10 07:56 -0700
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-10 12:38 -0700
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-11 02:12 -0700
                Re: slrn is trembling Snit <usenet@gallopinginsanity.com> - 2018-10-12 12:27 -0700
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-12 12:42 -0700
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-12 21:47 -0700
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-14 03:28 -0700
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-12 20:45 -0700
                Re: slrn is trembling Snit <usenet@gallopinginsanity.com> - 2018-10-05 15:15 -0700
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-05 15:41 -0700
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-05 19:21 -0700
                Re: slrn is trembling Snit <usenet@gallopinginsanity.com> - 2018-10-05 13:44 -0700
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-05 17:48 -0700
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-04 17:15 -0700
            Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-04 16:13 -0700
        Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-04 20:47 -0400
          Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 01:09 +0000
            Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-04 18:18 -0700
            Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-04 21:38 -0400
              Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-04 19:04 -0700
              Re: slrn is trembling owl <owl@rooftop.invalid> - 2018-10-05 02:05 +0000
                Re: slrn is trembling Steve Carroll <frelwizzen@gmail.com> - 2018-10-04 19:35 -0700
                Re: slrn is trembling DFS <nospam@nospam.com> - 2018-10-10 10:36 -0400

csiph-web