Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > news.admin.peering > #3443

Re: another peeve with newsmaster who dont do common sense

Show all headers | View raw

On 8/1/26 21:41, Marco Moock wrote:
> Am 02.08.26 um 03:19 schrieb Kevin Bowling:
>>
>> The Internet Protocols are the same, only the L7 differs.  Inbound 
>> NNTP is basically the worst possible place to use a load balancer, you 
>> just have the feeders peer with each other and outward and everything 
>> flood fills without any additional complexity.  Reader servers might 
>> benefit from a sticky session LB, and a _proxy_ (not LB) would be less 
>> ridiculous for inbound if it was providing routing or message oracle 
>> for some distributed backend.
> 
> Is a reader server for text-only groups in need of a load balancer or 
> can current hardware handle all the sessions?
> 

For the most part a single system can handle it if designed for.  It 
might be a little tight for a place like Eternal September that might 
see 10k idle connections.

The current issue with inn specifically is that it forks a new nnrpd 
process for every reader connection.  That means each connection costs 
many megabytes of RAM, when the actual weight of a connection could be 
kilobytes.  The way to solve this is to make the connections cheap, with 
an event loop, and have nnrpd service many connections as they notify 
(via the kernel) of read/write readiness.  But there is a lot of work to 
get there, and you still want some fan out to processes (or threads) to 
continue taking advantage of multiple CPU cores.

In the mean time something like 
https://github.com/mjc/nntp-proxy/tree/main would be helpful to an inn 
reader deployment where idle connections sit on a cheap event loop, and 
are multiplexed back to the expensive nnrpd processes.  Note that I 
haven't looked deeply at that code so I don't know how complete or 
effective it is.  To highlight the complexity, csiph grew a fairly 
sophisticated connection pooler for similar reasons (the complexity is 
to deal with things like a WWW request aborting.. I want the NNTP conn 
to stay alive and be in a known good state so it finishes the NNTP 
transaction anyway which is cheaper than tearing down and setting up a 
new conn).

Back to news.admin.peering | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread

Thread

another peeve with newsmaster who dont do common sense noel <deletethis@invalid.lan> - 2026-08-01 09:56 +1000
  Re: another peeve with newsmaster who dont do common sense Nomen Nescio <nobody@dizum.com> - 2026-08-01 03:13 +0000
    Re: another peeve with newsmaster who dont do common sense Marco Moock <mm@dorfdsl.de> - 2026-08-01 06:18 +0200
      Re: another peeve with newsmaster who dont do common sense Ray Banana <rayban@raybanana.net> - 2026-08-01 08:52 +0200
        Re: another peeve with newsmaster who dont do common sense Kevin Bowling <kevin.bowling@kev009.com> - 2026-08-01 01:10 -0700
          Re: another peeve with newsmaster who dont do common sense noel <deletethis@invalid.lan> - 2026-08-01 20:55 +1000
            Re: another peeve with newsmaster who dont do common sense Kevin Bowling <kevin.bowling@kev009.com> - 2026-08-01 04:50 -0700
              Re: another peeve with newsmaster who dont do common sense noel <deletethis@invalid.lan> - 2026-08-01 23:54 +1000
                Re: another peeve with newsmaster who dont do common sense Jesse Rehmer <jesse.rehmer@blueworldhosting.com> - 2026-08-01 16:25 +0000
                Re: another peeve with newsmaster who dont do common sense Ivo Gandolfo <usenet@bofh.team> - 2026-08-01 21:02 +0200
                Re: another peeve with newsmaster who dont do common sense noel <deletethis@invalid.lan> - 2026-08-02 09:04 +1000
                Re: another peeve with newsmaster who dont do common sense Ivo Gandolfo <usenet@bofh.team> - 2026-08-02 12:54 +0200
                Re: another peeve with newsmaster who dont do common sense noel <deletethis@invalid.lan> - 2026-08-04 08:23 +1000
                Re: another peeve with newsmaster who dont do common sense Jesse Rehmer <jesse.rehmer@blueworldhosting.com> - 2026-08-04 02:34 +0000
                Re: another peeve with newsmaster who dont do common sense Kevin Bowling <kevin.bowling@kev009.com> - 2026-08-06 00:12 -0700
                Re: another peeve with newsmaster who dont do common sense Nomen Nescio <nobody@dizum.com> - 2026-08-02 11:45 +0000
                Re: another peeve with newsmaster who dont do common sense Kevin Bowling <kevin.bowling@kev009.com> - 2026-08-01 16:25 -0700
                Re: another peeve with newsmaster who dont do common sense Eddie Martin <ejm@nospammy.myplace.de> - 2026-08-02 10:50 +1000
                Re: another peeve with newsmaster who dont do common sense Kevin Bowling <kevin.bowling@kev009.com> - 2026-08-01 18:19 -0700
                Re: another peeve with newsmaster who dont do common sense Eddie Martin <ejm@nospammy.myplace.de> - 2026-08-02 13:29 +1000
                Re: another peeve with newsmaster who dont do common sense Kevin Bowling <kevin.bowling@kev009.com> - 2026-08-01 21:02 -0700
                Re: another peeve with newsmaster who dont do common sense Marco Moock <mm@dorfdsl.de> - 2026-08-02 06:41 +0200
                Re: another peeve with newsmaster who dont do common sense Kevin Bowling <kevin.bowling@kev009.com> - 2026-08-01 22:11 -0700
                Re: another peeve with newsmaster who dont do common sense Ivo Gandolfo <usenet@bofh.team> - 2026-08-02 13:02 +0200
                Re: another peeve with newsmaster who dont do common sense D <J@M> - 2026-08-02 06:47 +0200
        Re: another peeve with newsmaster who dont do common sense noel <deletethis@invalid.lan> - 2026-08-01 20:08 +1000
          Re: another peeve with newsmaster who dont do common sense Ray Banana <rayban@raybanana.net> - 2026-08-01 16:35 +0200
    Re: another peeve with newsmaster who dont do common sense noel <deletethis@invalid.lan> - 2026-08-01 20:07 +1000
  Re: another peeve with newsmaster who dont do common sense Nigel Reed <sysop@endofthelinebbs.com> - 2026-08-15 01:47 -0500
    Re: another peeve with newsmaster who dont do common sense Jesse Rehmer <jesse.rehmer@blueworldhosting.com> - 2026-08-15 13:17 +0000
      Re: another peeve with newsmaster who dont do common sense Nigel Reed <sysop@endofthelinebbs.com> - 2026-08-29 22:32 -0500

csiph-web