Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...]

Message-ID	<66a31b29@news.ausics.net> (permalink)
From	Computer Nerd Kev <not@telling.you.invalid>
Subject	Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...]
Newsgroups	comp.misc
References	(7 earlier) <v7te4f$r6l$1@nnrp.usenet.blueworldhosting.com> <v7tmng$2abtm$1@dont-email.me> <v7tvu0$2c8e9$1@dont-email.me> <66a2d000@news.ausics.net> <20240726013343.02805fe30e4853cf7cd40797@gmail.moc>
Date	2024-07-26 13:42 +1000
Organization	Ausics - https://newsgroups.ausics.net

Show all headers | View raw

Anton Shepelev <anton.txt@gmail.moc> wrote:
> Computer Nerd Kev:
> 
>> I must get around to trying to build a web forum to NNTP
>> gateway one day, although It'll probably send me crazy
>> trying to keep up with scraping different forum platform
>> page layouts.
> 
> In case you are building it for the heck of it, there is one
> already:
>                 <https://news.novabbs.org>
> 
> If, on the other hand, your ambition is a bridge between
> real web forums and NNTP, there have been working
> implementations in englishforums.com (many years ago) and
> the Microsoft forums (via NNTPBridge, not so many years
> ago). Both were abandoned, partly because forums do not
> agree with NNTP either ideologically (centralisation)
> physically (different message format).

Perhaps I was too vague, I'm talking about something run
separately from the forum operators, like Gwene does with RSS.
I described my ambitions better last year in news.software.nntp
when I asked about any existing projects (without receiving any
relevent suggestions). See below.

Later I found this project that might help as a basis for the forum
scraping aspect:
https://github.com/mikwielgus/forum-dl

Though I don't think I could rely on that project to be maintained
and keep up with forum platform changes, since a recent comment
from the author is:
"Sadly, I haven't had much time to continue this project as I'm
 currently very busy with another one."
So I'd probably have to maintain something like it myself, which
might not be worth the pain.

Message-ID: <651b4c54@news.ausics.net>
Subject: Client-Side Bridge to Web Forums?
Newsgroups: news.software.nntp

Web forums keep annoying me more and more with bloated interfaces,
so I'm using them less and less, yet there's less and less to read
on Usenet too. So lately I've been considering, not entirely
seriously, writing a program to scrape specific web forums and
generate a news spool with the content of the forum's latest posts
for me to read (either locally, or perhaps remotely via NNTP).

Has anyone done this before? I know there are various web forum
platforms that support NNTP server-side, but I'm talking about web
forums hosted by other people who I have no association or
influence with. Has anyone done something that's purely a
client-side implementation?

Simple Machines Forum and Discourse are prime targets for me, maybe
phpBB too. Most don't have RSS enabled, or the feed only shows the
start of new posts. The ideal would be a system supporting scrapers
for multiple forum platforms which can be easily extended.

Support for posting would be nice, but read-only access in a news
reader (Tin) would be better than nothing.

-- 
__          __
#_ < |\| |< _#

Back to comp.misc | Previous | Next — Previous in thread | Next in thread | Find similar

Thread

Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] Anton Shepelev <anton.txt@g{oogle}mail.com> - 2024-07-24 11:58 +0300
  Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] D <nospam@example.net> - 2024-07-24 11:08 +0200
    Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] Johanne Fairchild <jfairchild@tudado.org> - 2024-07-24 10:21 -0300
    Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] The Real Bev <bashley101@gmail.com> - 2024-07-24 15:10 -0700
      Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] D <nospam@example.net> - 2024-07-25 11:24 +0200
        Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] Rich <rich@example.invalid> - 2024-07-25 12:03 +0000
          Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] D <nospam@example.net> - 2024-07-25 17:38 +0200
            Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] Anton Shepelev <anton.txt@gmail.moc> - 2024-07-26 01:16 +0300
              Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] D <nospam@example.net> - 2024-07-26 10:44 +0200
                Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] kludge@panix.com (Scott Dorsey) - 2024-07-26 19:49 +0000
            Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] The Real Bev <bashley101@gmail.com> - 2024-07-25 20:04 -0700
              Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] D <nospam@example.net> - 2024-07-26 10:52 +0200
                Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] Johanne Fairchild <jfairchild@tudado.org> - 2024-07-26 09:21 -0300
                Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] D <nospam@example.net> - 2024-07-26 18:35 +0200
              Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] Retrograde <fungus@amongus.com.invalid> - 2024-07-27 03:06 +0000
                Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] D <nospam@example.net> - 2024-07-27 11:25 +0200
                Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] kludge@panix.com (Scott Dorsey) - 2024-07-27 13:38 +0000
                Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] D <nospam@example.net> - 2024-07-27 20:03 +0200
          Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] The Real Bev <bashley101@gmail.com> - 2024-07-25 19:52 -0700
        Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] The Real Bev <bashley101@gmail.com> - 2024-08-05 21:48 -0700
          Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] The Real Bev <bashley101@gmail.com> - 2024-08-06 17:14 -0700
            Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] Richard Kettlewell <invalid@invalid.invalid> - 2024-08-07 08:57 +0100
              Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] arnold@skeeve.com (Aharon Robbins) - 2024-08-07 15:04 +0000
                Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] Lawrence D'Oliveiro <ldo@nz.invalid> - 2024-08-07 22:53 +0000
                Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] kludge@panix.com (Scott Dorsey) - 2024-08-08 09:21 +0000
                Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] Lawrence D'Oliveiro <ldo@nz.invalid> - 2024-08-08 23:52 +0000
                Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] kludge@panix.com (Scott Dorsey) - 2024-08-09 20:54 +0000
                Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] Lawrence D'Oliveiro <ldo@nz.invalid> - 2024-08-09 23:32 +0000
                Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] Dan Purgert <dan@djph.net> - 2024-08-08 09:33 +0000
                Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] D <nospam@example.net> - 2024-08-08 22:24 +0200
                Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] Rich <rich@example.invalid> - 2024-08-08 20:31 +0000
                Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] D <nospam@example.net> - 2024-08-09 10:32 +0200
                Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] Bob Eager <news0009@eager.cx> - 2024-08-08 20:45 +0000
                Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] Lawrence D'Oliveiro <ldo@nz.invalid> - 2024-08-08 23:53 +0000
                Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] Dan Purgert <dan@djph.net> - 2024-08-09 01:14 +0000
                Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] Lawrence D'Oliveiro <ldo@nz.invalid> - 2024-08-09 02:41 +0000
                Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] kludge@panix.com (Scott Dorsey) - 2024-08-08 09:20 +0000
                Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] Johanne Fairchild <jfairchild@tudado.org> - 2024-08-13 22:40 -0300
              Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] The Real Bev <bashley101@gmail.com> - 2024-08-09 10:54 -0700
                Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] D <nospam@example.net> - 2024-08-09 22:28 +0200
                Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] The Real Bev <bashley101@gmail.com> - 2024-08-10 12:12 -0700
                Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] Johanne Fairchild <jfairchild@tudado.org> - 2024-08-13 22:43 -0300
                Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] D <remailer@domain.invalid> - 2024-08-13 22:54 -0400
            Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] kludge@panix.com (Scott Dorsey) - 2024-08-07 09:45 +0000
    Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] David LaRue <huey.dll@tampabay.rr.com> - 2024-08-05 14:49 +0000
      Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] D <nospam@example.net> - 2024-08-05 21:45 +0200
  Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] George Musk <grgmusk@skiff.com> - 2024-07-25 11:49 +0000
    Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] Marco Moock <mm+usenet-es@dorfdsl.de> - 2024-07-25 16:16 +0200
      Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] yeti <yeti@tilde.institute> - 2024-07-25 15:13 +0042
        Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] D <nospam@example.net> - 2024-07-25 17:39 +0200
      Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] Johanne Fairchild <jfairchild@tudado.org> - 2024-07-25 12:27 -0300
        Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] D <nospam@example.net> - 2024-07-25 23:40 +0200
          Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] candycanearter07 <candycanearter07@candycanearter07.nomail.afraid> - 2024-07-26 16:40 +0000
            Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] D <nospam@example.net> - 2024-07-26 22:38 +0200
        Re: Emigration from Usenet Johanne Fairchild <jfairchild@tudado.org> - 2024-07-26 19:38 -0300
          Re: Emigration from Usenet Johanne Fairchild <jfairchild@tudado.org> - 2024-07-27 10:03 -0300
          Re: Emigration from Usenet Richard Kettlewell <invalid@invalid.invalid> - 2024-07-27 17:24 +0100
            Re: Emigration from Usenet D <nospam@example.net> - 2024-07-27 20:06 +0200
              Re: Emigration from Usenet Rich <rich@example.invalid> - 2024-07-27 18:31 +0000
                Re: Emigration from Usenet D <nospam@example.net> - 2024-07-28 11:23 +0200
            Re: Emigration from Usenet Richard Kettlewell <invalid@invalid.invalid> - 2024-07-27 21:01 +0100
              Re: Emigration from Usenet The Real Bev <bashley101@gmail.com> - 2024-07-27 18:48 -0700
              Re: Emigration from Usenet D <nospam@example.net> - 2024-07-28 11:25 +0200
              Re: Emigration from Usenet Richard Kettlewell <invalid@invalid.invalid> - 2024-07-28 10:53 +0100
                Re: Emigration from Usenet Rich <rich@example.invalid> - 2024-07-28 16:00 +0000
                Re: Emigration from Usenet Richard Kettlewell <invalid@invalid.invalid> - 2024-07-28 21:35 +0100
                Re: Emigration from Usenet Rich <rich@example.invalid> - 2024-07-28 20:51 +0000
                Re: Emigration from Usenet D <nospam@example.net> - 2024-07-28 19:14 +0200
            Re: Emigration from Usenet Andreas Eder <a_eder_muc@web.de> - 2024-07-28 19:48 +0200
            Re: Emigration from Usenet Johanne Fairchild <jfairchild@tudado.org> - 2024-07-28 21:58 -0300
              Re: Emigration from Usenet Richard Kettlewell <invalid@invalid.invalid> - 2024-07-29 08:50 +0100
                Re: Emigration from Usenet Javier <invalid@invalid.invalid> - 2024-07-29 08:51 +0000
                Re: Emigration from Usenet yeti <yeti@tilde.institute> - 2024-07-29 09:51 +0042
                Re: Emigration from Usenet Rich <rich@example.invalid> - 2024-07-29 12:58 +0000
                Re: Emigration from Usenet Johanne Fairchild <jfairchild@tudado.org> - 2024-07-29 20:50 -0300
                Re: Emigration from Usenet Johanne Fairchild <jfairchild@tudado.org> - 2024-07-30 11:55 -0300
                Re: Emigration from Usenet Lawrence D'Oliveiro <ldo@nz.invalid> - 2024-07-30 20:35 +0000
                Re: Emigration from Usenet Richard Kettlewell <invalid@invalid.invalid> - 2024-07-29 14:21 +0100
            Re: Emigration from Usenet Johanne Fairchild <jfairchild@tudado.org> - 2024-07-28 22:00 -0300
              Re: Emigration from Usenet The Real Bev <bashley101@gmail.com> - 2024-07-28 19:41 -0700
                Re: Emigration from Usenet Mike Spencer <mds@bogus.nodomain.nowhere> - 2024-07-29 14:20 -0300
                Re: Emigration from Usenet The Real Bev <bashley101@gmail.com> - 2024-07-29 10:51 -0700
              Re: Emigration from Usenet D <nospam@example.net> - 2024-07-29 11:09 +0200
      Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] Rich <rich@example.invalid> - 2024-07-25 16:53 +0000
        Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] not@telling.you.invalid (Computer Nerd Kev) - 2024-07-26 08:21 +1000
          Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] Anton Shepelev <anton.txt@gmail.moc> - 2024-07-26 01:33 +0300
            Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] Computer Nerd Kev <not@telling.you.invalid> - 2024-07-26 13:42 +1000
              Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] D <nospam@example.net> - 2024-07-26 11:00 +0200
                Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] Computer Nerd Kev <not@telling.you.invalid> - 2024-07-26 22:18 +1000
                Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] Lawrence D'Oliveiro <ldo@nz.invalid> - 2024-07-28 01:55 +0000
              Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] Theo <theom+news@chiark.greenend.org.uk> - 2024-08-12 17:13 +0100
                Re: Emigration from Usenet [was: Re: PTD was the most-respected of the AUE regulars ...] not@telling.you.invalid (Computer Nerd Kev) - 2024-08-13 08:12 +1000

csiph-web