Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > rocksolid.programming > #251 > unrolled thread

import script from several formats

Back to article view | Back to rocksolid.programming

Contents

  import script from several formats Retro Guy <retro_guy@novabbs.com> - 2021-02-07 03:01 -0700
    Re: import script from several formats retro.guy@rocksolidbbs.com (Retro Guy) - 2021-02-09 10:10 +0000
      Re: import script from several formats retro.guy@rocksolidbbs.com (Retro Guy) - 2021-02-09 10:28 +0000

#251 — import script from several formats

I'm working on an import script for news archives into rslight.

The main reason was to easily copy a newsgroup from one rslight site to
another without just copying the entire spool, just copy the group .db3
file. Then I realized I have old .mbox files of some newsgroups dating
back to around 1998 and thought it would be fun to import these messages
also.

I can easily pull the articles from .mbox, and I'll use the code from
spoolnews.php to plug them into rslight. The idea is I can just drop
a .mbox or rslight.db3 file into a directory and it will be
automatically imported. 

It shouldn't be difficult to get this done, so hopefully I can spend
some time next week and finish it up. I've been reading through some of
the old articles and it's interesting. I also need to make sure the
date format will work, or I'll convert the dates during import. Some
old news has dates like

Date: 1998/08/10

Just need to make sure these dates are read properly.

Retro Guy

[toc] | [next] | [standalone]

#252

Retro Guy wrote:

> It shouldn't be difficult to get this done, so hopefully I can spend
> some time next week and finish it up. I've been reading through some of
> the old articles and it's interesting. I also need to make sure the
> date format will work, or I'll convert the dates during import. Some

This seems to be going well. Conversion was not difficult.

I also have earlier articles (early 80s) which are fun to have, but the headers are severely lacking. Not sure I'll spend much time on those right now.

Threading is weak in earlier articles, but as long as I have an actual newsgroup name I can put it in the right place. I'll be working on this more over the next few weeks.

Retro Guy
-- 
Posted on Rocksolid Light
news.novabbs.org

[toc] | [prev] | [next] | [standalone]

#253

Retro Guy wrote:

> I also have earlier articles (early 80s) which are fun to have, but the headers are severely lacking. Not sure I'll spend much time on those right now.

Here's an example of an early header and message. Quite different from current headers, but the info is there. Forget threading, lol:

Autzoo.101
test
utzoo!henry
Fri Feb  6 00:19:47 1981
first_test
This is the first U of T test of the Duke news program.
Here is some more text.
And some more.
-- 
Posted on Rocksolid Light
news.novabbs.org

[toc] | [prev] | [standalone]

Back to top | Article view | rocksolid.programming

csiph-web