Groups | Search | Server Info | Login | Register

Groups > comp.infosystems.gopher > #771

Re: Gopherpedia is down

Show all headers | View raw

On 2025-03-20, anthk <anthk@openbsd.home> wrote:
> Now that gopher://gopherpedia.com it's down, is there any alternative?
>
> In case it gets back, I wish they implement the articles 
> as a gopher directory with two items, that's it:
> a link to the article itself and a directory with the article images.
>
> The article would have the images marked as [see figure1.png] or whatever.

Someone pointed out that gopherpedia.com uses clownflare for its
authoritative name servers.

    $ dig -t NS gopherpedia.com
    ...
    ns1.digitalocean.com.   103001  IN      A       172.64.52.210
    ns2.digitalocean.com.   103001  IN      A       172.64.53.21
    ns3.digitalocean.com.   103001  IN      A       172.64.49.209
    
    $ whois 172.64.52.210
    ...
    NetRange:       172.64.0.0 - 172.71.255.255
    CIDR:           172.64.0.0/13
    NetName:        CLOUDFLARENET
    NetHandle:      NET-172-64-0-0-1
    Parent:         NET172 (NET-172-0-0-0-0)
    NetType:        Direct Allocation
    OriginAS:       AS13335
    Organization:   Cloudflare, Inc. (CLOUD14)

After gopherpedia.com went down for many days, i chose to write a small
shell script to format Wikipedia pages as plain text.  I serve those
from my own gopher hole.  This script depends on two external programs.

* suckless `fold` command
<https://dl.suckless.org/sbase/>

* webdump
<https://codemadness.org/webdump.html>

    $ cat >gopherpoodia-fetch.sh <<__EOF__
#!/bin/sh
# Version 1
#
# Use suckless fold command instead of GNU coreutils.
# https://dl.suckless.org/sbase/sbase-0.1.tar.gz
#
# `fold` from GNU coreutils corrupts UTF-8.
# <https://debbugs.gnu.org/cgi/bugreport.cgi?bug=44975>
# <https://unix.stackexchange.com/questions/454044/
#  unicode-safe-alternative-for-fold/486428#486428>

page="$1"
if [ -z "$page" ]
then
    echo "Usage: gopherpoodia-fetch.sh [Wikipedia page title or URL]"
    echo ""
    echo "Converts Wikipedia page to plaintext document."
    echo ""
    exit 1
fi

base="https://en.wikipedia.org/wiki/"
title=${page##$base}
title=${title##/}
enctitle=$(echo "$title" | sed -e 's|/|%2F|g')
link="$base$enctitle"

agent="User-Agent: Gopherpoodia (user@stinkin.host)"
api="https://en.wikipedia.org/api/rest_v1"
url="$api/page/html/$enctitle"

outdir="public_gopher/wiki/"
safetitle=$(echo "$enctitle" |\
    sed -e 's|%2F|-|g' -e 's|\.\.|_|g' -e 's|:|_|g')
outfile="$outdir/$safetitle"

mkdir -p "$outdir"
curl -H "User-Agent: $agent" "$url" |\
    webdump -l -r -w 70 -b "$base"  |\
    sed -e 's|/\./|/|g'             |\
    fold.suckless -s -w 72 >"$outfile"

echo "" >>"$outfile"
echo "From: <$link>" >>"$outfile"
__EOF__

Back to comp.infosystems.gopher | Previous | Next — Previous in thread | Find similar

Thread

Gopherpedia is down anthk <anthk@openbsd.home> - 2025-03-20 09:35 +0000
  Re: Gopherpedia is down "Arti F. Idiot" <addr@is.invalid> - 2025-03-20 05:48 -0600
    Re: Gopherpedia is down anthk <anthk@openbsd.home> - 2025-03-20 14:36 +0000
      Re: Gopherpedia is down "Arti F. Idiot" <addr@is.invalid> - 2025-04-01 15:23 -0600
        Re: Gopherpedia is down anthk <anthk@openbsd.home> - 2025-04-08 08:04 +0000
        Re: Gopherpedia is down Daniel <me@sc1f1dan.com> - 2025-04-20 10:28 +0100
          Re: Gopherpedia is down IanJ <SPAMian_jones_01@yahoo.co.uk.invalid> - 2025-06-01 19:43 +0000
  Re: Gopherpedia is down Ben Collver <bencollver@tilde.pink> - 2025-03-20 15:45 +0000

csiph-web