Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]
| From | Ivan Shmakov <ivan@siamics.net> |
|---|---|
| Newsgroups | comp.misc |
| Subject | digital hoarding |
| Date | 2019-01-15 18:25 +0000 |
| Organization | Aioe.org NNTP Server |
| Message-ID | <87a7k16amv.fsf_-_@violet.siamics.net> (permalink) |
| References | <0fmsgf-h6d.ln1@rasp.therandymon.com> <ga22o7F4s9qU9@mid.individual.net> <q1gme1$ci8$1@solani.org> |
>>>>> RS Wood <rsw@therandymon.com> writes:
[...]
> Not a digital hoarder, but I like hanging onto stuff I'm not sure
> will be around the next time I search for it.
My first Internet link at home was via a V.32bis modem, paid
per-minute, so it made every sense to batch-download items of
interest for offline reading. Some of the local ISPs had reduced
nighttime rates as well, making it all the more practical.
Although I've moved to "broadband" (128 kbit/s at first, I
think) when it become affordable around here c. 2007, and the
data rate available to me has increased considerably (but then,
so is the disk space), the old habit remains.
So, for me, the question is not whether to "hoard" or not, but
how to contribute back to the effort of distributing whatever
information I find valuable. So far, BitTorrent seems the best
option. For instance, over the last 26 days, my BitTorrent
agent served 34.5 GiB of data of 19 GiB worth of collections
(mainly from http://remix.kwed.org/ and http://modarchive.org/)
currently available at my home system.
Were such torrents available, I would've considered joining ones
for http://commons.wikimedia.org/, http://scene.org/, and Debian
"pool." (Though I guess I can still get the latter via Devuan.
Also, I see that Internet Archive also makes .torrent files
available, but I haven't investigated that option as of yet.)
When it comes to Web, I've found that Lynx first saves everything
it downloads into its "disk" cache, implemented as a temporary
per-process directory, from where I can Rsync it (see below)
to a more "persistent" location whenever I feel needed. An
agent-independent solution would be to use a caching HTTP proxy,
yet the proliferation of "HTTPS for everything" made that
somewhat infeasible. (No-HTTPS code notwithstanding.)
$ rsync -cb -rOtH --suffix=.~"$(date +%s)"~ \
-- /tmp/lynxXXXX?????? ~/private/hist/lynx/
For Usenet, my idea was, similarly, to implement an NNTP proxy,
which would transparently cache (or archive) data retrieved from
the upstream (such as the responses to, first and foremost, the
ARTICLE, HEAD and BODY commands; but also likely LIST and XOVER.)
I'm yet to get to that point, though. For now, I use a
dedicated archiver (5677 newsgroups from nntp://nntp.aioe.org/,
including all the comp /except/ c.o.l.advocacy and c.binaries.cbm),
and given that it uses a custom format that still requires some
work (and also that the archiver does not currently honor
X-No-Archive:), I'm rather reluctant to make my Usenet archives
available to the wider audience.
--
FSF associate member #7257 http://am-1.org/~ivan/
Back to comp.misc | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread
wipe and reinstall RS Wood <rsw@therandymon.com> - 2019-01-13 16:16 -0500
Re: wipe and reinstall Bob Eager <news0073@eager.cx> - 2019-01-14 00:17 +0000
Re: wipe and reinstall RS Wood <rsw@therandymon.com> - 2019-01-14 00:51 +0000
Re: wipe and reinstall Dan Espen <dan1espen@gmail.com> - 2019-01-13 22:08 -0500
Re: wipe and reinstall Bob Eager <news0073@eager.cx> - 2019-01-14 09:24 +0000
Re: wipe and reinstall RS Wood <rsw@therandymon.com> - 2019-01-17 18:44 +0300
Re: wipe and reinstall Dan Espen <dan1espen@gmail.com> - 2019-01-17 11:19 -0500
Re: wipe and reinstall Rich <rich@example.invalid> - 2019-01-17 17:09 +0000
Re: wipe and reinstall Kerry Imming <kcimming@pobox.com> - 2019-01-14 11:52 -0600
digital hoarding Ivan Shmakov <ivan@siamics.net> - 2019-01-15 18:25 +0000
Re: digital hoarding Eli the Bearded <*@eli.users.panix.com> - 2019-01-15 19:32 +0000
Re: digital hoarding Ivan Shmakov <ivan@siamics.net> - 2019-01-15 19:57 +0000
Re: digital hoarding Eli the Bearded <*@eli.users.panix.com> - 2019-01-15 20:05 +0000
Re: digital hoarding Ivan Shmakov <ivan@siamics.net> - 2019-01-15 20:20 +0000
Re: digital hoarding not@telling.you.invalid (Computer Nerd Kev) - 2019-01-15 22:25 +0000
Re: digital hoarding Eli the Bearded <*@eli.users.panix.com> - 2019-01-15 22:45 +0000
Re: digital hoarding Computer Nerd Kev <not@telling.you.invalid> - 2019-01-16 04:03 +0000
Re: digital hoarding Eli the Bearded <*@eli.users.panix.com> - 2019-01-16 22:15 +0000
Re: digital hoarding not@telling.you.invalid (Computer Nerd Kev) - 2019-01-17 22:11 +0000
Re: digital hoarding Eli the Bearded <*@eli.users.panix.com> - 2019-01-17 22:54 +0000
Re: digital hoarding Eric Pozharski <whynot@pozharski.name> - 2019-01-18 15:32 +0200
Re: digital hoarding Mike Spencer <mds@bogus.nodomain.nowhere> - 2019-01-18 01:56 -0400
Re: digital hoarding Computer Nerd Kev <not@telling.you.invalid> - 2019-01-26 07:35 +0000
Re: digital hoarding Eli the Bearded <*@eli.users.panix.com> - 2019-01-28 05:10 +0000
Re: wipe and reinstall "Dirk T. Verbeek" <dverbeek@xs4all.nl> - 2019-01-14 11:36 +0100
Re: wipe and reinstall "Pascal J. Bourguignon" <pjb@informatimago.com> - 2019-01-14 12:07 +0100
Re: wipe and reinstall Huge <Huge@nowhere.much.invalid> - 2019-01-14 13:01 +0000
Re: wipe and reinstall Dan Purgert <dan@djph.net> - 2019-01-14 15:32 +0000
Re: wipe and reinstall Huge <Huge@nowhere.much.invalid> - 2019-01-14 15:36 +0000
Re: wipe and reinstall "Pascal J. Bourguignon" <pjb@informatimago.com> - 2019-01-15 10:22 +0100
Re: wipe and reinstall Huge <Huge@nowhere.much.invalid> - 2019-01-15 09:47 +0000
Re: wipe and reinstall "Pascal J. Bourguignon" <pjb@informatimago.com> - 2019-01-15 11:13 +0100
Re: wipe and reinstall Eli the Bearded <*@eli.users.panix.com> - 2019-01-15 19:42 +0000
Re: wipe and reinstall Richard Kettlewell <invalid@invalid.invalid> - 2019-01-14 11:31 +0000
Re: wipe and reinstall scott@alfter.diespammersdie.us (Scott Alfter) - 2019-01-14 21:52 +0000
Re: wipe and reinstall gazelle@shell.xmission.com (Kenny McCormack) - 2019-01-15 00:33 +0000
Re: wipe and reinstall Dan Purgert <dan@djph.net> - 2019-01-14 12:23 +0000
Re: wipe and reinstall kludge@panix.com (Scott Dorsey) - 2019-01-14 17:21 -0500
Re: wipe and reinstall J <invalid@invalid.invalid> - 2019-01-16 12:55 +0000
Re: wipe and reinstall Huge <Huge@nowhere.much.invalid> - 2019-01-16 14:24 +0000
Re: wipe and reinstall Sylvia Else <sylvia@email.invalid> - 2019-01-17 12:55 +1100
csiph-web