Path: csiph.com!news.uzoreto.com!i2pn.org!rocksolid2!.POSTED.127.166.132.178!not-for-mail From: Anonymous Newsgroups: rocksolid.shared.tor Subject: None Date: Sun, 18 Apr 2021 04:51:21 -0700 Organization: rocksolid2 (novabbs.org) Message-ID: References: Content-Type: text/plain; charset=UTF-8 Injection-Info: novabbs.org; posting-account="def2"; posting-host="127.166.132.178"; logging-data="21434"; mail-complaints-to="usenet@novabbs.org" Xref: csiph.com rocksolid.shared.tor:100 >>23e71008f4848d7f0c >pull the title from each site and add it to the file. yes, i had something similar in place (link analysis)- > Is this something easy to do when making the list in the first place, or is doing it after the first run better? i would say it is slightly faster to do it right away, but it is easy enough to do after as well. The easiest is probably to get the page source and then parse it with regular expressions. Like this: lynx -source http://kyue3hfjhqxj3df4hox46itdyz7euah457ldtg4d23evfggumxw4rkid.onion/u/ | gawk -v IGNORECASE=1 -v RS=']*>/,"");print;exit}' -- Posted on def2