Groups | Search | Server Info | Login | Register

Groups > rocksolid.shared.tor > #74

Re: Very good research on detection of hidden services

Show all headers | View raw

[Multipart message — attachments visible in raw view] - view raw

new version 0.16 attached. changes:
-some bug were fixed (yes, even in these few lines, if you can believe it)
-speed improvement by adding seeds
-speed improvement by biasing the random choice of the address to retrieve towards hosts that have been found up previously
-gives out agglomerated results in one file for later processing
-gives out status reports to log file
-analysis of links found per host:
1) all links that point to the same host (internal links)
2) all links that point to other onion addresses
3) links from other pages that point to the host

Unfortunately, these numbers are not very accurate fo rnow due to several factors, and are vastly different in particular cases (mostly false negative, so links are not found).
However, high numbers found help to identify:
-sites with a lot of content
-sites with a lot of links
-sites that are known by many

In later versions I will probably use this to prioritize the crawling even more.

To analyze the tor network efficiently the well known sites would also make good starting points.

Stats from a current run: 
onion addresses found: 8590
hosts confirmed up: 1687
hosts appearing down: 1894
to check: 5009

Back to rocksolid.shared.tor | Previous | Next — Previous in thread | Next in thread | Find similar

Thread

Very good research on detection of hidden services Anonymous <poster@anon.com> - 2021-03-29 09:19 -0700
  Re: Very good research on detection of hidden services Retro Guy <retroguy@novabbs.com> - 2021-03-29 22:42 -0700
  Re: Very good research on detection of hidden services Anonymous <poster@anon.com> - 2021-04-03 06:30 -0700
  Re: Very good research on detection of hidden services Anonymous <poster@anon.com> - 2021-04-04 08:57 -0700
  Re: Very good research on detection of hidden services Anonymous <poster@anon.com> - 2021-04-04 09:01 -0700
  Re: Very good research on detection of hidden services Anonymous <poster@anon.com> - 2021-04-04 13:44 -0700
    Re: Very good research on detection of hidden services Retro Guy <retroguy@novabbs.com> - 2021-04-04 23:54 -0700
  Re: Very good research on detection of hidden services Anonymous <poster@anon.com> - 2021-04-05 03:52 -0700
  Re: Very good research on detection of hidden services Anonymous <poster@anon.com> - 2021-04-05 08:12 -0700
  Re: Very good research on detection of hidden services Anonymous <poster@anon.com> - 2021-04-06 13:28 -0700
  Final stats and address list Anonymous <poster@anon.com> - 2021-04-17 12:22 -0700
    Re: Final stats and address list Anonymous@news.novabbs.org (Anonymous) - 2021-04-18 00:52 +0000
  None Anonymous <poster@anon.com> - 2021-04-18 04:51 -0700

csiph-web