Re: bad bot behavior

Message-ID	<67e477e8@news.ausics.net> (permalink)
From	not@telling.you.invalid (Computer Nerd Kev)
Subject	Re: bad bot behavior
Newsgroups	comp.misc
References	(1 earlier) <vrc8qm$2tkq5$1@dont-email.me> <20250318182006.00006ae3@dne3.net> <slrnvtlcpl.41d.${send-direct-email-to-news1021-at-jusme-dot-com-if@vm46.home.jusme.com> <slrnvu06im.2o4dt.candycanearter07@candydeb.host.invalid> <vs0vvs$1s4mh$1@dont-email.me>
Date	2025-03-27 07:55 +1000
Organization	Ausics - https://newsgroups.ausics.net

Show all headers | View raw

D Finnigan <dog_cow@macgui.com> wrote:
> https://tech.slashdot.org/story/25/03/26/016244/open-source-devs-say-ai-crawlers-dominate-traffic-forcing-blocks-on-entire-countries
> 
> They're abusing everyone. If you have a web site, don't allow it to be 
> abused this way.

On the other hand I run websites on the cheapest VPSs available and
they have no load problem without any robots.txt rules to block
bots let alone active blocking. Yet solutions like the "Anubis"
proof-of-work thing mentioned in the link will require Javascript
which blocks the JS-less web browsers I like to use for browsing
other people's websites (and FF with NoScript too unless I decide
to allow the random JS).

So basically those websites are making their slow code on the
server _my_ problem by forcing me to do bot-tests which I fail
(sometimes in Firefox even with NoScript disabled too!).

Don't abuse _users_ that way, just to block bots from your
too-slow website!

-- 
__          __
#_ < |\| |< _#

Back to comp.misc | Previous | Next — Previous in thread | Next in thread | Find similar

Thread

bad bot behavior Ben Collver <bencollver@tilde.pink> - 2025-03-18 15:17 +0000
  Re: bad bot behavior D Finnigan <dog_cow@macgui.com> - 2025-03-18 12:00 -0500
    Re: bad bot behavior not@telling.you.invalid (Computer Nerd Kev) - 2025-03-19 08:19 +1000
    Re: bad bot behavior Toaster <toaster@dne3.net> - 2025-03-18 18:20 -0400
      Re: bad bot behavior Ian <${send-direct-email-to-news1021-at-jusme-dot-com-if-you-must}@jusme.com> - 2025-03-19 12:06 +0000
        Re: bad bot behavior Rich <rich@example.invalid> - 2025-03-19 16:59 +0000
          Re: bad bot behavior candycanearter07 <candycanearter07@candycanearter07.nomail.afraid> - 2025-03-23 14:30 +0000
        Re: bad bot behavior Lawrence D'Oliveiro <ldo@nz.invalid> - 2025-03-20 02:22 +0000
          Re: bad bot behavior Ian <${send-direct-email-to-news1021-at-jusme-dot-com-if-you-must}@jusme.com> - 2025-03-20 08:33 +0000
            Re: bad bot behavior Toaster <toaster@dne3.net> - 2025-03-20 19:01 -0400
            Re: bad bot behavior Lawrence D'Oliveiro <ldo@nz.invalid> - 2025-03-21 08:05 +0000
              Re: bad bot behavior Ian <${send-direct-email-to-news1021-at-jusme-dot-com-if-you-must}@jusme.com> - 2025-03-21 08:42 +0000
        Re: bad bot behavior candycanearter07 <candycanearter07@candycanearter07.nomail.afraid> - 2025-03-23 14:30 +0000
          Re: bad bot behavior D Finnigan <dog_cow@macgui.com> - 2025-03-26 08:38 -0500
            Re: bad bot behavior candycanearter07 <candycanearter07@candycanearter07.nomail.afraid> - 2025-03-26 17:00 +0000
            Re: bad bot behavior not@telling.you.invalid (Computer Nerd Kev) - 2025-03-27 07:55 +1000
        Re: bad bot behavior anthk <anthk@openbsd.home> - 2025-05-12 06:24 +0000
      Re: bad bot behavior anthk <anthk@openbsd.home> - 2025-05-12 06:24 +0000

csiph-web