Path: csiph.com!eternal-september.org!feeder3.eternal-september.org!news.eternal-september.org!eternal-september.org!.POSTED!not-for-mail From: candycanearter07 Newsgroups: comp.misc Subject: Re: bad bot behavior Date: Sun, 23 Mar 2025 14:30:04 -0000 (UTC) Organization: the-candyden-of-code Lines: 18 Message-ID: References: <20250318182006.00006ae3@dne3.net> Injection-Date: Sun, 23 Mar 2025 15:30:05 +0100 (CET) Injection-Info: dont-email.me; posting-host="f93b1c05508c8a8dc1c72008084bccc1"; logging-data="2701582"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1+PIKMv73r/rEL41fV1baEpgSSpuXqIJqo1QV8lm1R15g==" User-Agent: slrn/1.0.3 (Linux) Cancel-Lock: sha1:f0VV96xewQ1JHIla1ghIsajHIMQ= X-Face: b{dPmN&%4|lEo,wUO\"KLEOu5N_br(N2Yuc5/qcR5i>9-!^e\.Tw9?/m0}/~:UOM:Zf]% b+ V4R8q|QiU/R8\|G\WpC`-s?=)\fbtNc&=/a3a)r7xbRI]Vl)r<%PTriJ3pGpl_/B6!8pe\btzx `~R! r3.0#lHRE+^Gro0[cjsban'vZ#j7,?I/tHk{s=TFJ:H?~=]`O*~3ZX`qik`b:.gVIc-[$t/e ZrQsWJ >|l^I_[pbsIqwoz.WGA] wrote at 12:06 this Wednesday (GMT): > On 2025-03-18, Toaster wrote: >> >> But what can be done to mitigate this issue? Crawlers and bots ruin the >> internet. > > #mode=evil > > How about a script that spews out an endless stream of junk from > /usr/share/dict/words, parked on a random URL that's listed in > robots.txt as forbidden. Any bot choosing to chew on that gets what > it deserves, though you might need to bandwidth limit it. I heard Cloudflare is doing something like that, but ironically with their own generative AI.. -- user is generated from /dev/urandom