Groups > linux.debian.user > #219496

Re: new, not nice web bots disposal

From	Gene Heskett <gheskett@shentel.net>
Newsgroups	linux.debian.user
Subject	Re: new, not nice web bots disposal
Date	2020-02-26 20:50 +0100
Message-ID	<zEaQV-2Fg-3@gated-at.bofh.it> (permalink)
References	<zE0HT-3Z7-3@gated-at.bofh.it> <zEanT-2vz-3@gated-at.bofh.it> <zEaxz-2yO-3@gated-at.bofh.it>
Organization	none,nada,zip

Show all headers | View raw

On Wednesday 26 February 2020 14:21:31 Reco wrote:

> On Wed, Feb 26, 2020 at 02:15:18PM -0500, Gene Heskett wrote:
> > On Wednesday 26 February 2020 13:54:09 Reco wrote:
> > > 	Hi.
> > >
> > > On Wed, Feb 26, 2020 at 01:50:40PM -0500, Lee wrote:
> > > > On 2/26/20, Gene Heskett <gheskett@shentel.net> wrote:
> > > > > over the last 90 days or so, we seem to have been plauged with
> > > > > a new breed of bots scanning our web pages, and they are not
> > > > > just indexing our web pages I don't mind that, but they are
> > > > > ignoring our robots.txt and are  mirroring anything apache2
> > > > > can reach, including stuff thats there but not reachable by a
> > > > > normal browser just looking around and clicking on links.
> > > >
> > > >   <.. snip ..>
> > > >
> > > > > To add a new rule, covering that whole 256 address block
> > > > > because they seem to have a random address, changed about
> > > > > weekly, in that block:
> > > > >
> > > > > root@coyote:iptables$ cat iptables-add
> > > > >
> > > > > #!/bin/bash
> > > > > iptables -I INPUT -s add.ress.to.block/24 -j DROP
> > > >
> > > > Have you considered REJECT instead of DROP?
> > >
> > > A neat idea for your LAN. A bad idea in this case.
> > >
> > > You *want* that other side to retry, wasting their time instead of
> > > spamming their target. In fact, one should consider using TARPIT
> > > instead of a DROP here.
> >
> > Now thats a thought, does it take much fiddling to set that up? 
> > Links to tuts plz.
>
> You have to use testing or sid for that. [1] is a place to start,
> [2] will be needed too.
>
> [1] https://packages.debian.org/bullseye/xtables-addons-dkms
> [2] https://packages.debian.org/bullseye/xtables-addons-common
>
> Reco

Ahh, and I'm still on stretch, 9-11 so I'll have to start by upgrading to 
buster.  Is there a recipe for that, its about time and I am beginning 
to like what I see of buster on an rpi4b. I've been dragging my feet 
waiting for the linuxcnc guys to spin a buster install iso, but lots of 
python stuff has disappeared, making it very difficult to make all its 
toys work on buster. If my results of building it on buster are any 
indication, there's likely 20+ python libraries we'll have to assume 
support for just for x86 stuffs.

My machines that are running machines don't have near as much 
gingerbready stuff installed, so they will be easier than this one to 
update.  And the rest are still on wheezy. But I'm not too worried, I've 
got dd-wrt between me and the black hat crowd.

All the other tarpit thingies I've looked at take more work than I've 
time to play setting them up.

Cheers, Gene Heskett
-- 
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
If we desire respect for the law, we must first make the law respectable.
 - Louis D. Brandeis
Genes Web page <http://geneslinuxbox.net:6309/gene>

Thread

new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-26 10:00 +0100
  Re: new, not nice web bots disposal john doe <johndoe65534@mail.com> - 2020-02-26 10:20 +0100
    Re: new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-26 15:10 +0100
      Re: new, not nice web bots disposal Dan Ritter <dsr@randomstring.org> - 2020-02-26 15:30 +0100
  Re: new, not nice web bots disposal Jonas Smedegaard <jonas@jones.dk> - 2020-02-26 10:30 +0100
    Re: new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-26 15:20 +0100
  Re: new, not nice web bots disposal Dan Ritter <dsr@randomstring.org> - 2020-02-26 12:20 +0100
    Re: new, not nice web bots disposal Roger Price <debian@rogerprice.org> - 2020-02-26 12:50 +0100
      Re: new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-26 15:30 +0100
      Re: new, not nice web bots disposal Klaus Singvogel <deb-user-ml@singvogel.net> - 2020-02-26 15:30 +0100
  Re: new, not nice web bots disposal Greg Wooledge <wooledg@eeg.ccf.org> - 2020-02-26 14:30 +0100
    Re: new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-26 15:50 +0100
      Re: new, not nice web bots disposal Roger Price <debian@rogerprice.org> - 2020-02-26 16:50 +0100
        Re: new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-26 20:10 +0100
  Re: new, not nice web bots disposal Lee <ler762@gmail.com> - 2020-02-26 20:00 +0100
    Re: new, not nice web bots disposal Reco <recoverym4n@enotuniq.net> - 2020-02-26 20:00 +0100
      Re: new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-26 20:20 +0100
        Re: new, not nice web bots disposal Reco <recoverym4n@enotuniq.net> - 2020-02-26 20:30 +0100
          Re: new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-26 20:50 +0100
      Re: new, not nice web bots disposal <tomas@tuxteam.de> - 2020-02-26 22:10 +0100
        Re: new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-26 22:50 +0100
          Re: new, not nice web bots disposal Lee <ler762@gmail.com> - 2020-02-27 05:30 +0100
            Re: new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-27 06:10 +0100
              Re: new, not nice web bots disposal <tomas@tuxteam.de> - 2020-02-27 10:00 +0100
                Re: new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-27 14:30 +0100
                Re: new, not nice web bots disposal <tomas@tuxteam.de> - 2020-02-27 15:20 +0100
                Re: new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-27 15:40 +0100
                Re: new, not nice web bots disposal <tomas@tuxteam.de> - 2020-02-27 16:00 +0100
                Re: new, not nice web bots disposal Dan Ritter <dsr@randomstring.org> - 2020-02-27 16:20 +0100
                OT: LIbrarian (was: Re: new, not nice web bots disposal) rhkramer@gmail.com - 2020-02-27 16:40 +0100
            Re: new, not nice web bots disposal <tomas@tuxteam.de> - 2020-02-27 10:00 +0100
              Re: new, not nice web bots disposal Lee <ler762@gmail.com> - 2020-02-27 16:10 +0100
                Re: new, not nice web bots disposal tomas@tuxteam.de - 2020-02-27 16:20 +0100
                Re: new, not nice web bots disposal Lee <ler762@gmail.com> - 2020-02-27 16:40 +0100
                Re: new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-27 19:40 +0100
          Re: new, not nice web bots disposal <tomas@tuxteam.de> - 2020-02-27 10:00 +0100
            Re: new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-27 14:20 +0100
              Re: new, not nice web bots disposal <tomas@tuxteam.de> - 2020-02-27 15:20 +0100
              Re: new, not nice web bots disposal songbird <songbird@anthive.com> - 2020-02-28 06:20 +0100
    Re: new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-26 20:20 +0100
      Re: new, not nice web bots disposal Lee <ler762@gmail.com> - 2020-02-26 20:50 +0100
  Re: new, not nice web bots disposal deloptes <deloptes@gmail.com> - 2020-02-26 21:00 +0100
    Re: new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-26 22:30 +0100

csiph-web