Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > linux.debian.user > #219476

Re: new, not nice web bots disposal

From Dan Ritter <dsr@randomstring.org>
Newsgroups linux.debian.user
Subject Re: new, not nice web bots disposal
Date 2020-02-26 15:30 +0100
Message-ID <zE5Rf-880-5@gated-at.bofh.it> (permalink)
References <zE0HT-3Z7-3@gated-at.bofh.it> <zE11f-4mK-1@gated-at.bofh.it> <zE5xT-81m-1@gated-at.bofh.it>
Organization linux.* mail to news gateway

Show all headers | View raw


Gene Heskett wrote: 
> On Wednesday 26 February 2020 04:05:53 john doe wrote:
> 
> > On 2/26/2020 9:57 AM, Gene Heskett wrote:
> > > Be my guest folks, reclaim the net, we are paying for the bandwidth
> > > these jerks are burning up.
> >
> > The above is the way the OP has choosen to go about it but configuring
> > apache properly using fail2ban in addition of the robot.txt file.
> > should also be considered
> 
> That was also suggested and tried, for about a week, but there were no 
> failures to initiate the ban from. So I got out a bigger hammer.  This 

While fail2ban comes with a bunch of recognizers, it's fairly
easy to customize it -- anything that generates a log file with
an IP address and some condition that you can pick up with a
regex is fair game.

> What I fail to understand is why the universal reticence on the part of 
> all the knowitalls here to use the almost 20 year old tools given us to 
> control these jerks? Particularly when it looks like its the only tool 
> that actually and effectively works.

In this case of this knowitall, it's because I've used those
tools, written my own -- just like you -- and I have come to
appreciate the value of sharing tools -- just like you -- so
when I see that lots of people recommend a tool, I find some
value in seeing if it's right for me.

If someone went to the bother of packaging it for Debian, and
other people say it's a good tool -- maybe it is. And maybe 
they are wrong. And it could certainly not be the right tool
for me, or for you, in this particular circumstance.

-dsr-

Back to linux.debian.user | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread


Thread

new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-26 10:00 +0100
  Re: new, not nice web bots disposal john doe <johndoe65534@mail.com> - 2020-02-26 10:20 +0100
    Re: new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-26 15:10 +0100
      Re: new, not nice web bots disposal Dan Ritter <dsr@randomstring.org> - 2020-02-26 15:30 +0100
  Re: new, not nice web bots disposal Jonas Smedegaard <jonas@jones.dk> - 2020-02-26 10:30 +0100
    Re: new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-26 15:20 +0100
  Re: new, not nice web bots disposal Dan Ritter <dsr@randomstring.org> - 2020-02-26 12:20 +0100
    Re: new, not nice web bots disposal Roger Price <debian@rogerprice.org> - 2020-02-26 12:50 +0100
      Re: new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-26 15:30 +0100
      Re: new, not nice web bots disposal Klaus Singvogel <deb-user-ml@singvogel.net> - 2020-02-26 15:30 +0100
  Re: new, not nice web bots disposal Greg Wooledge <wooledg@eeg.ccf.org> - 2020-02-26 14:30 +0100
    Re: new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-26 15:50 +0100
      Re: new, not nice web bots disposal Roger Price <debian@rogerprice.org> - 2020-02-26 16:50 +0100
        Re: new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-26 20:10 +0100
  Re: new, not nice web bots disposal Lee <ler762@gmail.com> - 2020-02-26 20:00 +0100
    Re: new, not nice web bots disposal Reco <recoverym4n@enotuniq.net> - 2020-02-26 20:00 +0100
      Re: new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-26 20:20 +0100
        Re: new, not nice web bots disposal Reco <recoverym4n@enotuniq.net> - 2020-02-26 20:30 +0100
          Re: new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-26 20:50 +0100
      Re: new, not nice web bots disposal <tomas@tuxteam.de> - 2020-02-26 22:10 +0100
        Re: new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-26 22:50 +0100
          Re: new, not nice web bots disposal Lee <ler762@gmail.com> - 2020-02-27 05:30 +0100
            Re: new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-27 06:10 +0100
              Re: new, not nice web bots disposal <tomas@tuxteam.de> - 2020-02-27 10:00 +0100
                Re: new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-27 14:30 +0100
                Re: new, not nice web bots disposal <tomas@tuxteam.de> - 2020-02-27 15:20 +0100
                Re: new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-27 15:40 +0100
                Re: new, not nice web bots disposal <tomas@tuxteam.de> - 2020-02-27 16:00 +0100
                Re: new, not nice web bots disposal Dan Ritter <dsr@randomstring.org> - 2020-02-27 16:20 +0100
                OT: LIbrarian (was: Re: new, not nice web bots disposal) rhkramer@gmail.com - 2020-02-27 16:40 +0100
            Re: new, not nice web bots disposal <tomas@tuxteam.de> - 2020-02-27 10:00 +0100
              Re: new, not nice web bots disposal Lee <ler762@gmail.com> - 2020-02-27 16:10 +0100
                Re: new, not nice web bots disposal tomas@tuxteam.de - 2020-02-27 16:20 +0100
                Re: new, not nice web bots disposal Lee <ler762@gmail.com> - 2020-02-27 16:40 +0100
                Re: new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-27 19:40 +0100
          Re: new, not nice web bots disposal <tomas@tuxteam.de> - 2020-02-27 10:00 +0100
            Re: new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-27 14:20 +0100
              Re: new, not nice web bots disposal <tomas@tuxteam.de> - 2020-02-27 15:20 +0100
              Re: new, not nice web bots disposal songbird <songbird@anthive.com> - 2020-02-28 06:20 +0100
    Re: new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-26 20:20 +0100
      Re: new, not nice web bots disposal Lee <ler762@gmail.com> - 2020-02-26 20:50 +0100
  Re: new, not nice web bots disposal deloptes <deloptes@gmail.com> - 2020-02-26 21:00 +0100
    Re: new, not nice web bots disposal Gene Heskett <gheskett@shentel.net> - 2020-02-26 22:30 +0100

csiph-web