Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.lang.php > #7241

Re: problem with link checker

From "M. Strobel" <sorry_no_mail_here@nowhere.dee>
Newsgroups comp.lang.php
Subject Re: problem with link checker
Date 2012-10-03 13:34 +0200
Message-ID <ad2m5mFgrdlU1@mid.uni-berlin.de> (permalink)
References <4195aa64-6c81-4976-9665-73eab30b36f3@googlegroups.com>

Show all headers | View raw


Am 03.10.2012 11:46, schrieb Helmut:
> Hello,
> I have written a php script whose function is to detect dead links on 
> a website.
> unfortunately,(obviously) my ISP  redirects invalid urls (or part of them) to a search site, so I get status 302 instead of 404.
> Even worse, in one case an invalid url (http://www.ajrccm.com)
> is also redirected to a search site (I don't know by whom) and I get
> the status 200 !
> Any idea how to solve this problem?
> 
> thanx for your help, Helmut
> 

1. Find a name server that does not spam DNS, see terminal log below.
2. on Linux I would not hesitate to install bind9, it's a one liner

/Str.
#
# host not found, okay
#
strobel@s114-intel:~> ping nonono.deee
ping: unknown host nonono.deee
#
# dig @ google nameserver, not found, okay
#
strobel@s114-intel:~> dig nonono.deee @8.8.8.8

; <<>> DiG 9.7.6-P3 <<>> nonono.deee @8.8.8.8
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NXDOMAIN, id: 14380
;; flags: qr rd ra; QUERY: 1, ANSWER: 0, AUTHORITY: 1, ADDITIONAL: 0

;; QUESTION SECTION:
;nonono.deee.                   IN      A

;; AUTHORITY SECTION:
.                       1800    IN      SOA     a.root-servers.net.
nstld.verisign-grs.com. 2012100300 1800 900 604800 86400

;; Query time: 92 msec
;; SERVER: 8.8.8.8#53(8.8.8.8)
;; WHEN: Wed Oct  3 13:27:20 2012
;; MSG SIZE  rcvd: 104

#
# dig @ dnsadvantage, Spam!
#
strobel@s114-intel:~> dig nonono.deee @156.154.70.1

; <<>> DiG 9.7.6-P3 <<>> nonono.deee @156.154.70.1
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 644
;; flags: qr rd ra; QUERY: 1, ANSWER: 1, AUTHORITY: 0, ADDITIONAL: 0

;; QUESTION SECTION:
;nonono.deee.                   IN      A

;; ANSWER SECTION:
nonono.deee.            600     IN      A       92.242.144.2

;; Query time: 66 msec
;; SERVER: 156.154.70.1#53(156.154.70.1)
;; WHEN: Wed Oct  3 13:27:52 2012
;; MSG SIZE  rcvd: 56

strobel@s114-intel:~>

Back to comp.lang.php | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread


Thread

problem with link checker Helmut <helmut_blass@web.de> - 2012-10-03 02:46 -0700
  Re: problem with link checker Captain Paralytic <paul_lautman@yahoo.com> - 2012-10-03 02:48 -0700
    Re: problem with link checker Jerry Stuckle <jstucklex@attglobal.net> - 2012-10-03 11:20 -0400
  Re: problem with link checker "M. Strobel" <sorry_no_mail_here@nowhere.dee> - 2012-10-03 13:34 +0200
    Re: problem with link checker Jerry Stuckle <jstucklex@attglobal.net> - 2012-10-03 11:21 -0400
  Re: problem with link checker Martin Leese <please@see.Web.for.e-mail.INVALID> - 2012-10-03 08:07 -0600

csiph-web