Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]
Groups > comp.lang.java.programmer > #21954
| From | Roedy Green <see_website@mindprod.com.invalid> |
|---|---|
| Newsgroups | comp.programming, comp.lang.java.programmer, alt.hacker |
| Subject | Re: security quirk |
| Date | 2013-02-01 05:11 -0800 |
| Organization | Canadian Mind Products |
| Message-ID | <lffng89fvr74fulvo98lqd0hhu9tkl8spr@4ax.com> (permalink) |
| References | <b968c6c6-5aa9-4584-bd7a-5b097f17c54d@pu9g2000pbc.googlegroups.com> <XnsA15843BB95369gandalfparker@78.46.70.116> <badd4188-196b-45e3-ba8a-511d471282fa@nh8g2000pbc.googlegroups.com> <XnsA1593E485EC8Egandalfparker@46.4.102.18> |
Cross-posted to 3 groups.
On Thu, 31 Jan 2013 14:07:21 +0000 (UTC), Gandalf Parker <gandalf@the.dead.ISP.of.Community.net> wrote, quoted or indirectly quoted someone who said : >The site creates web pages. >Google collects web pages. >The site needs to set things like robot.txt to tell Google to NOT collect >the pages in the archives. Which is not an absolute protection but at least >its an effort that works for most sites. To the site, Google is just a voracious reader. If they block readers from hoovering up content, that automatically stops Google. The site owners wanted Google to spider the site, bring in customers, then hit them with a fee. They forgot that anyone coming in directly via Google's links would bypass their own search engine. -- Roedy Green Canadian Mind Products http://mindprod.com The first 90% of the code accounts for the first 90% of the development time. The remaining 10% of the code accounts for the other 90% of the development time. ~ Tom Cargill Ninety-ninety Law
Back to comp.lang.java.programmer | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread
security quirk RichD <r_delaney2001@yahoo.com> - 2013-01-29 20:55 -0800
Re: security quirk Roedy Green <see_website@mindprod.com.invalid> - 2013-01-30 01:55 -0800
Re: security quirk Martin Musatov <marty.musatov@gmail.com> - 2013-01-30 06:37 -0800
Re: security quirk "Auric__" <not.my.real@email.address> - 2013-01-30 22:40 +0000
Re: security quirk Gandalf Parker <gandalf@the.dead.ISP.of.Community.net> - 2013-01-30 14:39 +0000
Re: security quirk RichD <r_delaney2001@yahoo.com> - 2013-01-30 11:39 -0800
Re: security quirk alex23 <wuwei23@gmail.com> - 2013-01-30 17:16 -0800
Re: security quirk Roedy Green <see_website@mindprod.com.invalid> - 2013-01-31 04:20 -0800
Re: security quirk Gandalf Parker <gandalf@the.dead.ISP.of.Community.net> - 2013-01-31 14:07 +0000
Re: security quirk Roedy Green <see_website@mindprod.com.invalid> - 2013-02-01 05:11 -0800
Re: security quirk Big Bad Bob <BigBadBob-at-mrp3-dot-com@testing.local> - 2013-01-30 11:59 -0800
Re: security quirk Arne Vajhøj <arne@vajhoej.dk> - 2013-01-30 20:40 -0500
csiph-web