Groups > comp.lang.java.programmer > #6269

Re: Looking for Java web crawler api

From	iadb <freeinternetarticles@gmail.com>
Newsgroups	comp.lang.java.programmer
Subject	Re: Looking for Java web crawler api
Date	2011-07-18 16:06 -0700
Organization	http://groups.google.com
Message-ID	<77c82369-26e7-40ca-aa96-d919cf1a6263@a11g2000yqm.googlegroups.com> (permalink)
References	<4e1bf464$0$314$14726298@news.sunsite.dk>

Show all headers | View raw

On Jul 12, 3:14 am, pm <el_dura...@yah00.c0m> wrote:
> Hello, I am working on a project that requires me to do custom search on
> different websites.  I am using Java and while I can write this from
> ground up, I am looking at using existing APIs that can be used due to
> time limit.  So far I have came across Apache's HttpClient.  
>         I am wondering if there are any others that can be effective or
> give more options for web searching/scraping. I plan to create a GUI
> based application and need something quick and effective while not being
> too complex.
> I appreciate any feedback.

Look at the attached example, it works fine with little
customization..
http://java.sun.com/developer/technicalArticles/ThirdParty/WebCrawler/


http://www.internetarticlesdb.com

Back to comp.lang.java.programmer | Previous | Next — Previous in thread | Next in thread | Find similar

Thread

Looking for Java web crawler api pm <el_durango@yah00.c0m> - 2011-07-12 07:14 +0000
  Re: Looking for Java web crawler api Bent C Dalager <bcd@pvv.ntnu.no> - 2011-07-12 09:44 +0000
    Re: Looking for Java web crawler api Durango2011 <el_durango@yah00.c0m> - 2011-07-13 06:12 +0000
  Re: Looking for Java web crawler api Roedy Green <see_website@mindprod.com.invalid> - 2011-07-14 12:52 -0700
  Re: Looking for Java web crawler api iadb <freeinternetarticles@gmail.com> - 2011-07-18 16:06 -0700
  Re: Looking for Java web crawler api Durango2011 <el_durango@yah00.c0m> - 2011-07-21 05:49 +0000
  Re: Looking for Java web crawler api Arne Vajhøj <arne@vajhoej.dk> - 2011-07-21 17:10 -0400

csiph-web