Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.lang.java.programmer > #6103

Looking for Java web crawler api

Path csiph.com!x330-a1.tempe.blueboxinc.net!usenet.pasdenom.info!weretis.net!feeder4.news.weretis.net!nuzba.szn.dk!news.szn.dk!pnx.dk!dotsrc.org!filter.dotsrc.org!news.dotsrc.org!not-for-mail
From pm <el_durango@yah00.c0m>
Subject Looking for Java web crawler api
Newsgroups comp.lang.java.programmer
User-Agent Pan/0.135 (Tomorrow I'll Wake Up and Scald Myself with Tea; GIT 30dc37b master)
MIME-Version 1.0
Content-Type text/plain; charset=UTF-8
Content-Transfer-Encoding 8bit
Date 12 Jul 2011 07:14:45 GMT
Lines 9
Message-ID <4e1bf464$0$314$14726298@news.sunsite.dk> (permalink)
Organization SunSITE.dk - Supporting Open source
NNTP-Posting-Host 66.229.12.209
X-Trace news.sunsite.dk DXC=ZdMCW`T1FcANc7PehKo47KYSB=nbEKnkKn9A_8AWGAnL;L11_OIPWIIF9e3NA7Te_F5[f9[bmol[OPP@?gfKK36B0>C=9EF^m]@
X-Complaints-To staff@sunsite.dk
Xref x330-a1.tempe.blueboxinc.net comp.lang.java.programmer:6103

Show key headers only | View raw


Hello, I am working on a project that requires me to do custom search on 
different websites.  I am using Java and while I can write this from 
ground up, I am looking at using existing APIs that can be used due to 
time limit.  So far I have came across Apache's HttpClient.  
	I am wondering if there are any others that can be effective or 
give more options for web searching/scraping. I plan to create a GUI 
based application and need something quick and effective while not being 
too complex.
I appreciate any feedback.

Back to comp.lang.java.programmer | Previous | NextNext in thread | Find similar


Thread

Looking for Java web crawler api pm <el_durango@yah00.c0m> - 2011-07-12 07:14 +0000
  Re: Looking for Java web crawler api Bent C Dalager <bcd@pvv.ntnu.no> - 2011-07-12 09:44 +0000
    Re: Looking for Java web crawler api Durango2011 <el_durango@yah00.c0m> - 2011-07-13 06:12 +0000
  Re: Looking for Java web crawler api Roedy Green <see_website@mindprod.com.invalid> - 2011-07-14 12:52 -0700
  Re: Looking for Java web crawler api iadb <freeinternetarticles@gmail.com> - 2011-07-18 16:06 -0700
  Re: Looking for Java web crawler api Durango2011 <el_durango@yah00.c0m> - 2011-07-21 05:49 +0000
  Re: Looking for Java web crawler api Arne Vajhøj <arne@vajhoej.dk> - 2011-07-21 17:10 -0400

csiph-web