Path: csiph.com!x330-a1.tempe.blueboxinc.net!usenet.pasdenom.info!weretis.net!feeder4.news.weretis.net!nuzba.szn.dk!news.szn.dk!pnx.dk!dotsrc.org!filter.dotsrc.org!news.dotsrc.org!not-for-mail From: pm Subject: Looking for Java web crawler api Newsgroups: comp.lang.java.programmer User-Agent: Pan/0.135 (Tomorrow I'll Wake Up and Scald Myself with Tea; GIT 30dc37b master) MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Date: 12 Jul 2011 07:14:45 GMT Lines: 9 Message-ID: <4e1bf464$0$314$14726298@news.sunsite.dk> Organization: SunSITE.dk - Supporting Open source NNTP-Posting-Host: 66.229.12.209 X-Trace: news.sunsite.dk DXC=ZdMCW`T1FcANc7PehKo47KYSB=nbEKnkKn9A_8AWGAnL;L11_OIPWIIF9e3NA7Te_F5[f9[bmol[OPP@?gfKK36B0>C=9EF^m]@ X-Complaints-To: staff@sunsite.dk Xref: x330-a1.tempe.blueboxinc.net comp.lang.java.programmer:6103 Hello, I am working on a project that requires me to do custom search on different websites. I am using Java and while I can write this from ground up, I am looking at using existing APIs that can be used due to time limit. So far I have came across Apache's HttpClient. I am wondering if there are any others that can be effective or give more options for web searching/scraping. I plan to create a GUI based application and need something quick and effective while not being too complex. I appreciate any feedback.