Groups > comp.lang.java.programmer > #2592

Re: JavaScript and Screenscraping

Date	2011-03-30 07:40 -0700
From	Peter Duniho <NpOeStPeAdM@NnOwSlPiAnMk.com>
Newsgroups	comp.lang.java.programmer
Subject	Re: JavaScript and Screenscraping
References	<rvc6p6toumdlevjb48ohjnlf1gur128eqe@4ax.com>
Message-ID	<RYSdnRdK4sZ93Q7QnZ2dnUVZ_sSdnZ2d@posted.palinacquisition> (permalink)

Show all headers | View raw

On 3/30/11 6:51 AM, Roedy Green wrote:
> I am working on a screenscraping project that is turning out to much
> more time-consuming that I thought it would be. I am trying to gather
> a database of information about all the motherboards sold my major
> manufacturers.  The idea is to eventually create a comparison shopper
> to help you narrow down models that fit your needs. [...]

Already done.  For example:
http://www.newegg.com/Store/SubCategory.aspx?SubCategory=22

The most successful approach will never be to scrape web sites, but 
rather to do what commercial sites do: build a database from technical 
specifications provided by manufacturers (as above).

If you're doing this as an academic exercise, then I suppose that might 
be useful from a learning point of view.  You'll learn a lot about 
scraping. :)  Otherwise, I don't see the point.

Pete

Back to comp.lang.java.programmer | Previous | Next — Previous in thread | Next in thread | Find similar

Thread

JavaScript and Screenscraping Roedy Green <see_website@mindprod.com.invalid> - 2011-03-30 06:51 -0700
  Re: JavaScript and Screenscraping Michal Kleczek <kleku75@gmail.com> - 2011-03-30 16:27 +0200
    Re: JavaScript and Screenscraping Tom Anderson <twic@urchin.earth.li> - 2011-03-31 00:28 +0100
  Re: JavaScript and Screenscraping Peter Duniho <NpOeStPeAdM@NnOwSlPiAnMk.com> - 2011-03-30 07:40 -0700
    Re: JavaScript and Screenscraping Roedy Green <see_website@mindprod.com.invalid> - 2011-03-30 18:27 -0700
  Re: JavaScript and Screenscraping Dr J R Stockton <reply1113@merlyn.demon.co.uk> - 2011-04-01 23:39 +0100
    Re: JavaScript and Screenscraping Roedy Green <see_website@mindprod.com.invalid> - 2011-04-01 20:00 -0700
      Re: JavaScript and Screenscraping Dr J R Stockton <reply1113@merlyn.demon.co.uk> - 2011-04-03 17:27 +0100
  Re: JavaScript and Screenscraping RedGrittyBrick <RedGrittyBrick@spamweary.invalid> - 2011-04-05 17:15 +0100

csiph-web