Re: efficient way to process data

References	(2 earlier) <CACwCsY6W3x+8QzkJ8GR7qeck9s4xkwkhUbRt4k2iBAGcFuUb2g@mail.gmail.com> <CAPTjJmp82qrVz03sZFLXyju0oL-3=qJrcn34UJU6N4qo+wF6tw@mail.gmail.com> <CACwCsY74dTc9vJ=j06Fq9rqXe_wmSHpYQ-qaC284CcgjEnrQ9Q@mail.gmail.com> <CAPTjJmrv7aG09p8H_v6tyJRQHo37o=_2ZX0sL96L_ZaDsddJNw@mail.gmail.com> <CACwCsY62pqvKVrs11+yv5Ox9QBSv4McQDZ3-0aGnaUezfm2Ywg@mail.gmail.com>
Date	2014-01-15 01:26 +1100
Subject	Re: efficient way to process data
From	Chris Angelico <rosuav@gmail.com>
Newsgroups	comp.lang.python
Message-ID	<mailman.5460.1389709601.18130.python-list@python.org> (permalink)

Show all headers | View raw

On Wed, Jan 15, 2014 at 1:18 AM, Larry Martell <larry.martell@gmail.com> wrote:
> if you're interested in what the application is, this is data
> collected with an electron microscope from semiconductor wafers as
> they are being manufactured. The x and y are the position on the wafer
> that the data was collected, in microns. If 2 data points are
> collected within 1 micron of each other they need to be combined when
> being analyzed.

As far as I'm concerned, you won geek cred the moment you said
"electron microscope", and "semiconductor wafers as they are being
manufactured" is just gravy I don't suppose you want to hire another
programmer? :)

Do you actually mean here that the two points need to be within 1
micron, or that data gets combined if it's nearby in *either*
coordinate? There are libraries for figuring out if two things are
near each other - I'm not 100% sure, but you might be able to do this
inside PostgreSQL (though that just gets back to the previous rule:
can't move off MySQL). Treat every data point as a circle or square,
and then look for overlap.

ChrisA

Back to comp.lang.python | Previous | Next | Find similar | Unroll thread

Thread

Re: efficient way to process data Chris Angelico <rosuav@gmail.com> - 2014-01-15 01:26 +1100

csiph-web