Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.soft-sys.math.mathematica > #11363

Re: Find Position of many elements in a large list.

From Peter Pein <petsie@dordos.net>
Newsgroups comp.soft-sys.math.mathematica
Subject Re: Find Position of many elements in a large list.
Date 2012-08-15 07:39 +0000
Message-ID <k0fjnm$qbc$1@smc.vnet.net> (permalink)
References <k0d4bu$m8f$1@smc.vnet.net>
Organization Time-Warner Telecom

Show all headers | View raw


Am 14.08.2012 11:05, schrieb benp84@gmail.com:
> I have a sorted, 1-dimensional list X of 1,000,000 integers, and a sorted, 1-dimensional list Y of 10,000 integers.  Most, but not all, of the elements of Y are also elements of X.  I'd like to know the positions of the elements in X that are also in Y.  What's the fastest way to compute this?
>
> I have an algorithm in mind but it requires lots of custom code and I'm wondering if there's a clever way to do it with built-in functions.  Thanks.
>

Hi,

  the fastest way I was able to find is about four times faster than the 
naive approach

Flatten[Position[x, Alternatives @@ Intersection[x, y], 1]]

Dropping successively the irrelevant parts of the huge list x, searching 
becomes faster:

Reap[
  Fold[
   Drop[#1, Sow[LengthWhile[#1, Function[x0, x0 <= #2]]]] &,
   x, Intersection[x, y]
  ]
][[2, 1]] // Accumulate

I tried patterns and compilation; to no avail (see [1]).

Cheers,
  Peter

[1] https://dl.dropbox.com/u/3030567/Mathematica/getpositions.nb

Back to comp.soft-sys.math.mathematica | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread


Thread

Find Position of many elements in a large list. benp84@gmail.com - 2012-08-14 09:05 +0000
  Re: Find Position of many elements in a large list. Roland Franzius <roland.franzius@uos.de> - 2012-08-15 07:32 +0000
  Re: Find Position of many elements in a large list. Peter Pein <petsie@dordos.net> - 2012-08-15 07:33 +0000
  Re: Find Position of many elements in a large list. daniel.lichtblau0@gmail.com - 2012-08-15 07:34 +0000
  Re: Find Position of many elements in a large list. Peter Pein <petsie@dordos.net> - 2012-08-15 07:39 +0000
  Re: Find Position of many elements in a large list. daniel.lichtblau0@gmail.com - 2012-08-16 05:58 +0000

csiph-web