Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.soft-sys.math.mathematica > #11372

Re: Find Position of many elements in a large list.

From daniel.lichtblau0@gmail.com
Newsgroups comp.soft-sys.math.mathematica
Subject Re: Find Position of many elements in a large list.
Date 2012-08-16 05:58 +0000
Message-ID <k0i26i$1aq$1@smc.vnet.net> (permalink)
References <k0d4bu$m8f$1@smc.vnet.net>
Organization Time-Warner Telecom

Show all headers | View raw


On Tuesday, August 14, 2012 4:05:02 AM UTC-5, ben...@gmail.com wrote:
> I have a sorted, 1-dimensional list X of 1,000,000 integers, and a sorted, 1-dimensional list Y of 10,000 integers.  Most, but not all, of the elements of Y are also elements of X.  I'd like to know the positions of the elements in X that are also in Y.  What's the fastest way to compute this?
>
>
>
> I have an algorithm in mind but it requires lots of custom code and I'm wondering if there's a clever way to do it with built-in functions.  Thanks.

Here is a method around an order of magnitude faster than my previous attempt. Still not the fastest one seen but it handles duplicates in case that's an issue. This time I do assume the inputs are sorted (which can dominate the time of the subsequent work).

posns2 = Compile[{{l1, _Integer, 1}, {l2, _Integer, 1}},
   Module[
    {res, n1 = Length[l1], n2 = Length[l2], n3 = 0, j = 1, k = 1,
     diff},
    res = ConstantArray[0, n1];
    While[j <= n1 && k <= n2,
     diff = l1[[j]] - l2[[k]];
     If[diff < 0, j++, If[diff > 0, k++, n3++; res[[n3]] = j; j++]];
     ];
    Take[res, n3]
    ]];

n1 = 6;
n2 = 4;
SeedRandom[1111];
l1 = Sort@RandomInteger[10^n1, 10^n1];
l2 = Sort@RandomInteger[10^n1, 10^n2];

In[557]:= Timing[pos2 = posns2[l1, l2];]

Out[557]= {0.160000, Null}

Daniel Lichtblau
Wolfram Research

Back to comp.soft-sys.math.mathematica | Previous | Next — Previous in thread | Find similar | Unroll thread


Thread

Find Position of many elements in a large list. benp84@gmail.com - 2012-08-14 09:05 +0000
  Re: Find Position of many elements in a large list. Roland Franzius <roland.franzius@uos.de> - 2012-08-15 07:32 +0000
  Re: Find Position of many elements in a large list. Peter Pein <petsie@dordos.net> - 2012-08-15 07:33 +0000
  Re: Find Position of many elements in a large list. daniel.lichtblau0@gmail.com - 2012-08-15 07:34 +0000
  Re: Find Position of many elements in a large list. Peter Pein <petsie@dordos.net> - 2012-08-15 07:39 +0000
  Re: Find Position of many elements in a large list. daniel.lichtblau0@gmail.com - 2012-08-16 05:58 +0000

csiph-web