Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.soft-sys.math.mathematica > #8445

Re: ListInterpolate and missing values

From Ulrich Arndt <ulrich.arndt@data2knowledge.de>
Newsgroups comp.soft-sys.math.mathematica
Subject Re: ListInterpolate and missing values
Date 2012-02-10 10:53 +0000
Organization Steven M. Christensen and Associates, Inc and MathTensor, Inc.
Message-ID <jh2sut$kc$1@smc.vnet.net> (permalink)
References <201202091034.FAA18221@smc.vnet.net>

Show all headers | View raw


Hi,

I didn't checked the ListInterpolate as it was not obvious to me how this can help.

Maybe below function will do sufficient enough - test case of 1 mio element list in < 2 sec.

I added a constrained to the function that the first and the last element should not be null as no rule was given for this case...

Ulrich

x={1,2,10,,12,2,6,6,,,,12,22};

Clear[specialInterpole];

=
specialInterpole[x_List/;NumericQ[x[[1]]]==True&&NumericQ[x[[-1]]]== True]:= Module[{out,p,t,vals,diff,len,increment,newvals},
p = Position[x,Null]//Flatten;
t = Split[p,#2==#1+1&];
If[Length[p]>0,
vals = Map[{x[[Min[#]-1]],x[[Max[#]+1]]}&,t];
diff = Map[#[[2]]-#[[1]]&,vals];
len = Map[Length,t];
increment = Map[#[[1]]/#[[2]]&,Transpose[{diff,len+1}]];
newvals =  vals[[All,1]]+Map[Range,len] * increment;
out = x;
out[[Flatten[t]]]=Flatten[newvals];
];
out];


specialInterpole[x]
Out[156]= {1,2,10,11,12,2,6,6,15/2,9,21/2,12,22}

specialInterpole[{1,,,,,,,,,10}]
Out[157]= {1,2,3,4,5,6,7,8,9,10}

specialInterpole[{,1,2}]
Out[158]= specialInterpole[{Null,1,2}]

specialInterpole[{1,1,}]
Out[159]= specialInterpole[{1,1,Null}]

specialInterpole[{1,,1}]
Out[160]= {1,1,1}

SeedRandom[1]
dim = 1000000
dat =Range[dim];
dat[[RandomSample[dat,dim/10]]]= ConstantArray[Null,dim/10];
dat[[1;;20]]
dat[[-1]]

Out[395]= 1000000
Out[398]= =
{1,Null,3,4,5,6,7,8,Null,Null,11,12,13,Null,Null,16,17,18,19,20}
Out[399]= 1000000

Timing[out = specialInterpole[dat];]
Out[400]= {1.49907,Null}

out==Range[dim]
Out[401]= True


--
www.data2knowledge.de

Am 09.02.2012 um 11:34 schrieb Mark Coleman:

> Hi,
>
> I'm looking for a way to linearly interpolate missing values in a
> large list of numbers such that the interpolated values reflect the
> size of the "gap" between non-missing values. For instance, say I have
> the following list:
>
> x={1,2,10,,12,2,6,6,,,12,22}
>
> The list x has two gaps. A gap of size "1" at x[4], and a gap a size
> "2" at x[10]-x[11]. I'm looking for a linear interpolation method such
> that
>
> x[4] = 11,
>
> x[10]=8, x[11]=10
>
> That is, each of the interpolated values is a constant increment
> between the two surrouding non-missing values. My actually problem has
> millions of such lists, where gaps are dispersed randomly (In thinking
> about his more, missing endpoints could also be interpolated by
> "extending" the line between the two succeeeding or preceeding
> points).
>
> I'm wondering if ListInterpolate can handle this sort of problem
> directly? If not, any help would be much appreciated.
>
> Cheers,
>
> Mark
>

Back to comp.soft-sys.math.mathematica | Previous | Next | Find similar | Unroll thread


Thread

Re: ListInterpolate and missing values Ulrich Arndt <ulrich.arndt@data2knowledge.de> - 2012-02-10 10:53 +0000

csiph-web