Path: csiph.com!news.bbs.geek.nz!.POSTED.agency.bbs.geek.nz!not-for-mail From: Robert Klemme (Robert Klemme) Newsgroups: comp.lang.java.programmer Subject: Re: How to identify outliers Date: Thu, 30 Nov 2017 18:38:02 +1200 Organization: fsxNet Usenet Gateway | bbs.geek.nz/#fsxNet Message-ID: <3040055046@f38.n261.z1.binkp.net> References: <7760685@f38.n261.z1.binkp.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Injection-Info: news.bbs.geek.nz; posting-host="M6YmRdZYyc42DJk0lNlt/X4dpP4dzvceBNabSmESN3E"; logging-data="25937"; mail-complaints-to="abuse@news.bbs.geek.nz" User-Agent: VSoup v1.2.9.47Beta [95/NT] X-Comment-To: Daniele Futtorovic X-MailConverter: SoupGate-Win32 v1.05 Xref: csiph.com comp.lang.java.programmer:37743 On 28.11.2017 15:40, Daniele Futtorovic wrote: > I got a statistical problem, and due to a youth math trauma, I'd like a > bit of help to solve it. :-) > I have a data series. Integer values, but that should be beside the > point. I want to identify and eliminate "outliers" from this series. > "Outliers" being values that are "too big" or "too small", in short, > that are not congruent with the rest of the series. I am well aware that > saying "outlier" begs the question, hence the quotes, but I can > fine-tune the degree of outlying for my purposes later on. For the time > being, I wonder if someone could outline some basic approaches I could > take in the matter. Funny: just today I ran across https://www.reddit.com/r/java/comments/7gkry0/statistically_rigorous_java_perfo rmance_evaluation/ and eventually found https://en.wikipedia.org/wiki/Truncated_mean which is a fairly simple and straightforward method. Depending on what you want to do you could also work with median or percentiles which are usually less affected by outliers than the median. Kind regards robert -- remember.guy do |as, often| as.you_can - without end http://blog.rubybestpractices.com/