Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]
Groups > comp.soft-sys.math.mathematica > #6124 > unrolled thread
| Started by | Andy Ross <andyr@wolfram.com> |
|---|---|
| First post | 2011-11-02 11:29 +0000 |
| Last post | 2011-11-02 11:29 +0000 |
| Articles | 1 — 1 participant |
Back to article view | Back to comp.soft-sys.math.mathematica
This discussion starts older than the indexed window; earlier articles aren't shown. The article labeled Started by
below is the oldest one visible, not the original post.
Re: Problems with DistributionFitTest Andy Ross <andyr@wolfram.com> - 2011-11-02 11:29 +0000
| From | Andy Ross <andyr@wolfram.com> |
|---|---|
| Date | 2011-11-02 11:29 +0000 |
| Subject | Re: Problems with DistributionFitTest |
| Message-ID | <j8r9it$3jm$1@smc.vnet.net> |
This is exactly what you might expect. The p-value from a hypothesis
test is itself a random variable. Under the null hypothesis the p-value
should follow a UniformDistribution[{0,1}].
In your case, the null hypothesis is that the data have been drawn from
a normal distribution. What that p-value is really saying is that about
3% of the time you can expect to get a test statistic like the one you
obtained or one even more extreme.
Andy Ross
Wolfram Research
On 11/1/2011 12:02 AM, fd wrote:
> Dear Group
>
> I'm not a specialist in statistics, but I spoke to one who found this
> behaviour dubious.
>
> Before using DistributionFitTest I was doing some tests with the
> normal distribution, like this
>
> data = RandomVariate[NormalDistribution[], 10000];
>
> DistributionFitTest[data]
>
> 0.0312946
>
> According to the documentation "A small p-value suggests that it is
> unlikely that the data came from dist", and that the test assumes the
> data is normally distributed
>
> I found this result for the p-value to be really low, if I re-run the
> code I often get what I would expect (a number greater than 0.5) but
> it is not at all rare to obtain p values smaller than 0.05 and even
> smaller. Through multiple re-runs I notice it fluctuates by orders of
> magnitude.
>
> The statistician I consulted with found this weird since the data was
> drawn from a a normal distribution and the sample size is big,
> especially because the Pearson X2 test also fluctuates like this:
>
> H=DistributionFitTest[data, Automatic, "HypothesisTestData"];
>
> H["TestDataTable", All]
>
> Is this a real issue?
>
> Any thougths
>
> Best regards
> Felipe
>
>
>
>
Back to top | Article view | comp.soft-sys.math.mathematica
csiph-web