Kolmogorov–Smirnov test

In statistics, the Kolmogorov-Smirnov test is used to determine whether two underlying probability distributions differ from each other or whether an underlying probability distribution differs from a hypothesized distribution, in either case based in finite samples.

The empirical cumulative distribution function F_n for n observations y_i is defined as

$F_{n}(x)={1 \over n}\sum _{i=1}^{n}\left\{{\begin{matrix}1&\mathrm {if} \ y_{i}\leq x,\\0&\mathrm {otherwise} .\end{matrix}}\right.$

The two one-sided Kolmogorov-Smirnov test statistics are given by

$D_{n}^{+}=\max(F_{n}(x)-F(x))\,$

$D_{n}^{-}=\max(F(x)-F_{n}(x))\,$

where F(x) is the hypothesized distribution or another empirical distribution. The probability distributions of these two statistics, given that the null hypothesis of equality of distributions is true, does not depend on what the hypothesized distribution is, as long as it is continuous. Knuth gives a detailed description of how to analyze the significance of this pair of statistics. Many people use max(D_n⁺, D_n⁻ ) instead, but the distribution of this statistic is more difficult to deal with.

Note that when the underlying independent variable is cyclic, as with day of the year or day of the week, then Kuiper's test is more appropriate. Numerical Recipes is a good source of information on this. Note furthermore, that the Kolmogorov-Smirnov test is more sensitive at points near the median of the distribution than on its tails. The Anderson-Darling test is a test that provides equal sensitivity at the tails.

See also

• Kolmogorov

External links

• http://www.itl.nist.gov/div898/handbook/eda/section3/eda35g.htm - A lovely explanation of the one-sided KS test
• http://www.io.com/~ritter/JAVASCRP/NORMCHIK.HTM - JavaScript code that implements both the one-sided and two-sided tests.
• As always, Numerical Recipes (ISBN 0521431085) is a prime resource for this sort of thing (see http://www.nr.com/nronline_switcher.html for a discussion).
• The Legacy of Andrei Nikolaevich Kolmogorov Curriculum Vitae and Biography. Kolmogorov School. Ph.D. students and descendants of A.N. Kolmogorov. A.N. Kolmogorov works, books, papers, articles. Photographs and Portraits of A.N. Kolmogorov.