Isotropic position

In the fields of machine learning, the theory of computation, and random matrix theory, a probability distribution over vectors is said to be in isotropic position if its covariance matrix is equal to the identity matrix.

Formal definitions

Let ${\textstyle D}$ be a distribution over vectors in the vector space ${\textstyle \mathbb {R} ^{n}}$. Then ${\textstyle D}$ is in isotropic position if, for vector ${\textstyle v}$ sampled from the distribution, $$\mathbb {E} \,vv^{\mathsf {T}}=\mathrm {Id} .$$

A set of vectors is said to be in isotropic position if the uniform distribution over that set is in isotropic position. In particular, every orthonormal set of vectors is isotropic.

As a related definition, a convex body ${\textstyle K}$ in ${\textstyle \mathbb {R} ^{n}}$ is called isotropic if it has volume ${\textstyle |K|=1}$, center of mass at the origin, and there is a constant ${\textstyle \alpha >0}$ such that $$\int _{K}\langle x,y\rangle ^{2}dx=\alpha ^{2}|y|^{2},$$ for all vectors ${\textstyle y}$ in ${\textstyle \mathbb {R} ^{n}}$; here ${\textstyle |\cdot |}$ stands for the standard Euclidean norm.

See also

• Whitening transformation

References

• Rudelson, M. (1999). "Random Vectors in the Isotropic Position". Journal of Functional Analysis. 164 (1): 60–72. arXiv:math/9608208. doi:10.1006/jfan.1998.3384.