-
Notifications
You must be signed in to change notification settings - Fork 0
KarhunenLoeveTheorem
Let
Here, the
and the functions
where
The eigenfunctions are orthogonal, i.e.,
where
The uncorrelated random variables
and
Thus, the Karhunen-Loève theorem provides a complete orthonormal set of functions
See also GaussianProcessOrthogonalPolynomials.
The process of determining the orthogonal eigenfunctions corresponding to a covariance kernel, which defines the inner product space, is generally known as "solving the eigenproblem" or "solving the Sturm-Liouville problem" in the context of functional analysis. In this context, the procedure involves finding the eigenvalues and corresponding eigenfunctions of the operator defined by the covariance kernel.
This process can be described as follows:
- The covariance kernel defines an integral operator. The application of this operator to a function is given by the integral of the covariance kernel times the function.
- The eigenfunctions and eigenvalues of this operator are determined by solving the integral equation:
- Here,
$R(s,t)$ is the covariance kernel,$\lambda_k$ are the eigenvalues, and$\phi_k(t)$ are the eigenfunctions.
In the specific context of the Karhunen-Loève theorem, the eigenfunctions are also orthonormal with respect to the inner product defined by the covariance kernel, making them suitable for use in expanding the stochastic process in terms of these eigenfunctions.
While there's not a specific name for this process in the context of the Karhunen-Loève theorem, it's sometimes referred to as the "Karhunen-Loève transform" or "Karhunen-Loève decomposition", although these terms also refer to the resulting representation of the stochastic process in terms of the eigenfunctions.