Iterative Methods in Numerical Analysis
Iterative Methods in Numerical Analysis
For an invertible block matrix, the inverse is found using the formula: If A and C are nonsingular, then . Applying this to an example matrix results in the inverse being calculated as shown, for instance, in the matrix example from the document .
The power method starts with an initial guess vector and applies the matrix iteratively. For the given matrix, starting with X(0) = (1, -2, 0, 3)t, subsequent iterations provide an approximated dominant eigenvalue of µ(3) = 5.038462 and eigenvector X(3) = (1, 0.221374, 0.389313, 0.404580)t .
Using the Jacobi method, which is an iterative algorithm to diagonalize a symmetric matrix, the eigenvalues are calculated until off-diagonal elements are below a threshold. For this matrix, after six rotations, the eigenvalues are determined as 6.372293, 0.627718, 2.000001 .
Implementation involves solving each equation in sequence using the updated values as soon as they are available. For the given system, the result after two iterations by applying this method provides the estimate X(2) = (-1.625, 1.3125, -0.65625)t .
Iterative methods like Gauss-Seidel require the spectral radius of iteration matrix to be less than 1 for convergence. In the provided system, convergence is achieved after 5 iterations when ∥X(k) − X(k−1)∥∞/∥X(k)∥∞ ≤10⁻³, resulting in the vector X(5) = (1.0001, 2.0000, -1.0000, 1.0000)t .
Jacobi and Gauss-Seidel methods are simple and intuitive for iterative solutions, suitable for large sparse systems. However, their convergence is not guaranteed for every system, dependent on the spectral radius and diagonal dominance conditions. Gauss-Seidel is generally faster due to immediate updates, but both may converge slowly on ill-conditioned systems .
LU decomposition involves decomposing the coefficient matrix into a lower triangular matrix L and an upper triangular matrix U. For the given system, after performing LU decomposition, back substitution leads to the solution X = [1, 0.5, -0.5]t .
The Jacobi method involves solving each equation for its respective variable, using the previous iteration's values. For this system, the first two iterations result in X(2) = (1.633333, −0.983333, 0.233333)t .
The inverse of a 2x2 block matrix is calculated by separately inverting individual submatrices A and C if they are nonsingular, and using a specified formula for the off-diagonal blocks. An example from the document shows the inversion process applied to a specific matrix, generating a precise inverse matrix .
The Gauss-Seidel method differs from the Jacobi method by using the latest updated values of the variables as soon as they are available within the same iteration, rather than only relying on previous iteration values. This often leads to faster convergence compared to the independent updates per equation seen in the Jacobi method .