Scribd
Upload
20 views2 pages

Vector Spaces and Norms Cheat Sheet

The document outlines key concepts in linear algebra, including vector spaces, norms, inner products, and orthogonality. It defines vector spaces and their properties, explains various norms and inner product spaces, and discusses orthogonality, orthonormality, and related theorems. Additionally, it covers linear combinations, spans, bases, subspaces, and the rank of matrices.

Uploaded by

Acvelh
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
20 views2 pages

Vector Spaces and Norms Cheat Sheet

The document outlines key concepts in linear algebra, including vector spaces, norms, inner products, and orthogonality. It defines vector spaces and their properties, explains various norms and inner product spaces, and discusses orthogonality, orthonormality, and related theorems. Additionally, it covers linear combinations, spans, bases, subspaces, and the rank of matrices.

Uploaded by

Acvelh
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

Study Map & Cheat Sheet: Vector Spaces, Norms, Inner

Products, Orthogonality
Vector Spaces
Definition: A set with vector addition and scalar multiplication.
Properties: Closed under addition & scalar multiplication.
Examples: ℝⁿ, polynomials of degree ≤ p, continuous functions.
Non-example: {x ∈ ℝ : x² = 1} (not closed).

Norms
Definition: A function mapping vector → non-negative length.
Properties: Non-negativity, positive definiteness, triangle inequality, homogeneity.
Common norms:
‣ ℓ₂ (Euclidean): ∥x∥₂ = √(Σ xᵢ²)
‣ ℓ₁ (Manhattan): ∥x∥₁ = Σ |xᵢ|
‣ ℓ∞ (Chebyshev): ∥x∥∞ = max |xᵢ|
‣ ℓₚ (general): ∥x∥ₚ = (Σ |xᵢ|ᵖ)^(1/p)
Extensions: ℓₚ (sequences), Lₚ (continuous functions).

Inner Product Spaces


Definition: ⟨x,y⟩ → ℝ, generalizing dot product.
Properties: Symmetry, linearity, positive definiteness.
Examples:
‣ Dot product in ℝⁿ: ⟨x,y⟩ = Σ xᵢyᵢ
‣ Continuous functions: ⟨f,g⟩ = ∫ f(t)g(t) dt
‣ Matrices: ⟨X,Y⟩ = trace(YᵀX) (Frobenius).
Induced norm: ∥x∥ = √⟨x,x⟩.

Orthogonality & Orthonormality


Orthogonal: ⟨x,y⟩ = 0.
Orthogonal basis: Vectors are mutually orthogonal.
Orthonormal basis: Orthogonal + unit length.
Key theorems:
‣ Pythagorean theorem: ∥x+y∥² = ∥x∥² + ∥y∥² if x ⟂ y
‣ Cauchy–Schwarz: |⟨x,y⟩| ≤ ∥x∥·∥y∥
‣ Parallelogram law: ∥x+y∥² + ∥x−y∥² = 2(∥x∥² + ∥y∥²).

Linear Combinations, Span, Basis


Linear combination: a₁v₁ + a₂v₂ + … + aₙvₙ.
Span: All linear combinations of a set of vectors.
Linear independence: Only trivial combo = 0.
Basis: Spans the space and is linearly independent.
Dimension: Number of vectors in a basis.

Subspaces & Rank


Subspace: Closed under addition & scalar multiplication.
Column space: Span of matrix columns.
Row space: Span of matrix rows.
Rank: Dimension of column space (equals row space dimension).

You might also like