Hilbert Spaces 1 | Introductions and Cauchy-Schwarz Inequality [dark version]
Based on The Bright Side of Mathematics's video on YouTube. If you like this content, support the original creators by watching, liking and subscribing to their content.
Hilbert spaces are defined by combining an inner product with completeness under the induced norm.
Briefing
Hilbert spaces are built on one central ingredient: an inner product that turns a vector space into a geometric setting where lengths, angles, and orthogonality make sense. The series frames Hilbert spaces as the backbone of functional analysis and highlights why they matter for both theory and applications—especially once infinite-dimensional problems enter the picture.
The groundwork starts with an inner product on a vector space X over a fixed field F (either real numbers R or complex numbers C). The inner product is a function ⟨·,·⟩ that takes two vectors from X and returns a scalar in F. It must be positive definite: ⟨x,x⟩ is always nonnegative, and it equals 0 only when x is the zero vector. It also must be linear in the second argument, meaning ⟨x, y1 + y2⟩ = ⟨x,y1⟩ + ⟨x,y2⟩ and ⟨x, αy⟩ = α⟨x,y⟩. Finally, it must satisfy conjugate symmetry: swapping the arguments leaves the value unchanged in the real case, but introduces complex conjugation in the complex case. That last point forces a key asymmetry: in complex spaces, the first argument behaves conjugate-linearly rather than linearly under scalar multiplication.
With those axioms in place, the series moves to the Cauchy–Schwarz inequality, a cornerstone result that links the inner product to a bound on “correlation” between vectors. For any vectors x and y, it gives
|⟨x,y⟩|² ≤ ⟨x,x⟩⟨y,y⟩.
The proof uses a standard trick: when y ≠ 0, consider the vector x − s y where s is chosen as ⟨x,y⟩ / ⟨y,y⟩. Positive definiteness ensures ⟨x − s y, x − s y⟩ ≥ 0. Expanding this expression requires careful bookkeeping of linearity in the second slot and conjugation in the first slot (the order of arguments matters in the complex case). After cancellations, the inequality emerges by rearranging terms and multiplying by ⟨y,y⟩.
Cauchy–Schwarz then immediately yields a norm from the inner product: define ||x|| = sqrt(⟨x,x⟩). The series notes that this norm satisfies the norm axioms, including the triangle inequality, which can be derived using Cauchy–Schwarz. At that point, the definition of a Hilbert space becomes clear: an inner product space is a Hilbert space when it is complete with respect to this induced norm (a Banach space condition). Completeness is what prevents “Cauchy sequences” from converging to something outside the space, making Hilbert spaces the natural setting for infinite-dimensional analysis.
The takeaway is a clean pipeline: inner product axioms → Cauchy–Schwarz → a norm → completeness → Hilbert space. That chain explains why Hilbert spaces are both mathematically structured and practically useful for studying operators, projections, and spectral behavior later in the course.
Cornell Notes
Hilbert spaces start with an inner product ⟨·,·⟩ on a vector space X over F = R or C. The inner product must be positive definite, linear in the second argument, and symmetric up to complex conjugation when the field is complex. From these axioms, the Cauchy–Schwarz inequality follows: |⟨x,y⟩|² ≤ ⟨x,x⟩⟨y,y⟩. That inequality supports defining a norm by ||x|| = sqrt(⟨x,x⟩), turning the space into a metric setting where distances and triangle inequality hold. A Hilbert space is then an inner product space that is complete under this norm, meaning Cauchy sequences converge within the space.
What are the three defining properties of an inner product, and why does complex conjugation matter?
How does the Cauchy–Schwarz inequality proof use positive definiteness?
Why does Cauchy–Schwarz immediately lead to a norm?
What extra condition turns an inner product space into a Hilbert space?
What changes between real and complex vector spaces in this setup?
Review Questions
- State the three axioms of an inner product and specify which argument is linear under the convention used here.
- Derive the Cauchy–Schwarz inequality starting from the nonnegativity of ⟨x − s y, x − s y⟩ and the choice s = ⟨x,y⟩ / ⟨y,y⟩.
- Explain how completeness under the induced norm is used to define a Hilbert space.
Key Points
- 1
Hilbert spaces are defined by combining an inner product with completeness under the induced norm.
- 2
An inner product must be positive definite, linear in the second argument, and symmetric up to complex conjugation in the complex case.
- 3
Cauchy–Schwarz inequality provides the bound |⟨x,y⟩|² ≤ ⟨x,x⟩⟨y,y⟩ and is proved using positive definiteness of ⟨x − s y, x − s y⟩.
- 4
The norm induced by an inner product is ||x|| = sqrt(⟨x,x⟩), and Cauchy–Schwarz supports the triangle inequality.
- 5
A Hilbert space is an inner product space that is complete (every Cauchy sequence converges within the space) under this norm.