Hilbert Spaces 1 | Introductions and Cauchy-Schwarz Inequality

TL;DR

An inner product ⟨·,·⟩ on X must be positive definite, linear in the second argument, and conjugate symmetric in the complex case.

Briefing Cornell Notes

Briefing

Hilbert spaces hinge on one foundational idea: an inner product that turns a vector space into a geometric setting where lengths, angles, and orthogonality make sense. The course begins by defining an inner product on a real or complex vector space X (written as an F-vector space, where F is either R or C). The inner product ⟨·,·⟩ must be positive definite—⟨x,x⟩ is nonnegative for every x, and it equals 0 only when x is the zero vector. It must also be linear in the second argument, meaning scalars and sums can be pulled out from that slot. Finally, it must satisfy conjugate symmetry: swapping the arguments leaves the value unchanged in the real case, but introduces complex conjugation in the complex case. That last point matters because it means the first argument behaves differently from the second when complex numbers are involved.

With those properties in place, the central inequality of inner product spaces—Cauchy–Schwarz—takes over as the key tool. For any vectors x and y, the inequality bounds the magnitude of ⟨x,y⟩ by the product of the “self-inner-products” ⟨x,x⟩ and ⟨y,y⟩. In formula form, |⟨x,y⟩|² ≤ ⟨x,x⟩⟨y,y⟩. The proof uses a standard trick: when y is nonzero, consider the vector x − s y with a carefully chosen scalar s = ⟨x,y⟩/⟨y,y⟩. Plugging this linear combination into the inner product yields a nonnegative quantity by positive definiteness. Expanding produces four terms, where the cross terms cancel after simplification, and conjugate symmetry converts the remaining expression into an absolute value squared. Rearranging then delivers Cauchy–Schwarz.

Cauchy–Schwarz isn’t just a standalone result—it immediately generates a norm. The course defines ||x|| = √⟨x,x⟩, showing that inner products automatically provide a way to measure lengths and, by extension, distances. Once this norm is available, the definition of a Hilbert space becomes clear: an inner product space becomes a Hilbert space when it is complete with respect to that norm. Completeness means Cauchy sequences (with respect to ||·||) converge to points inside the space, which is essential for analysis in infinite-dimensional settings.

The takeaway is a clean pipeline: inner product axioms (including conjugate symmetry in the complex case) lead to Cauchy–Schwarz, which yields a norm, which in turn enables the completeness requirement that defines Hilbert spaces. From there, later material can build orthogonality, orthonormal bases, projections, and operator theory on a solid mathematical foundation.

Cornell Notes

An inner product on a real or complex vector space X turns algebra into geometry by defining lengths and angles. The inner product must be positive definite, linear in the second argument, and conjugate symmetric (symmetry for real spaces, conjugation for complex spaces). Using these axioms, Cauchy–Schwarz shows that |⟨x,y⟩|² ≤ ⟨x,x⟩⟨y,y⟩ for all x,y. That inequality enables the norm ||x|| = √⟨x,x⟩, which measures distances in the space. A Hilbert space is then an inner product space that is complete under this norm, meaning Cauchy sequences converge within the space—crucial for functional analysis and applications.

Why does conjugate symmetry force different behavior in the first vs. second argument for complex vector spaces?

In the complex case, conjugate symmetry requires ⟨x,y⟩ = overline{⟨y,x⟩}. Combined with linearity in the second argument, this implies scalars pulled from the first argument pick up complex conjugation. Concretely, linearity is stated only for the second slot; the first slot is conjugate-linear. The course notes that some conventions swap the definition, but this series fixes linearity in the second argument.

How does the proof of Cauchy–Schwarz use positive definiteness?

For y ≠ 0, it considers the vector x − s y where s = ⟨x,y⟩/⟨y,y⟩. Positive definiteness guarantees ⟨x − s y, x − s y⟩ ≥ 0. Expanding produces four terms involving ⟨x,x⟩, ⟨x,y⟩, ⟨y,x⟩, and ⟨y,y⟩. Conjugate symmetry lets ⟨y,x⟩ become the conjugate of ⟨x,y⟩, so the cross terms combine into |⟨x,y⟩|². Rearranging yields |⟨x,y⟩|² ≤ ⟨x,x⟩⟨y,y⟩.

What norm is induced by an inner product, and why is it natural?

The induced norm is defined by ||x|| = √⟨x,x⟩. It is natural because ⟨x,x⟩ is always nonnegative by positive definiteness, and it equals 0 only when x is the zero vector. The course also indicates that the norm axioms (including triangle inequality) can be established using Cauchy–Schwarz.

What extra condition turns an inner product space into a Hilbert space?

Completeness. After defining the norm from the inner product, the space is called a Hilbert space if it is a Banach space with respect to that norm—i.e., every Cauchy sequence (under ||·||) converges to a limit that lies in the space.

How does Cauchy–Schwarz connect inner products to geometry?

Cauchy–Schwarz bounds the inner product magnitude in terms of lengths: |⟨x,y⟩| ≤ ||x||·||y||. This relationship is the backbone for defining angles and orthogonality in inner product spaces, since it controls how large the “projection-like” quantity ⟨x,y⟩ can be relative to the lengths of x and y.

Review Questions

State the three axioms an inner product must satisfy in the complex case, and identify which argument is linear.
Derive the Cauchy–Schwarz inequality starting from the nonnegativity of ⟨x − s y, x − s y⟩ and the choice s = ⟨x,y⟩/⟨y,y⟩.
Explain how the norm ||x|| = √⟨x,x⟩ leads to the definition of a Hilbert space via completeness.

Key Points

1
An inner product ⟨·,·⟩ on X must be positive definite, linear in the second argument, and conjugate symmetric in the complex case.
2
In complex vector spaces, conjugate symmetry implies the first argument is conjugate-linear rather than linear under the chosen convention.
3
Cauchy–Schwarz gives the fundamental bound |⟨x,y⟩|² ≤ ⟨x,x⟩⟨y,y⟩ for all vectors x,y.
4
Cauchy–Schwarz enables the induced norm ||x|| = √⟨x,x⟩, turning inner product spaces into normed spaces.
5
A Hilbert space is an inner product space that is complete with respect to the induced norm (a Banach space under ||·||).
6
The proof strategy for Cauchy–Schwarz uses the nonnegativity of ⟨x − s y, x − s y⟩ with a specific choice of s.

Highlights

The inner product axioms—especially conjugate symmetry—determine how scalars behave in each argument for complex spaces.

Cauchy–Schwarz is proved by forcing a nonnegative inner product ⟨x − s y, x − s y⟩ and expanding into four terms.

The norm ||x|| = √⟨x,x⟩ drops out directly from the inner product, making geometry measurable.

Hilbert spaces are exactly the complete inner product spaces, ensuring limits of Cauchy sequences stay inside the space.

Topics

Mentioned

Cauchy-Schwarz