Get AI summaries of any video or article — Sign up free
Linear Algebra 9 | Inner Product and Norm [dark version] thumbnail

Linear Algebra 9 | Inner Product and Norm [dark version]

3 min read

Based on The Bright Side of Mathematics's video on YouTube. If you like this content, support the original creators by watching, liking and subscribing to their content.

TL;DR

An inner product turns vector spaces like into spaces where angles and perpendicularity can be expressed algebraically.

Briefing

Inner products and norms add the missing “geometry layer” to vector spaces like : they turn raw addition and scaling into tools for measuring angles, orthogonality, and lengths. With an inner product, two vectors and produce a real number that encodes whether they are perpendicular—specifically, means the vectors are orthogonal. This is the same geometric idea familiar from and , but it extends cleanly to higher dimensions, where visual intuition fades and algebraic definitions matter more.

The standard inner product on is defined component-by-component: if and , then This construction generalizes the familiar from and from . Beyond the formula, the inner product is characterized by three key properties. First, it is positive definite: for every vector, and happens only when is the zero vector—because becomes a sum of squares. Second, it is symmetric: , reflecting commutativity of real multiplication. Third, it is linear in the second argument: and for scalars . Symmetry then implies the same linear behavior in the first argument as well.

Once an inner product exists, a norm follows naturally as a length measure. The standard norm of is defined by Because is nonnegative, the square root produces a real, nonnegative length. In and , this reproduces the usual Euclidean distance formula—essentially the Pythagorean theorem in algebraic form—while in higher dimensions it becomes the same “sum of squared components, then square root” rule.

A concrete example in makes the geometry tangible. For and , the inner product is zero, so the vectors are orthogonal (a right angle in spirit, even if not drawn). Their lengths come from the norm: and , showing that is longer. The takeaway is that these definitions preserve familiar geometric meaning while scaling to , setting up later discussion of more abstract (and even “strange”) geometries built from the same underlying inner-product properties.

Cornell Notes

An inner product on assigns a real number to two vectors, letting orthogonality and angle-related geometry be expressed algebraically. The standard inner product is , and it satisfies positive definiteness (, with equality only for the zero vector), symmetry (), and linearity in the second argument. A norm then measures length via , generalizing Euclidean length and the Pythagorean theorem. This framework makes it possible to talk about angles, perpendicular vectors, and lengths even in high-dimensional spaces like .

How does an inner product determine when two vectors are orthogonal?

Orthogonality is encoded by the inner product value: if , then and are orthogonal (perpendicular). In , the example and has , so the vectors are orthogonal.

What are the three defining properties of an inner product on ?

The inner product must be (1) positive definite: and iff is the zero vector; (2) symmetric: ; and (3) linear in the second argument: and . Symmetry then yields linearity in the first argument as well.

How is the standard inner product on computed from vector components?

If and , then . It multiplies corresponding components and adds the results, extending the familiar dot-product formulas from and .

How does the norm relate to the inner product, and why does it produce a length?

The norm is defined by . Since positive definiteness guarantees , the square root is real and nonnegative. For the standard inner product, becomes a sum of squared components, so matches Euclidean length.

In the example, how are the norms of and calculated?

For , . For , . The larger norm indicates is longer than .

Review Questions

  1. Given vectors and in , what condition on guarantees they are orthogonal?
  2. Write the formula for the standard inner product on and identify which property ensures cannot be negative.
  3. How is the norm defined in terms of the inner product, and what familiar geometric rule does it generalize?

Key Points

  1. 1

    An inner product turns vector spaces like into spaces where angles and perpendicularity can be expressed algebraically.

  2. 2

    The standard inner product on is .

  3. 3

    Orthogonality is characterized by .

  4. 4

    A valid inner product must be positive definite, symmetric, and linear in the second argument (with symmetry implying linearity in the first).

  5. 5

    The standard norm is defined by , producing a nonnegative length.

  6. 6

    In , orthogonality and lengths can be computed directly from components, even when geometry is hard to visualize.

  7. 7

    These definitions set up later generalizations to more abstract geometries beyond the standard Euclidean one.

Highlights

Orthogonality becomes a single algebraic test: .
The standard inner product in is just a component-wise multiply-and-sum: .
Lengths come from the inner product via , turning sums of squares into Euclidean distance.
In , and are orthogonal, with norms and respectively.

Topics