Ma · Mathematics

How Do You Expand an Inner Product of Finite Sums?

Published By the 9to5Science editorial team

At a glance

  1. 1. Write both sums

    Identify the vectors in each finite sum and keep their order clear.

  2. 2. Distribute the inner product

    Apply additivity in each argument to form one inner product for every pair of terms.

  3. 3. Use conjugate symmetry

    If simplifying a squared norm, pair the cross terms and take twice their real part.

If you need to multiply out an inner product whose arguments are finite sums, distribute across both arguments. Every term in the first sum pairs with every term in the second. This is the inner-product analogue of multiplying two finite sums of numbers.

The finite-sum rule

Let x1,…,xmx_1,\ldots,x_m and y1,…,yny_1,\ldots,y_n belong to an inner product space. Then

⟨∑i=1mxi, ∑j=1nyj⟩=∑i=1m∑j=1n⟨xi,yj⟩.\left\langle \sum_{i=1}^m x_i,\,\sum_{j=1}^n y_j\right\rangle =\sum_{i=1}^m\sum_{j=1}^n \langle x_i,y_j\rangle.

For example, with two terms in each sum,

⟨x1+x2, y1+y2⟩=⟨x1,y1⟩+⟨x1,y2⟩+⟨x2,y1⟩+⟨x2,y2⟩.\langle x_1+x_2,\,y_1+y_2\rangle =\langle x_1,y_1\rangle+\langle x_1,y_2\rangle +\langle x_2,y_1\rangle+\langle x_2,y_2\rangle.

This identity follows by applying additivity in one argument and then additivity in the other. In a complex inner product space, the inner product is sesquilinear: it is additive in both arguments, but scalar multiplication in one argument introduces complex conjugation. That distinction matters when scalars are present; it does not change the displayed rule for sums of vectors.

Worked example in R2\mathbb{R}^2

Use the usual dot product and take

x1=(1,2),x2=(3,−1),y1=(2,0),y2=(−1,4).x_1=(1,2),\quad x_2=(3,-1),\quad y_1=(2,0),\quad y_2=(-1,4).

Expanding the inner product of the sums gives four pairings:

⟨x1+x2,y1+y2⟩=⟨x1,y1⟩+⟨x1,y2⟩+⟨x2,y1⟩+⟨x2,y2⟩=(1⋅2+2⋅0)+(1⋅(−1)+2⋅4)+(3⋅2+(−1)⋅0)+(3⋅(−1)+(−1)⋅4)=2+7+6−7=8.\begin{aligned} \langle x_1+x_2, y_1+y_2\rangle &=\langle x_1,y_1\rangle+\langle x_1,y_2\rangle +\langle x_2,y_1\rangle+\langle x_2,y_2\rangle\\ &=(1\cdot2+2\cdot0)+(1\cdot(-1)+2\cdot4)\\ &\quad +(3\cdot2+(-1)\cdot0)+(3\cdot(-1)+(-1)\cdot4)\\ &=2+7+6-7=8. \end{aligned}

You can check directly: x1+x2=(4,1)x_1+x_2=(4,1) and y1+y2=(1,4)y_1+y_2=(1,4), whose dot product is 4⋅1+1⋅4=84\cdot1+1\cdot4=8. Both methods agree.

Applying the rule to a squared norm

A common special case is the squared norm of a sum. Since ∥x∥2=⟨x,x⟩\|x\|^2=\langle x,x\rangle,

∥∑i=1mxi∥2=∑i=1m∑j=1m⟨xi,xj⟩.\left\|\sum_{i=1}^m x_i\right\|^2 =\sum_{i=1}^m\sum_{j=1}^m\langle x_i,x_j\rangle.

In a real inner product space, symmetry gives the equivalent expression

∥∑i=1mxi∥2=∑i=1m∥xi∥2+2∑1≤i<j≤m⟨xi,xj⟩.\left\|\sum_{i=1}^m x_i\right\|^2 =\sum_{i=1}^m\|x_i\|^2+2\sum_{1\le i<j\le m}\langle x_i,x_j\rangle.

In a complex inner product space, use conjugate symmetry, ⟨xj,xi⟩=⟨xi,xj⟩‾\langle x_j,x_i\rangle=\overline{\langle x_i,x_j\rangle}. Each pair of cross terms therefore adds to twice a real part:

∥∑i=1mxi∥2=∑i=1m∥xi∥2+2Re⁡(∑1≤i<j≤m⟨xi,xj⟩).\left\|\sum_{i=1}^m x_i\right\|^2 =\sum_{i=1}^m\|x_i\|^2+2\operatorname{Re}\left(\sum_{1\le i<j\le m}\langle x_i,x_j\rangle\right).

For two vectors this is ∥x+y∥2=∥x∥2+∥y∥2+2Re⁡⟨x,y⟩\|x+y\|^2=\|x\|^2+\|y\|^2+2\operatorname{Re}\langle x,y\rangle. In a real space, the real-part operator can be omitted.

Common mistakes

  • Keeping only matching indices. The expression ⟨∑ixi,∑jyj⟩\langle\sum_i x_i,\sum_j y_j\rangle includes every pair (i,j)(i,j), not just terms with i=ji=j.
  • Treating a complex inner product as bilinear. Sums distribute in both arguments, but pulling out a complex scalar conjugates it in whichever argument is conjugate-linear under your convention. Check whether your text defines the inner product to be linear in the first or second argument.
  • Dropping cross terms in a squared norm. In general, ∥x+y∥2\|x+y\|^2 is not just ∥x∥2+∥y∥2\|x\|^2+\|y\|^2. The cross terms vanish when xx and yy are orthogonal; otherwise they contribute.

The finite-sum expansion is valid in any inner product space, including an infinite-dimensional Hilbert space. It uses only the inner-product axioms, not completeness or finite dimensionality.

References

  1. Erwin Kreyszig, Introductory Functional Analysis with Applications
  2. Sheldon Axler, Linear Algebra Done Right

Spotted an error? Send a correction. Read how we write and check articles in our editorial policy.