Ma · Mathematics

Why Every Real Symmetric Matrix Is Diagonalizable

Published By the 9to5Science editorial team

At a glance

  1. 1. Maximize a quadratic form

    Find a unit vector where xᵀAx is largest; compactness guarantees that such a vector exists.

  2. 2. Obtain an eigenvector

    Use the constrained maximum condition to show the maximizing vector satisfies Av = λv.

  3. 3. Preserve the complement

    Symmetry makes the orthogonal complement of that eigenvector invariant under A.

  4. 4. Apply induction

    Restrict A to the complement and repeat until an orthonormal eigenbasis is obtained.

Let AA be an n×nn\times n real matrix satisfying

AT=A.A^T=A.

The claim is stronger than ordinary diagonalizability: AA has an orthonormal basis of real eigenvectors. Consequently, there is an orthogonal matrix QQ and a real diagonal matrix DD such that

QTAQ=D,Q^TAQ=D,

or equivalently,

A=QDQT.A=QDQ^T.

This is the real spectral theorem.

The key idea: maximize a quadratic form

Consider the function

f(x)=xTAxf(x)=x^TAx

on the unit sphere

Sn−1={x∈Rn:xTx=1}.S^{n-1}=\{x\in\mathbb R^n:x^Tx=1\}.

The sphere is compact and ff is continuous, so ff attains a maximum at some unit vector vv. Write the maximum as

λ=f(v)=vTAv.\lambda=f(v)=v^TAv.

We will show that vv is an eigenvector of AA.

At the constrained maximum, the method of Lagrange multipliers gives

∇f(v)=μ∇(xTx)∣x=v\nabla f(v)=\mu\nabla(x^Tx)\big|_{x=v}

for some scalar μ\mu. Since

∇(xTAx)=(A+AT)x=2Ax\nabla(x^TAx)=(A+A^T)x=2Ax

when AT=AA^T=A, and ∇(xTx)=2x\nabla(x^Tx)=2x, we obtain

2Av=2μv.2Av=2\mu v.

Thus

Av=μv.Av=\mu v.

Multiplying on the left by vTv^T and using vTv=1v^Tv=1 shows that

μ=vTAv=λ.\mu=v^TAv=\lambda.

Therefore vv is a real unit eigenvector of AA.

The orthogonal complement is invariant

Let

V=v⊥={x∈Rn:vTx=0}.V=v^\perp=\{x\in\mathbb R^n:v^Tx=0\}.

We claim that AA maps VV into itself. Take any x∈Vx\in V. Since AA is symmetric and Av=λvAv=\lambda v,

vT(Ax)=(ATv)Tx=(Av)Tx=(λv)Tx=λvTx=0.\begin{aligned} v^T(Ax)&=(A^Tv)^Tx\\ &=(Av)^Tx\\ &=(\lambda v)^Tx\\ &=\lambda v^Tx\\ &=0. \end{aligned}

Hence Ax∈VAx\in V. In other words, VV is invariant under AA.

The restriction of AA to VV is still symmetric. Indeed, for x,y∈Vx,y\in V,

⟨Ax,y⟩=xTATy=xTAy=⟨x,Ay⟩.\langle Ax,y\rangle=x^TA^Ty=x^TAy=\langle x,Ay\rangle.

The space VV has dimension n−1n-1. Applying the same argument to the restriction of AA on VV, we obtain a unit eigenvector in VV. Repeating this process gives orthonormal eigenvectors

v1,v2,…,vnv_1,v_2,\ldots,v_n

that form a basis of Rn\mathbb R^n.

Constructing the diagonalization

Let λi\lambda_i be the eigenvalue corresponding to viv_i, so that

Avi=λivi.Av_i=\lambda_i v_i.

Form the matrix whose columns are these orthonormal eigenvectors:

Q=[v1v2⋯vn].Q=\begin{bmatrix}v_1&v_2&\cdots&v_n\end{bmatrix}.

Because the columns are orthonormal,

QTQ=I,Q^TQ=I,

so QQ is orthogonal. Also,

AQ=[Av1Av2⋯Avn]=[λ1v1λ2v2⋯λnvn].AQ=\begin{bmatrix}Av_1&Av_2&\cdots&Av_n\end{bmatrix} =\begin{bmatrix}\lambda_1v_1&\lambda_2v_2&\cdots&\lambda_nv_n\end{bmatrix}.

Therefore

AQ=QD,AQ=QD,

where

D=diag⁡(λ1,λ2,…,λn).D=\operatorname{diag}(\lambda_1,\lambda_2,\ldots,\lambda_n).

Multiplying by QTQ^T on the left gives

QTAQ=D.Q^TAQ=D.

Thus AA is diagonalizable, and the diagonalizing matrix can be chosen orthogonal.

A concrete example

Consider

A=[2112].A=\begin{bmatrix}2&1\\1&2\end{bmatrix}.

This matrix is symmetric. Its characteristic polynomial is

det⁡(A−λI)=det⁡[2−λ112−λ]=(2−λ)2−1=(λ−1)(λ−3).\det(A-\lambda I) =\det\begin{bmatrix}2-\lambda&1\\1&2-\lambda\end{bmatrix} =(2-\lambda)^2-1 =(\lambda-1)(\lambda-3).

The eigenvalues are 11 and 33. For λ=3\lambda=3, an eigenvector is (1,1)T(1,1)^T, and for λ=1\lambda=1, an eigenvector is (1,−1)T(1,-1)^T. Normalize them:

v1=12[11],v2=12[1−1].v_1=\frac{1}{\sqrt2}\begin{bmatrix}1\\1\end{bmatrix}, \qquad v_2=\frac{1}{\sqrt2}\begin{bmatrix}1\\-1\end{bmatrix}.

They are orthonormal, so

Q=12[111−1]Q=\frac{1}{\sqrt2}\begin{bmatrix}1&1\\1&-1\end{bmatrix}

is orthogonal. With

D=[3001],D=\begin{bmatrix}3&0\\0&1\end{bmatrix},

we have

QTAQ=D.Q^TAQ=D.

Why symmetry matters

For arbitrary real matrices, eigenvectors need not exist in sufficient number, and even when all eigenvalues exist, the matrix need not be diagonalizable. Symmetry forces the orthogonal-complement argument above to work at every stage.

It also implies that eigenvectors belonging to distinct eigenvalues are automatically orthogonal. If Au=λuAu=\lambda u and Av=μvAv=\mu v, then

λuTv=(Au)Tv=uTATv=uTAv=μuTv.\lambda u^Tv=(Au)^Tv=u^TA^Tv=u^TAv=\mu u^Tv.

Thus (λ−μ)uTv=0(\lambda-\mu)u^Tv=0. When λ≠μ\lambda\ne\mu, this gives uTv=0u^Tv=0.

Common convention issue: real versus complex matrices

The statement is correct for a real symmetric matrix, meaning AT=AA^T=A with real entries. For complex matrices, the corresponding condition is Hermitian:

A∗=A,A^*=A,

where A∗A^* is the conjugate transpose. Every complex Hermitian matrix is unitarily diagonalizable.

A complex matrix can satisfy AT=AA^T=A without being diagonalizable. For example,

B=[1ii−1]B=\begin{bmatrix}1&i\\i&-1\end{bmatrix}

is complex symmetric, but

B2=0B^2=0

while B≠0B\ne0. Hence its only eigenvalue is 00, and it cannot be diagonalizable: a diagonalizable matrix with only eigenvalue 00 would have to be the zero matrix.

References

  1. Linear Algebra Done Right, Sheldon Axler
  2. Matrix Analysis, Roger A. Horn and Charles R. Johnson

Spotted an error? Send a correction. Read how we write and check articles in our editorial policy.