Lukas' Notes

A linear operator takes vectors in a space and sends them back into the same space. Most vectors are moved to a different direction. An eigenvector is the special case where the direction survives.

The equation is small:

The operator acts on , but the result stays on the same line through . The scalar records what happened along that line: stretch, shrink, sign flip, or collapse.

Direction is the invariant part

A general vector can be turned, sheared, or mixed with other directions. An eigenvector is not protected from scaling, but it is protected from being turned away from its own line.

The non-zero condition matters. The zero vector always satisfies , but it carries no direction. Eigenvectors are direction carriers, so is excluded.

The eigenvalue is the scale factor

Once the direction survives, the only remaining question is how the vector changed along that direction. That number is the eigenvalue.

For an eigenvector ,

Different signs and sizes of mean different one-dimensional behaviours:

value of effect on an eigenvector
stretches along the same direction
shrinks along the same direction
leaves unchanged
sends to
flips direction and scales

The eigenvalue belongs to the direction, not just to one vector. If is an eigenvector for , then any non-zero scalar multiple is also an eigenvector for the same :

So the real object is often the whole line, or more generally the whole subspace, of vectors sharing the same scale factor.

Eigenspaces collect all directions with the same scale

Fix a scalar . The eigenspace for is the set of vectors on which behaves exactly like scalar multiplication by :

This set includes , even though is not an eigenvector. That is useful: with included, becomes a subspace.

If , then

So any linear combination of vectors in stays in .

An eigenspace is therefore not a pile of unrelated eigenvectors. It is the whole subspace where the operator acts like the simple operation .

Subtract the simple part

The equation

says that two actions agree on : applying and scaling by . Move them to one side:

Using the identity operator , this becomes

So the eigenspace is a kernel:

This is the practical test. A scalar is an eigenvalue exactly when has a non-zero vector in its kernel. For a matrix , this becomes

A non-zero solution means that collapses some direction to zero. That direction is an eigenvector of .

The geometric picture

Eigenvectors are the directions where the operator becomes one-dimensional. On an eigenspace, the complicated operator behaves like the simple scalar operator .

That is the core compression:

Eigenvalues name the scaling. Eigenvectors carry the directions. Eigenspaces collect all vectors that share the same scaling behaviour.