← all posts

Vector Spaces

2026-07-27·6 min read·

A first pass through vector spaces: subspaces, direct sums, linear independence, bases, Zorn's lemma, and the existence of complements.

Vector Spaces

Definition (Vector Space)

Let F\mathbb{F} be a field. A vector space over F\mathbb{F} is a nonempty set VV equipped with two operations

V×V⟶V,(u,v)⟼u+v,V \times V \longrightarrow V, \qquad (u,v) \longmapsto u+v,

called vector addition, and

F×V⟶V,(a,v)⟼av,\mathbb{F} \times V \longrightarrow V, \qquad (a,v) \longmapsto av,

called scalar multiplication.

These operations satisfy the following axioms for all u,v,w∈Vu,v,w \in V and all a,b∈Fa,b \in \mathbb{F}:

  1. (u+v)+w=u+(v+w)(u+v)+w = u+(v+w).
  2. u+v=v+uu+v = v+u.
  3. There exists 0V∈V0_V \in V such that v+0V=vv+0_V = v.
  4. For every v∈Vv \in V, there exists −v∈V-v \in V such that v+(−v)=0Vv+(-v)=0_V.
  5. a(bv)=(ab)va(bv)=(ab)v.
  6. 1Fv=v1_{\mathbb{F}}v=v.
  7. a(u+v)=au+ava(u+v)=au+av.
  8. (a+b)v=av+bv(a+b)v=av+bv.

The elements of VV are called vectors, and the elements of F\mathbb{F} are called scalars.

The standard example is

Fn=F×⋯×F={(x1,…,xn)∣xi∈F}.\mathbb{F}^n = \mathbb{F}\times \cdots \times \mathbb{F} = \{(x_1,\ldots,x_n) \mid x_i \in \mathbb{F}\}.

For a∈Fna \in \mathbb{F}^n, we write its coordinates as a=(a1,…,an)a=(a_1,\ldots,a_n).

Subspaces

Definition (Subspace)

A subset U⊆VU \subseteq V is called a subspace of VV if UU is itself a vector space over the same field F\mathbb{F}, using the addition and scalar multiplication inherited from VV.

Equivalently, a nonempty subset U⊆VU \subseteq V is a subspace if

u,v∈U, a,b∈F⟹au+bv∈U.u,v \in U,\ a,b \in \mathbb{F} \quad\Longrightarrow\quad au+bv \in U.

This single closure condition is usually the most efficient way to check that a subset is a subspace.

Sums and Direct Sums

Let V1,…,Vn⊆VV_1,\ldots,V_n \subseteq V be subspaces. Their sum is

V1+⋯+Vn:={v1+⋯+vn∣vi∈Vi, i=1,…,n}.V_1+\cdots+V_n := \{v_1+\cdots+v_n \mid v_i \in V_i,\ i=1,\ldots,n\}.

If for every i∈{1,…,n}i \in \{1,\ldots,n\},

Vi∩(V1+⋯+Vi−1+Vi+1+⋯+Vn)={0},V_i \cap \left(V_1+\cdots+V_{i-1}+V_{i+1}+\cdots+V_n\right) = \{0\},

then this sum is called a direct sum, and we write

V1⊕⋯⊕Vn=V1+⋯+Vn.V_1 \oplus \cdots \oplus V_n = V_1+\cdots+V_n.
Theorem (Minimality of the Sum)

The subspace V1+⋯+VnV_1+\cdots+V_n is the smallest subspace of VV containing V1,…,VnV_1,\ldots,V_n.

Proof.

Clearly V1+⋯+VnV_1+\cdots+V_n is a subspace and contains every ViV_i.

Now let U⊆VU \subseteq V be any subspace containing V1,…,VnV_1,\ldots,V_n. If vi∈Viv_i \in V_i for all ii, then each vi∈Uv_i \in U. Since UU is closed under addition,

v1+⋯+vn∈U.v_1+\cdots+v_n \in U.

Thus V1+⋯+Vn⊆UV_1+\cdots+V_n \subseteq U, so it is contained in every subspace containing all the ViV_i.

■
Theorem (Uniqueness in Direct Sums)

If v∈V1⊕⋯⊕Vnv \in V_1 \oplus \cdots \oplus V_n, then vv can be written in exactly one way as

v=v1+⋯+vn,vi∈Vi.v=v_1+\cdots+v_n, \qquad v_i \in V_i.
Proof.

Suppose

v1+⋯+vn=u1+⋯+un,ui,vi∈Vi.v_1+\cdots+v_n = u_1+\cdots+u_n, \qquad u_i,v_i \in V_i.

Then

(u1−v1)+⋯+(un−vn)=0.(u_1-v_1)+\cdots+(u_n-v_n)=0.

Fix ii. Rearranging gives

ui−vi=−∑j≠i(uj−vj).u_i-v_i = -\sum_{j\neq i}(u_j-v_j).

The left side lies in ViV_i, while the right side lies in ∑j≠iVj\sum_{j\neq i}V_j. Since the sum is direct,

Vi∩∑j≠iVj={0}.V_i \cap \sum_{j\neq i}V_j = \{0\}.

Hence ui−vi=0u_i-v_i=0. This holds for every ii, so ui=viu_i=v_i for all ii.

■

Span and Linear Independence

Let VV be a vector space and let v1,…,vn∈Vv_1,\ldots,v_n \in V. The span of these vectors is

span⁡(v1,…,vn)={a1v1+⋯+anvn∣ai∈F}.\operatorname{span}(v_1,\ldots,v_n) = \{a_1v_1+\cdots+a_nv_n \mid a_i \in \mathbb{F}\}.

The vectors v1,…,vnv_1,\ldots,v_n are linearly independent if

a1v1+⋯+anvn=0⟹a1=⋯=an=0.a_1v_1+\cdots+a_nv_n=0 \quad\Longrightarrow\quad a_1=\cdots=a_n=0.

They are linearly dependent if there is a nontrivial relation

a1v1+⋯+anvn=0a_1v_1+\cdots+a_nv_n=0

with at least one coefficient aia_i nonzero.

Definition (Basis)

A set β={v1,…,vn}\beta=\{v_1,\ldots,v_n\} is a basis of VV if it is linearly independent and

span⁡(β)=V.\operatorname{span}(\beta)=V.

When VV has a finite basis with nn elements, we call nn the dimension of VV and write dim⁡V=n\dim V=n.

More generally, a subset U⊆VU \subseteq V is linearly independent if every finite subset of UU is linearly independent. It is a spanning set of VV if every vector v∈Vv \in V can be written as a finite linear combination of elements of UU.

For arbitrary vector spaces, bases need not be finite. Such bases are often called Hamel bases.

Zorn's Lemma and Hamel Bases

Lemma (Zorn's Lemma)

Let (P,≤)(\mathcal{P},\leq) be a partially ordered set. Suppose every chain C⊆P\mathcal{C}\subseteq\mathcal{P} has an upper bound in P\mathcal{P}. Then P\mathcal{P} contains a maximal element.

Zorn's lemma is one of the standard forms of the axiom of choice. It is exactly the kind of tool that lets us prove existence theorems where no explicit construction is available.

Theorem (Hamel's Theorem)

Every vector space VV has a basis.

Proof.

Let

P={S⊆V∣S is linearly independent},\mathcal{P} = \{S \subseteq V \mid S \text{ is linearly independent}\},

ordered by inclusion. Since ∅\varnothing is linearly independent, P\mathcal{P} is nonempty.

Let C⊆P\mathcal{C}\subseteq\mathcal{P} be a chain, and define

P=⋃S∈CS.P=\bigcup_{S\in\mathcal{C}}S.

We claim that PP is linearly independent. Indeed, take finitely many vectors u1,…,um∈Pu_1,\ldots,u_m \in P and suppose

a1u1+⋯+amum=0.a_1u_1+\cdots+a_mu_m=0.

For each ii, choose Si∈CS_i \in \mathcal{C} such that ui∈Siu_i \in S_i. Since C\mathcal{C} is a chain, among the finitely many SiS_i there is one that contains all the others. Hence all uiu_i lie in a single linearly independent set from the chain, so a1=⋯=am=0a_1=\cdots=a_m=0.

Thus P∈PP\in\mathcal{P} and PP is an upper bound for C\mathcal{C}. By Zorn's lemma, P\mathcal{P} has a maximal element M\mathcal{M}.

We now show that span⁡(M)=V\operatorname{span}(\mathcal{M})=V. Suppose not. Choose

v∈V∖span⁡(M).v \in V \setminus \operatorname{span}(\mathcal{M}).

Then M∪{v}\mathcal{M}\cup\{v\} is linearly independent: if

av+a1u1+⋯+amum=0,ui∈M,av+a_1u_1+\cdots+a_mu_m=0, \qquad u_i\in\mathcal{M},

and a≠0a\neq 0, then

v=−a1au1−⋯−amaum,v=-\frac{a_1}{a}u_1-\cdots-\frac{a_m}{a}u_m,

which would put vv in span⁡(M)\operatorname{span}(\mathcal{M}), a contradiction. Therefore a=0a=0, and the independence of M\mathcal{M} forces a1=⋯=am=0a_1=\cdots=a_m=0.

So M∪{v}\mathcal{M}\cup\{v\} is a strictly larger linearly independent set, contradicting the maximality of M\mathcal{M}. Hence M\mathcal{M} spans VV, and therefore it is a basis of VV.

■

Exchange and Complements

Theorem (Steinitz Exchange Lemma)

Let VV be a vector space. Suppose U⊆VU\subseteq V is linearly independent and W⊆VW\subseteq V spans VV. Then there exists a subset W′⊆WW'\subseteq W such that

U∪W′U\cup W'

is a basis of VV.

Proof.

Consider the partially ordered set

P={S⊆W∣U∪S is linearly independent},\mathcal{P} = \{S\subseteq W \mid U\cup S \text{ is linearly independent}\},

ordered by inclusion. By the same chain-union argument used in Hamel's theorem, every chain in P\mathcal{P} has an upper bound in P\mathcal{P}. Zorn's lemma gives a maximal element W′⊆WW'\subseteq W.

We claim U∪W′U\cup W' spans VV. If not, since WW spans VV, there must be some w∈Ww\in W not lying in span⁡(U∪W′)\operatorname{span}(U\cup W'). Then

U∪W′∪{w}U\cup W'\cup\{w\}

is still linearly independent, contradicting the maximality of W′W'. Therefore U∪W′U\cup W' is both linearly independent and spanning, so it is a basis of VV.

■
Corollary (Complements of Subspaces)

Let VV be a finite-dimensional vector space and let U⊆VU\subseteq V be a subspace. Then there exists a subspace W⊆VW\subseteq V such that

U⊕W=V.U\oplus W=V.
Proof.

Choose a basis {u1,…,uk}\{u_1,\ldots,u_k\} of UU. Since this set is linearly independent in VV, the exchange lemma extends it to a basis

{u1,…,uk,w1,…,wm}\{u_1,\ldots,u_k,w_1,\ldots,w_m\}

of VV. Define

W=span⁡(w1,…,wm).W=\operatorname{span}(w_1,\ldots,w_m).

Every vector in VV is a sum of something in UU and something in WW, so U+W=VU+W=V. The intersection U∩WU\cap W is trivial because the displayed basis is linearly independent. Hence

U⊕W=V.U\oplus W=V.
■
2026-07-27

comments

loading...

leave a note