Vector Spaces
Definition (Vector Space)Let F be a field. A vector space over F is a nonempty set V equipped with two operations
V×V⟶V,(u,v)⟼u+v,called vector addition, and
F×V⟶V,(a,v)⟼av,called scalar multiplication.
These operations satisfy the following axioms for all u,v,w∈V and all a,b∈F:
- (u+v)+w=u+(v+w).
- u+v=v+u.
- There exists 0V∈V such that v+0V=v.
- For every v∈V, there exists −v∈V such that v+(−v)=0V.
- a(bv)=(ab)v.
- 1Fv=v.
- a(u+v)=au+av.
- (a+b)v=av+bv.
The elements of V are called vectors, and the elements of F are called scalars.
The standard example is
Fn=F×⋯×F={(x1,…,xn)∣xi∈F}.
For a∈Fn, we write its coordinates as a=(a1,…,an).
Subspaces
Definition (Subspace)A subset U⊆V is called a subspace of V if U is itself a vector space over the same field F, using the addition and scalar multiplication inherited from V.
Equivalently, a nonempty subset U⊆V is a subspace if
u,v∈U, a,b∈F⟹au+bv∈U.
This single closure condition is usually the most efficient way to check that a subset is a subspace.
Sums and Direct Sums
Let V1,…,Vn⊆V be subspaces. Their sum is
V1+⋯+Vn:={v1+⋯+vn∣vi∈Vi, i=1,…,n}.
If for every i∈{1,…,n},
Vi∩(V1+⋯+Vi−1+Vi+1+⋯+Vn)={0},
then this sum is called a direct sum, and we write
V1⊕⋯⊕Vn=V1+⋯+Vn.
Theorem (Minimality of the Sum)The subspace V1+⋯+Vn is the smallest subspace of V containing V1,…,Vn.
Proof.Clearly V1+⋯+Vn is a subspace and contains every Vi.
Now let U⊆V be any subspace containing V1,…,Vn. If vi∈Vi for all i, then each vi∈U. Since U is closed under addition,
v1+⋯+vn∈U.Thus V1+⋯+Vn⊆U, so it is contained in every subspace containing all the Vi.
■
Theorem (Uniqueness in Direct Sums)If v∈V1⊕⋯⊕Vn, then v can be written in exactly one way as
v=v1+⋯+vn,vi∈Vi.
Proof.Suppose
v1+⋯+vn=u1+⋯+un,ui,vi∈Vi.Then
(u1−v1)+⋯+(un−vn)=0.Fix i. Rearranging gives
ui−vi=−j=i∑(uj−vj).The left side lies in Vi, while the right side lies in ∑j=iVj. Since the sum is direct,
Vi∩j=i∑Vj={0}.Hence ui−vi=0. This holds for every i, so ui=vi for all i.
■
Span and Linear Independence
Let V be a vector space and let v1,…,vn∈V. The span of these vectors is
span(v1,…,vn)={a1v1+⋯+anvn∣ai∈F}.
The vectors v1,…,vn are linearly independent if
a1v1+⋯+anvn=0⟹a1=⋯=an=0.
They are linearly dependent if there is a nontrivial relation
a1v1+⋯+anvn=0
with at least one coefficient ai nonzero.
Definition (Basis)A set β={v1,…,vn} is a basis of V if it is linearly independent and
span(β)=V.When V has a finite basis with n elements, we call n the dimension of V and write dimV=n.
More generally, a subset U⊆V is linearly independent if every finite subset of U is linearly independent. It is a spanning set of V if every vector v∈V can be written as a finite linear combination of elements of U.
For arbitrary vector spaces, bases need not be finite. Such bases are often called Hamel bases.
Zorn's Lemma and Hamel Bases
Lemma (Zorn's Lemma)Let (P,≤) be a partially ordered set. Suppose every chain C⊆P has an upper bound in P. Then P contains a maximal element.
Zorn's lemma is one of the standard forms of the axiom of choice. It is exactly the kind of tool that lets us prove existence theorems where no explicit construction is available.
Theorem (Hamel's Theorem)Every vector space V has a basis.
Proof.Let
P={S⊆V∣S is linearly independent},ordered by inclusion. Since ∅ is linearly independent, P is nonempty.
Let C⊆P be a chain, and define
P=S∈C⋃S.We claim that P is linearly independent. Indeed, take finitely many vectors u1,…,um∈P and suppose
a1u1+⋯+amum=0.For each i, choose Si∈C such that ui∈Si. Since C is a chain, among the finitely many Si there is one that contains all the others. Hence all ui lie in a single linearly independent set from the chain, so a1=⋯=am=0.
Thus P∈P and P is an upper bound for C. By Zorn's lemma, P has a maximal element M.
We now show that span(M)=V. Suppose not. Choose
v∈V∖span(M).Then M∪{v} is linearly independent: if
av+a1u1+⋯+amum=0,ui∈M,and a=0, then
v=−aa1u1−⋯−aamum,which would put v in span(M), a contradiction. Therefore a=0, and the independence of M forces a1=⋯=am=0.
So M∪{v} is a strictly larger linearly independent set, contradicting the maximality of M. Hence M spans V, and therefore it is a basis of V.
■
Exchange and Complements
Theorem (Steinitz Exchange Lemma)Let V be a vector space. Suppose U⊆V is linearly independent and W⊆V spans V. Then there exists a subset W′⊆W such that
U∪W′is a basis of V.
Proof.Consider the partially ordered set
P={S⊆W∣U∪S is linearly independent},ordered by inclusion. By the same chain-union argument used in Hamel's theorem, every chain in P has an upper bound in P. Zorn's lemma gives a maximal element W′⊆W.
We claim U∪W′ spans V. If not, since W spans V, there must be some w∈W not lying in span(U∪W′). Then
U∪W′∪{w}is still linearly independent, contradicting the maximality of W′. Therefore U∪W′ is both linearly independent and spanning, so it is a basis of V.
■
Corollary (Complements of Subspaces)Let V be a finite-dimensional vector space and let U⊆V be a subspace. Then there exists a subspace W⊆V such that
U⊕W=V.
Proof.Choose a basis {u1,…,uk} of U. Since this set is linearly independent in V, the exchange lemma extends it to a basis
{u1,…,uk,w1,…,wm}of V. Define
W=span(w1,…,wm).Every vector in V is a sum of something in U and something in W, so U+W=V. The intersection U∩W is trivial because the displayed basis is linearly independent. Hence
U⊕W=V.■