Dimension
The dimension of a vector space is the number of vectors in any basis — a single number that counts its independent directions, equals the rank of any spanning set, and is the same no matter which basis you pick.
Before you start — give these a try
Attempting first primes your brain for the lesson — even if you miss. Nothing is graded or saved; it's just a warm-up.
Find the dimension of in .
True or False: In , any set of vectors must be linearly dependent.
What you’ll be able to do
- Define the dimension of a vector space as the number of vectors in any one of its bases, and state that .
- Explain why dimension is well-defined: any two bases of the same space contain the same number of vectors.
- Compute the dimension of a span by finding the number of linearly independent vectors (the rank) via row reduction.
- Determine the dimension of a subspace described by linear equations by counting independent constraints.
- Use dimension to decide quickly when a set of vectors must be linearly dependent or cannot span.
In your course
· MATH2015 · Linear Algebra & Probability- Definition 2.7Dimension,
- Theorem 2.3Counting vs. the dimensionIf : more than vectors are always dependent, and fewer than can never span — so for exactly vectors you only need to check one of spanning / independence.
- Theorem 2.6All bases have the same size
Dimension counts degrees of freedom
Before any formulas, here is the picture to carry in your head: dimension measures how many independent directions a space has, equivalently how many numbers you need to pin down a single point in it.
- A line through the origin has one direction. Once you fix how far along the line you are (one number), the point is determined. It is 1-dimensional.
- A plane through the origin has two independent directions. You need two numbers (how far in each direction) to locate a point. It is 2-dimensional.
- All of (the set of lists of real numbers ) needs exactly coordinates, so it is -dimensional.
The subtle word is independent. If you offer three directions in a plane, one of them is redundant — it can be built from the other two — so the plane is still 2-dimensional, not 3. Dimension is the number of genuinely independent directions, with every redundancy removed. A basis is exactly a list of directions that is both non-redundant (linearly independent) and complete (spans the whole space), and the dimension is simply how many vectors are in that list.
The formal definition
Recall that a basis of a vector space is a set of vectors that is
- linearly independent — no vector in is a linear combination of the others (the only way to write is ), and
- spanning — every vector in can be written as some linear combination .
Definition. The dimension of a (finite-dimensional) vector space , written , is the number of vectors in any basis of .
Key facts that follow immediately:
- . The standard basis has exactly vectors, is independent, and spans .
- . The space containing only the zero vector has the empty set as its basis — zero vectors.
- A space is called finite-dimensional when it has a basis with finitely many vectors; that number is its dimension. (Spaces that need infinitely many basis vectors are infinite-dimensional, but every example in this lesson is finite-dimensional.)
Notice the definition says "any basis." For this to make sense, every basis must have the same number of vectors — otherwise would be ambiguous. That is the content of the next section.
Why dimension is well-defined: all bases are the same size
The definition would be useless if one basis of had 2 vectors and another had 3. Thankfully, this never happens.
Invariance of dimension. In a finite-dimensional vector space, any two bases have exactly the same number of vectors.
The engine behind this is a counting fact you should internalize, because it is useful on its own:
If a space has a basis of vectors, then any set of more than vectors in is linearly dependent, and any set of fewer than vectors cannot span .
Intuitively: a basis of size fixes the number of independent directions at . You can never fit more than independent vectors (so a bigger set must have a redundancy — it is dependent), and you can never reach every point with fewer than directions (so a smaller set cannot span). Squeeze these two bounds together and every basis is forced to have exactly vectors. (The classical argument that makes this precise is the replacement or exchange lemma, which swaps basis vectors for new ones one at a time.)
Why you care in practice: this gives instant answers.
- Five vectors in ? Must be dependent — .
- Two vectors spanning ? Impossible — .
- Exactly vectors in that are independent? They automatically span, so they are a basis (and vice versa).
Computing dimension: it equals the rank
Most problems give you a subspace in one of two forms. Here is how to read off its dimension in each.
Form 1 — a span (a spanning set is given). The subspace is . Then The rank is the maximum number of linearly independent vectors in the set. To find it:
- Form a matrix using the vectors as its rows.
- Row reduce to echelon form (Gaussian elimination).
- Count the nonzero rows (equivalently, the pivots). That count is the rank, and it is .
Row operations never change the row space, so the number of nonzero rows is exactly the number of independent directions. Redundant vectors collapse to zero rows and drop out.
Form 2 — a subspace defined by linear equations. If is the solution set of a system of independent (non-redundant) homogeneous linear equations, then Each independent equation removes one degree of freedom. For example, one nontrivial equation like in cuts the dimension from down to (a plane). Two independent equations cut it to (a line). Caution: the equations must be independent — two equations that are multiples of each other count as one constraint.
Sanity checks for any answer: a subspace of always has dimension between and ; dimension means , and dimension means .
For a finite-dimensional vector space , the dimension is the number of vectors in any basis of . In particular and .
Any two bases of a finite-dimensional vector space contain the same number of vectors. Consequently, if , then every set of more than vectors in is linearly dependent, and every set of fewer than vectors fails to span .
For , the dimension equals the rank of the set — the maximum number of linearly independent vectors among the — found by forming the matrix with these vectors as rows and counting the nonzero rows (pivots) after row reduction.
Worked examples
Find the dimension of in , where , , and .
- 1
Choose the method. The subspace is given as a span, so by the theorem equals the number of linearly independent vectors among — i.e. the rank. We find the rank by forming the matrix whose rows are these vectors and row-reducing.
- 2
Set up the matrix. Writing each vector as a row gives
- 3
Eliminate below the first pivot (the leading in row 1). Replace row 2 with : . Replace row 3 with : . The matrix becomes
- 4
Tidy into echelon form. Swap the zero row to the bottom so the pivots step down nicely: There are pivots in row 1 (the ) and row 2 (the ).
- 5
Count the nonzero rows. Two rows are nonzero, so the rank is . Therefore .
- 6
Interpret. The zero row came from , i.e. is redundant. The surviving independent directions are and , and is a basis of . (Sanity check: , so a dimension-2 subspace of is perfectly reasonable — it is a plane through the origin.)
Find the dimension of the subspace .
Find the dimension of in .