Linear independence

In linear algebra, a set of elements of a vector space is linearly independent if none of the vectorss in the set can be written as a linear combination of finitely many other vectors in the set. For instance, in three-dimensional Euclidean space R³, the three vectors (1, 0, 0), (0, 1, 0) and (0, 0, 1) are linearly independent, while (2, -1, 1), (1, 0, 1) and (3, -1, 2) are not (since the third vector is the sum of the first two). Vectors which are not linearly independent are called linearly dependent.

Table of contents

1 Definition
2 Example I
3 Example II
4 Example III: (Calculus required)

Definition

Let V be a vector space over a field K. If v₁,v₂,..,v_n are elements of V, we say that they are linearly dependent over K if there exist elements a₁,a₂,..,a_n in K not all equal to zero such that:

or, more concisely:

(Note that the zero on the right is the zero element in V, not the zero element in K.)

If there do not exist such field elements, then we say that v₁,v₂,...,v_n are linearly independent. An infinite subset of V is said to linearly independent if all its finite subsets are linearly independent.

To focus the definition on linear independence, we can say that the vectors v₁,v₂,..,v_n are linearly independent, if and only if the following condition is satisfied:

Whenever a₁,a₂,...,a_n are elements of K such that:

a₁v₁ + a₂v₂ + ... + a_nv_n = 0

then a_i = 0 for all i=1,2,...,n.

The concept of linear independence is important because a set of vectors which is linearly independent and spans some vector space, forms a basis for that vector space.

Example I

Show that the vectors (1,1) and (-3,2) in R² are linearly independent.

Proof:

Let a, b be two real numbers such that:

a(1,1) + b(-3,2) = (0,0)

Then:

(a-3b,a+2b) = (0,0) and

a-3b = 0 and a+2b = 0.

Solving for a and b, we find that a = 0 and b = 0.

Example II

Let V=Rⁿ and consider the following elements in V:

Then e₁,e₂,...,e_n are linearly independent.

Proof:

Suppose that a₁, a₂, ,a_n are elements of Rⁿ such that

a₁e₁ + a₂e₂ + ... + a_ne_n = 0

Since

a₁e₁ + a₂e₂ + .. + a_ne_n = (a₁,a₂,..,a_n)

then a_i = 0 for all i in {1,..,n}.

Example III: (Calculus required)

Let V be the vector space of all functions of a real variable t. Then the functions e^t and e^2t in V are linearly independent.

Proof:

Suppose a and b are two real numbers such that

ae^t + be^2t = 0 (1)

for all values of t. We need to show that a=0 and b=0. In order to do this,

we differentiate equation (1) to get

ae^t + 2be^2t = 0 (2)

which also holds for all values of t.

Subtracting the first relation from the second relation, we obtain:

be^2t = 0

and, by plugging in t = 0, we get b = 0.

From the first relation we then get:

ae^t = 0

and again for t = 0 we find a = 0.

A linear dependence among vectors v₁,...,v_n is a vector (a₁,...,a_n) with n scalar components, not all zero, such that a₁v₁+...+a_nv_n=0. If such a linear dependence exists, then the n vectors are linearly dependent. It makes sense to identify two linear dependences if one arises as a non-zero multiple of the other, because in this case the two describe the same linear relationship among the vectors. Under this identification, the set of all linear dependences among v₁, ...., v_n is a projective space.