Skip to content
Math Analysis 1

The Bolzano-Weierstrass theorem: statement and proof

Every bounded sequence has a convergent subsequence: proof by bisection, common mistakes, examples and what the theorem is used for in the rest of the course.

A bounded sequence does not have to converge: 1, -1, 1, -1, \dots stays between -1 and 1 forever without settling on any value. But if we look only at the terms in even positions we get the constant sequence 1, 1, 1, \dots, which converges. The Bolzano-Weierstrass theorem says this always happens: from a bounded sequence you can always extract a convergent subsequence.

Statement

Every bounded real sequence (x_n) has a subsequence (x_{n_k}), with n_1 < n_2 < n_3 < \dots, that converges to a real number L.

A subsequence is obtained by choosing infinitely many terms of the sequence in the order in which they appear: you may skip terms, but you cannot go back.

Proof by bisection

Since the sequence is bounded, all its terms lie in an interval I_0 = [a_0, b_0]. The idea is to halve the interval again and again, each time keeping a half that contains infinitely many terms of the sequence.

  1. Split I_0 in half. At least one of the two halves contains x_n for infinitely many indices n (if both contained only finitely many, the sequence would have finitely many terms). Call I_1 = [a_1, b_1] a half with this property.
  2. Repeat: from I_k get I_{k+1}, half as long, still containing infinitely many terms. The length is b_k - a_k = \dfrac{b_0 - a_0}{2^k}.
  3. Pick the indices: n_1 such that x_{n_1} \in I_1; then n_2 > n_1 with x_{n_2} \in I_2, and so on. This is always possible, because I_k contains infinitely many terms and therefore one with an index larger than the previous choice.

The left endpoints a_k form an increasing bounded sequence, so they converge to a limit L by the completeness of the real numbers. Also b_k \to L, because b_k - a_k \to 0. Finally a_k \le x_{n_k} \le b_k, and by the squeeze theorem x_{n_k} \to L. ∎

It is the same technique used for the intermediate zero theorem: build nested intervals, and completeness guarantees that they “point” to a real number.

A common mistake in proofs

You sometimes read: “the interval is compact, so the sequence has an accumulation point, so it has a convergent subsequence”. In a first calculus course this is circular, because the fact that closed bounded intervals are sequentially compact is the Bolzano-Weierstrass theorem. Another mistake is to pick terms “close to L” without saying how: you must make sure the indices are strictly increasing, and the bisection construction is there precisely for that.

Examples

  • x_n = (-1)^n: the even terms give 1, the odd terms -1. Two subsequences with different limits, so the sequence does not converge.
  • x_n = \sin n: it is bounded between -1 and 1, and the theorem guarantees a convergent subsequence, even though finding one explicitly is not easy.
  • x_n = n: not bounded, and indeed no subsequence converges. The hypothesis matters.

What it is for

The theorem is one of the building blocks of first-year calculus. It is used to prove the extreme value theorem: a continuous function on a closed bounded interval has a maximum and a minimum. You take a sequence of points where f approaches its supremum, extract a convergent subsequence and use continuity. It is also used to prove that Cauchy sequences converge and, later on, that a continuous function on a closed interval is uniformly continuous.

In engineering it shows up in a less visible but constant way: whenever an iterative algorithm produces a bounded sequence of estimates (an optimisation, an adaptive filter), the theorem guarantees that at least some subsequence settles on a value. Proving that the whole sequence converges takes an extra argument.

Subscribe
Notify of
guest
0 Comments
Oldest
Newest Most Voted
0
Would love your thoughts, please comment.x
()
x