๐Ÿงฎ Brain Teaser
Probability
The Cliff-Hanger
2026-10-21
โœ๏ธŽ

The Cliff-Hanger

A drunk man stands one step from the edge of a cliff. Each step is independent of all the others. With probability pp he steps toward the cliff, and with probability q=1โˆ’pq = 1-p he steps away from it. His position is an integer distance kโ‰ฅ0k \ge 0 from the edge, and he falls as soon as he reaches k=0k = 0.

  1. Take p=13p = \tfrac13. What is the probability that he eventually falls off the cliff?
  2. More generally, find the probability of falling as a function of pp.

You can probably write down a quadratic equation that the answer must satisfy. That equation has two roots, and one of them is always 11. The real content of the problem is to explain rigorously which root is the correct one.


Field: Probability (random walks, first-passage problems)

Why it's interesting: The man is twice as likely to walk away from the cliff as toward it. Even so, he falls with probability exactly 12\tfrac12. The solution uses a self-similarity trick that reduces an infinite-state problem to one quadratic equation. It then raises a subtle question that is easy to skip: the equation alone cannot tell you the answer. This "smallest fixed point" phenomenon shows up again in branching processes (extinction probabilities) and in Catalan-number generating functions.

Difficulty: 2 / 5

Source: Mosteller, Fifty Challenging Problems in Probability with Solutions, Problem 35 ("The Cliff-Hanger").

random walkfirst-step analysisself-similaritysmallest fixed pointstrong Markov property

Answer: The Cliff-Hanger

Key Idea / Intuition

Self-similarity. To fall from distance 2, the man must first get from 2 to 1, and then fall from 1. The walk is translation-invariant, so "getting from 2 to 1" is an exact copy of "getting from 1 to 0". The two stages are also independent. So if PP is the probability of ever falling from distance 1, the probability of ever falling from distance 2 is P2P^2.

One-step equation. Conditioning on the first step then gives a quadratic for PP. Its roots are 11 and p/qp/q.

Choosing the root. The quadratic does not say which root is right. We pin it down by showing that the true probability lies below every nonnegative root. The true probability is built up from below, as the probability of falling within nn steps for larger and larger nn. So it lands on the smallest root, not the largest.

Answer. For p=13p = \tfrac13, the probability of falling is 12\tfrac12. In general it is minโก(1,p/q)\min(1, p/q).


Formal Proof / Solution

Setup. Let PkP_k be the probability of ever reaching 00 when starting from position kโ‰ฅ1k \ge 1.

Step 1: P2=P12P_2 = P_1^2. Any path from 22 to 00 moves by ยฑ1\pm 1, so it must pass through 11.

  • Let TT be the first time the walk hits 11. Then Prโก(T<โˆž)\Pr(T<\infty) is the probability of ever moving one unit closer. By translation invariance, this equals P1P_1.
  • By the strong Markov property, the walk after time TT is a fresh walk started at 11, independent of the past. It reaches 00 with probability P1P_1.

Hence P2=P1โ‹…P1=P12P_2 = P_1 \cdot P_1 = P_1^2. The same argument gives Pk=P1kP_k = P_1^k for every kโ‰ฅ1k \ge 1.

Step 2: First-step analysis. From position 11, he falls immediately with probability pp. Otherwise, with probability qq, he moves to position 22. Therefore P1=p+qโ€‰P12โŸบqx2โˆ’x+p=0(x=P1).P_1 = p + q\,P_1^2 \quad\Longleftrightarrow\quad qx^2 - x + p = 0 \quad (x = P_1). Factor using p+q=1p + q = 1: qx2โˆ’x+p=(xโˆ’1)(qxโˆ’p),qx^2 - x + p = (x-1)(qx - p), so the roots are x=1andx=pq.x = 1 \qquad\text{and}\qquad x = \frac{p}{q}.

Step 3: Which root? Let xโ‰ฅ0x \ge 0 be any nonnegative solution of x=p+qx2x = p + qx^2. We claim P1โ‰คxP_1 \le x.

Define un(k)u_n(k) as the probability of hitting 00 within nn steps, starting from kk. Set un(0)=1u_n(0) = 1 for all nn.

We prove un(k)โ‰คxku_n(k) \le x^k for all nโ‰ฅ0n \ge 0 and kโ‰ฅ0k \ge 0, by induction on nn.

  • Base case n=0n = 0. We have u0(0)=1=x0u_0(0) = 1 = x^0, and u0(k)=0โ‰คxku_0(k) = 0 \le x^k for kโ‰ฅ1k \ge 1.
  • Inductive step. For kโ‰ฅ1k \ge 1, condition on the first step: un+1(k)=pโ€‰un(kโˆ’1)+qโ€‰un(k+1)โ‰คpโ€‰xkโˆ’1+qโ€‰xk+1=xkโˆ’1(p+qx2)=xkโˆ’1โ‹…x=xk.u_{n+1}(k) = p\,u_n(k-1) + q\,u_n(k+1) \le p\,x^{k-1} + q\,x^{k+1} = x^{k-1}\bigl(p + qx^2\bigr) = x^{k-1}\cdot x = x^k. For k=0k = 0 the bound un+1(0)=1=x0u_{n+1}(0) = 1 = x^0 holds trivially.

The events "fall within nn steps" increase with nn, and their union is "eventually fall". So by continuity of probability, P1=limโกnโ†’โˆžun(1)โ‰คx.P_1 = \lim_{n\to\infty} u_n(1) \le x.

Step 4: Conclusion. By Step 2, P1P_1 is itself a root. By Step 3, it is at most every nonnegative root. So P1P_1 is the smallest nonnegative root: P1=minโกโ€‰โฃ(1,pq)\boxed{P_1 = \min\!\left(1, \frac{p}{q}\right)}

  • Part 1. For p=13p = \tfrac13 we get q=23q = \tfrac23, so P1=1/32/3=12P_1 = \dfrac{1/3}{2/3} = \tfrac12.
  • Drift toward the cliff or fair walk (pโ‰ฅ12p \ge \tfrac12). Then p/qโ‰ฅ1p/q \ge 1, so the smallest root is 11 and he falls with certainty.
  • Drift away from the cliff (p<12p < \tfrac12). He falls with probability p/qp/q. Starting kk steps away, the probability is (p/q)k(p/q)^k.

Remarks.

  • At p=12p = \tfrac12 the fall is certain, but the expected time until falling is infinite. This is the classic null-recurrent behaviour of the simple symmetric random walk.
  • The equation x=p+qx2x = p + qx^2 is exactly the extinction equation of a branching process in which each individual has either 00 children (probability pp) or 22 children (probability qq). In both settings, the correct answer is the smallest fixed point, and for the same monotone-iteration reason.

Source: Mosteller, Fifty Challenging Problems in Probability with Solutions, Problem 35 (The Cliff-Hanger)

Type: ProbabilitySource: Mosteller, Fifty Challenging Problems in Probability with Solutions, Problem 35 (The Cliff-Hanger)Edit on GitHub โ†—