🧮 Brain Teaser

The Lazy Drunk: Random Walk Returns in 2D vs 3D

A particle starts at the origin and takes steps in the following way:

  • In 2D: at each step, it moves one unit North, South, East, or West, each with probability 14\frac{1}{4}.
  • In 3D: at each step, it moves one unit along one of the 6 axis directions (±x,±y,±z\pm x, \pm y, \pm z), each with probability 16\frac{1}{6}.

In 2D, it is a classical fact that the particle returns to the origin with probability 1 (the walk is recurrent).

Question: In 3D, does the particle return to the origin with probability 1, or is there a positive probability of escaping to infinity forever? If it escapes, roughly what is the probability of never returning?

You don't need to compute the exact value — reasoning about why the answer differs between 2D and 3D is the heart of the problem. But if you can, the exact escape probability is approximately 0.3405\mathbf{0.3405}.

random walkrecurrencePolya theoremdimensiongenerating functions

Answer: The Lazy Drunk: Random Walk Returns in 2D vs 3D

Key Idea / Intuition

The 2D walk is recurrent: the drunk always comes home. The 3D walk is transient: the particle drifts away forever with positive probability. The reason is fundamentally about how quickly the probability of being at the origin decays with time — in 2D it decays like 1/n1/n, whose sum diverges (so infinitely many returns), while in 3D it decays like 1/n3/21/n^{3/2}, whose sum converges (so only finitely many returns on average, meaning escape is possible).

The key tool is a beautiful connection between return probabilities and expected number of returns, combined with a generating-function / Fourier analysis of the walk.


Formal Proof / Solution

Step 1: Expected number of returns as a convergence criterion

Let pnp_n = probability of being at origin after nn steps. The expected total number of visits to the origin (including time 0) is:

E[visits]=n=0pn.E[\text{visits}] = \sum_{n=0}^{\infty} p_n.

Let PP = probability of ever returning to the origin. After each return, the particle starts fresh, so the number of returns follows a geometric distribution with success parameter Q=1PQ = 1-P. Hence:

E[returns after time 0]=PQ=P1P.E[\text{returns after time 0}] = \frac{P}{Q} = \frac{P}{1-P}.

  • If P=1P = 1 (recurrent): the expected number of returns is infinite, so n=1pn=\sum_{n=1}^\infty p_n = \infty.
  • If P<1P < 1 (transient): the sum converges, and P=11n=0pnP = 1 - \frac{1}{\sum_{n=0}^\infty p_n}.

So recurrence     \iff npn\sum_n p_n diverges.


Step 2: Asymptotics of pnp_n

In 2D: By the local central limit theorem, after 2n2n steps,

p2n1πnas n.p_{2n} \sim \frac{1}{\pi n} \quad \text{as } n \to \infty.

(Odd steps give p2n+1=0p_{2n+1} = 0 by parity.) So n=1pnn1πn=\sum_{n=1}^\infty p_n \sim \sum_{n} \frac{1}{\pi n} = \infty. Recurrent.

In 3D: After 2n2n steps,

p2n1(4πn/3)3/2C=Cn3/2.p_{2n} \sim \frac{1}{(4\pi n/3)^{3/2}} \cdot C = \frac{C}{n^{3/2}}.

More precisely, p2n(32πn)3/2p_{2n} \sim \left(\frac{3}{2\pi n}\right)^{3/2}. Since nn3/2<\sum_n n^{-3/2} < \infty (a convergent pp-series with p=3/2>1p = 3/2 > 1), the walk is transient.


Step 3: Why the dimension matters

The key is dimension dd:

  • After nn steps, the particle is spread over a ball of radius n\sim \sqrt{n}, so volume nd/2\sim n^{d/2}.
  • The probability of being at the origin nd/2\sim n^{-d/2}.
  • Recurrence requires nd/2=\sum n^{-d/2} = \infty, i.e., d/21d/2 \leq 1, i.e., d2\mathbf{d \leq 2}.

This is Pólya's theorem (1921): The simple random walk on Zd\mathbb{Z}^d is recurrent for d2d \leq 2 and transient for d3d \geq 3.


Step 4: The escape probability in 3D

Since n=0pn\sum_{n=0}^\infty p_n converges, we can compute:

n=0p2n=1(2π)3[π,π]3d3k113(coskx+cosky+coskz).\sum_{n=0}^{\infty} p_{2n} = \frac{1}{(2\pi)^3} \int_{[-\pi,\pi]^3} \frac{d^3\mathbf{k}}{1 - \frac{1}{3}(\cos k_x + \cos k_y + \cos k_z)}.

This is Watson's triple integral (1939), which evaluates to:

n=0p2n=696π3Γ ⁣(14)41.5164\sum_{n=0}^{\infty} p_{2n} = \frac{\sqrt{6}}{96\pi^3}\,\Gamma\!\left(\tfrac{1}{4}\right)^4 \approx 1.5164\ldots

Therefore:

P(return)=11pn111.51640.3405(escape probability)P(\text{return}) = 1 - \frac{1}{\sum p_n} \approx 1 - \frac{1}{1.5164} \approx 0.3405 \quad \text{(escape probability)}

P(ever return)10.3405=0.6595.\Rightarrow P(\text{ever return}) \approx 1 - 0.3405 = 0.6595.


Summary

| Dimension | pnp_n decay | pn\sum p_n | Walk type | Return prob | |-----------|-------------|------------|-----------|-------------| | d=1d = 1 | n1/2n^{-1/2} | \infty | Recurrent | 1 | | d=2d = 2 | n1n^{-1} | \infty | Recurrent | 1 | | d=3d = 3 | n3/2n^{-3/2} | << \infty | Transient | 0.34\approx 0.34 |

The drunk in 2D will always find his way home. In 3D, he has about a 34% chance of wandering off forever — the extra dimension gives him too much room to escape.

Source: Fifty Challenging Problems in Probability with Solutions (Frederick Mosteller), Problem 51; classical result of Pólya (1921)

Type: ProbabilitySource: Fifty Challenging Problems in Probability with Solutions (Frederick Mosteller), Problem 51; classical result of Pólya (1921)Edit on GitHub ↗