The Secretary Who Knows the Distribution
You interview candidates one by one. Their quality scores are drawn independently and uniformly from . You must accept or reject each candidate immediately and irrevocably. You know the distribution (uniform on ) and want to maximize the probability of hiring the best candidate out of .
With only 2 candidates, what is the optimal strategy, and what is your probability of success?
Now generalize: with candidates, the optimal threshold strategy (accept candidate if their score exceeds some threshold ) gives a success probability that approaches what limit as ?
Answer: The Secretary Who Knows the Distribution
Key Idea / Intuition
With two candidates, you can afford a pure threshold rule: if the first candidate scores above some cutoff , hire them immediately; otherwise, wait and take the second (regardless of their score, since it's your last chance). The surprising punchline is that as the number of candidates grows, the optimal threshold strategy guarantees you hire the best with probability approaching โ the same asymptotic as the classical secretary problem (where you know only ranks, not values). Knowing the distribution doesn't actually help asymptotically!
Formal Proof / Solution
Step 1: Optimal Strategy for
Let the two scores be , independent.
Strategy: Choose threshold . Accept if ; otherwise accept .
Probability of hiring the best:
Compute each term:
So:
Optimize over :
This is strictly better than the rank-based secretary problem with (which gives ), because knowing the distribution lets you make a smarter decision on the first candidate.
Step 2: The -Candidate Threshold Strategy
With candidates and scores , work backwards. With candidates remaining and the current candidate having score , the optimal policy sets an indifference threshold satisfying:
From Mosteller's analysis: with draws remaining and candidate in hand with score , you should accept if where satisfies:
The right-hand side simplifies: it equals the probability that at least one of the remaining candidates exceeds and you successfully pick the largest.
Step 3: The Asymptotic Surprise
As , the optimal success probability satisfies:
Why? The threshold for the first candidate you'd accept, as grows, converges to -th power scaling. One can show the optimal thresholds for large , and the probability of winning under the optimal policy satisfies the recursion whose solution converges to .
Concretely, compare:
| | Optimal (known distribution) | Classical secretary (rank only) | |-----|-----------------------------|---------------------------------| | 1 | 1 | 1 | | 2 | 3/4 | 1/2 | | 3 | ~0.618 | ~0.500 | | | | |
The deep insight: For small , knowing the distribution helps substantially. But as , the problem becomes so hard (you're increasingly likely to miss the best by a wrong decision early on) that both strategies converge to . The extra information from knowing the distribution is asymptotically useless.
Summary
- With : threshold , success probability .
- With general : use decreasing thresholds .
- As : , matching the classical (rank-only) secretary problem.
Source: Fifty Challenging Problems in Probability with Solutions, Frederick Mosteller, Problem 48