Probability Inequalities & Concentration

the first moment method

Here is a deceptively powerful question: how do you prove that some elaborate object — a graph with no large clique, a colouring with no monochromatic line, a solution to a puzzle — does NOT exist, or conversely that one almost certainly DOES, without ever constructing it? The first moment method does this by counting on average. It connects a count's expectation to whether the count can be zero.

The idea rests on a one-line observation about a non-negative integer count N (say, the number of 'bad' configurations): if the average count is small, the count is usually zero. Formally, by Markov's inequality, P(N >= 1) <= E[N]. So if E[N] < 1, then P(N >= 1) < 1, which means P(N = 0) > 0 — there must exist an outcome with no bad configurations at all. To compute E[N], you write N as a sum of indicator variables, one per potential bad configuration, and use linearity of expectation: E[N] = sum of P(each configuration is bad). Linearity is the magic — it needs no independence whatsoever.

This is a cornerstone of the probabilistic method in combinatorics. To prove something exists, show a random construction produces it with positive probability (E[bad count] < 1, so a bad-free outcome exists). To prove an event is rare, show its expected count tends to 0, forcing the probability to 0. The honest limit: a small expectation guarantees the count is OFTEN zero but cannot guarantee it is ALWAYS positive — for the reverse direction (showing N >= 1 with high probability) a large E[N] is not enough, because the count could be huge sometimes and zero usually. That gap is exactly what the second moment method fixes.

To show a random 2-colouring of the edges of a complete graph can avoid a monochromatic clique of size k, let N count monochromatic k-cliques. By linearity, E[N] = (number of k-subsets) times 2 / 2^(k choose 2). If this is below 1, then P(N = 0) > 0, so a colouring with no such clique must exist — proven without ever exhibiting one.

If the average count of bad things is below 1, a bad-free outcome must exist.

A large E[N] does NOT prove N >= 1 typically — the count could be zero usually and enormous rarely. To prove existence the other way, you need the second moment method.

Also called
expectation methodfirst-moment argument一階動差法期望值法