Continuous Distributions

the normal (Gaussian) distribution

/ GOW-see-an /

Measure the heights of thousands of adults, or the tiny errors in a careful measurement repeated many times, and the histogram almost always shows the same shape: a single symmetric hump, fattest in the middle, thinning out evenly on both sides. This is the normal distribution, the famous bell curve — the single most important distribution in all of probability and statistics.

Write X ~ Normal(mu, sigma^2). Two numbers fully specify it: the mean mu sets where the peak sits (the centre, which is also the median and the mode), and the standard deviation sigma sets how wide the bell is (a small sigma is a tall narrow spike; a large sigma is a low flat spread). Its density f(x) = exp(-(x - mu)^2 / (2 sigma^2)) / (sigma sqrt(2 pi)) falls off as the exponential of a negative square, which is why the tails shrink very fast — extreme values are rare. The curve is perfectly symmetric about mu, so E[X] = mu and Var(X) = sigma^2.

The normal matters so much because of the central limit theorem: when you add up or average many small independent effects, the total tends toward a normal shape almost regardless of the pieces' own distributions. That is why measurement errors, sums, and averages are so often bell-shaped, and why the normal is the default model and the foundation of most statistical inference. The honest caveat: real data have fatter tails than the normal predicts more often than people expect, so 'extremely rare under the normal' events (market crashes, freak measurements) happen more than the bell curve says.

Adult male heights might be Normal(mu = 175 cm, sigma = 7 cm). The peak sits at 175 cm, about two-thirds of men fall within 175 +/- 7 cm (168 to 182), and a height of 196 cm — three sigma above the mean — is rare, under one in a thousand.

Mean fixes the centre; standard deviation fixes the width of the bell.

Sometimes the second parameter is the variance sigma^2 and sometimes the standard deviation sigma — Normal(0, 4) usually means variance 4, i.e. sigma = 2, so read the convention carefully.

Also called
Gaussian distributionbell curve常態分配高斯分配鐘形曲線