Probabilistic & Bayesian ML

probabilistic graphical model

/ prob-uh-bil-IS-tik GRAF-ih-kul MOD-ul /

A probabilistic graphical model is a way of drawing a complicated web of uncertain quantities as a picture — dots for the things you care about, lines for how they influence each other. Think of a detective's corkboard: suspects, clues, and the strings connecting them. The diagram is not decoration; it is a precise mathematical claim that any two dots with no string between them are unrelated once you know the dots in between.

That picture buys you two huge things. First, it lets you write down a model of many interacting variables compactly, by listing only the direct relationships instead of every possible combination — the difference between describing a city by its roads versus by every pair of addresses. Second, it lets a computer reason efficiently: to answer 'given these clues, how likely is this suspect?', algorithms march along the strings rather than checking every scenario, which would be hopeless for anything but tiny problems.

The two great families are Bayesian networks, whose strings have arrows showing direction (often read as cause-and-effect), and Markov random fields, whose strings are undirected and just say 'these two are linked.' Why it matters: graphical models were a dominant framework for reasoning under uncertainty for decades and remain the clearest way to make a model's assumptions visible and checkable. Their honest limit is that exact reasoning becomes intractable as the web grows dense, and that a tidy diagram can hide a wrong assumption — a missing string asserts an independence that may simply be false.

A medical model with dots for 'smoking', 'lung disease', 'cough', and 'chest pain'. Arrows run from smoking to lung disease, and from lung disease to both symptoms. The picture asserts that once you know whether someone has lung disease, their cough and chest pain are unrelated to whether they smoke — smoking only matters through the disease it causes.

A small graphical model: the missing strings encode strong assumptions about what is independent of what.

The strings you draw matter less than the strings you leave out: every missing edge is a confident claim of independence. A beautiful, simple diagram can be simply wrong if it omits a real dependence the data actually contains.

Also called
PGMgraphical model概率图模型機率圖模型图模型