Data Wrangling & Pipelines

Missing Data

Missing data are values that should be present but aren't — an empty cell, an “NA,” or a placeholder like -999. They arise constantly: a survey question skipped, a sensor offline, a record never joined.

How values went missing matters enormously. If they're missing at random, simple fixes are safe; but if missingness is systematic — say high earners skip the income question — then dropping or naively filling those rows biases every result. Always ask why a value is missing before deciding what to do, and beware tools that silently drop incomplete rows.

Statisticians distinguish missing completely at random, missing at random, and missing not at random — the last is the dangerous, hard-to-fix case.

Also called
missing valuesNA