Experiment Design & A/B Testing
Guardrail Metric
A metric you watch not to declare victory but to make sure you are not doing harm — page load time, crash rate, unsubscribe rate, revenue. Even if your change wins on the main metric, a broken guardrail can veto the launch.
Guardrails encode the rule “don't win the battle but lose the war”. A redesign that lifts engagement 2% but slows the page by 500 milliseconds or doubles complaints is usually not worth shipping. Defining guardrails in advance keeps an excited team honest about side effects.
Also called