Frontiers & the Post-Moore Era

the craft of architecture

Technologies come and go — vacuum tubes gave way to transistors, single cores gave way to multicore, and tomorrow may bring chiplets, photonics, or things not yet imagined. But underneath every era sits the same enduring craft: the disciplined, quantitative, tradeoff-driven way of thinking that defines a good architect. The craft of architecture is the skill that outlives any single technology — the habits of measuring honestly, reasoning about tradeoffs, and spending your limited budget of transistors, power, and time where it does the most good. A reader who has climbed the whole ladder leaves with this craft, even as the specific technologies they learned about are replaced.

Two principles form the backbone of the craft, and they are worth carrying everywhere. The first is make the common case fast: find the thing your workload spends most of its time doing, and optimize that, even at the expense of rare cases — because effort spent on what almost never happens is wasted. The second is Amdahl's law, the mathematical humbler of every optimization: if a part of the program that takes a fraction f of the time is sped up, the overall speedup is limited no matter how much you accelerate that part, because the untouched remainder still has to run. If 90 percent of a job can be made infinitely fast but 10 percent cannot be touched, the whole job can speed up at most ten-fold. Amdahl's law is why doubling cores rarely doubles performance, and why the serial part of a program is the ceiling on everything.

Together these give the architect's worldview: measure before you optimize (intuition lies; benchmark the real workload), attack the dominant cost, and respect the limit set by what you cannot speed up. This worldview is captured in the iron law of performance — run time equals instruction count times cycles per instruction times cycle time — which insists there is no single magic knob, only three honest factors to push on. The craft also means refusing easy myths: a higher clock rate is not automatically faster, pipelining raises throughput but not single-instruction latency, more cores do not give free linear speedups, and a benchmark measures only what it measures. In a post-Moore world where free speedups are gone and every gain must be designed, this quantitative, honest, tradeoff-aware craft is more central than ever — it is the part of computer architecture that no new technology can make obsolete.

An engineer profiles a program and finds it spends 95 percent of its time in one inner loop. By Amdahl's law, even making everything else instantaneous would speed the program up by only about 5 percent, while making that one loop twice as fast cuts the whole run time by nearly half. The craft is knowing to measure first, then pour effort into the dominant 95 percent — not the negligible 5.

Measure first, optimize the common case, and respect Amdahl's law — the craft that survives every change of technology.

The craft is a defense against myths: a higher clock rate is not automatically faster, pipelining raises throughput not single-instruction latency, more cores do not give free linear speedups (Amdahl's law caps it), and a benchmark measures only what it measures. Measure honestly before you optimize.

Also called
quantitative designthe art of computer architecture架構的工藝量化設計計算機結構的技藝