Datacenter & Cloud Networking

a datacenter network

Picture the wide-area Internet as a sprawling road system connecting cities across a continent — long distances, many independent owners, traffic flowing mostly between far-apart places. Now picture a single enormous warehouse the size of several football fields, packed wall to wall with tens of thousands of computers that all belong to one company and need to talk to each other constantly. The network wiring that building together is a datacenter network. It is a different world from the public Internet: one owner, short distances, and a known set of machines, which lets the designers make very different trade-offs.

A datacenter network connects the servers, storage, and accelerators inside a cloud facility using a structured fabric of switches and links. Because the operator controls everything end to end, the network is usually built as a regular, repeated pattern (a topology) of identical switches — not the messy, organically-grown mesh of the Internet. The goals are unusual too: enormous aggregate bandwidth between any two servers, very low and very predictable latency (often microseconds, not milliseconds), and the ability to keep working when individual links or switches fail. Traffic here is dominated by server-to-server flows (called east-west traffic), not by traffic entering and leaving the building.

Why it matters: the cloud is built on these networks. When you load a web page, dozens of internal services — databases, caches, search indexes, machine-learning models — may exchange messages inside one datacenter before a single byte reaches you. The performance of that internal fabric sets the ceiling on how fast and how cheaply the whole service can run. A common misconception is that a datacenter is just a big version of an office LAN; in fact its scale, its traffic pattern, and its need for many equal-cost paths force special topologies (fat-tree, leaf-spine), special transport behavior (incast, DCTCP), and special hardware (SmartNICs, RDMA) that you rarely see in a small network.

A typical request to a big web service might trigger 100+ internal calls: the front-end server queries a load balancer, which fans out to several application servers, which each hit caches and databases on other racks. All of that happens over the datacenter network in a few milliseconds, before the user ever sees a result.

One user request becomes a storm of internal east-west traffic.

Don't equate a datacenter network with the Internet. Inside one facility there is a single administrator, distances are short (so propagation delay is tiny), and the topology is engineered on purpose — assumptions that fail completely on the public Internet.

Also called
DCNdata center network資料中心網路DC 網路