Disruption in Data Center Design Part II: The Consumers

Data centers emerged during World War II to support colossal mainframe computers like ENIAC (Foyer, 2024). Over the years, more manual, pen-and-paper business systems were replaced by in-house IT networks and services delivered from the internet.  This transformed the value proposition for data centers. The new value proposition is best described by the e-commerce giant that had a hand in the Retail Apocalypse: Amazon.

Every business needs computing equipment to run its web applications, offer services to customers, sell products, or run internal applications for accounts, human resources, and operations management. As the business grows and IT operations increase, the scale and amount of required equipment also increases exponentially. Equipment that is distributed across several branches and locations is hard to maintain. Instead, companies use data centers to bring their devices to a central location and manage it cost effectively (Amazon Web Services, n.d.).

Data centers warehouse different types of data, from the contents of your iPhone to the account information of millions of customers for an e-retailer platform. This leads to the following five major categories of data center operators (Foyer, 2024). The first category of data center operators is Hyperscalers. These are the industry giants like Amazon and Google. Theirs are the largest facilities that host cloud computing. The second category is Enterprise Operators. These companies own the more traditional “on prem” data centers. Verizon is an example of an Enterprise Operator. Operators in the third category run the most data centers in the United States (Foyer, 2024): Colocation Operators.  Colocation offers Platform and Infrastructure as a Service (IaaS) to a variety of smaller corporate customers, opening the opportunity to outsource IT resources. The fourth category is Edge Operators. As the name implies, Edge Operators deliver IT at the point of service or application. Foyer describes companies like Netflix that deploy at the edge to reduce buffering in streaming content. Lastly, there are commercial real estate companies that invest in data center properties and lease them to operators. ChatGPT cites the three largest data center operators in the United States, in descending order, based on footprint. They are Equinix, Digital Realty, and CyrusOne. The largest, Equinix, a California-based colocator, operates approximately 260 data centers in 33 countries, over 90 of which are in the U.S. (Wikipedia, 2025).

A modern data center is pictured below. It is a mostly windowless, warehouse-like building or

 

 

A Google Data Center in Oregon (Source: Lambtron, CC BY-SA 4.0 <https://creativecommons.org/licenses/by-sa/4.0>, via Wikimedia Commons)

group of buildings. Today’s data centers are designed to securely house IT infrastructure and provide power and efficient cooling for continuous, uninterrupted service. A visitor will find some core systems. The first is a “server farm.” Servers that run customer applications are housed in racks or cabinets, as shown below. The racks are arranged in aisles designated "hot aisles" and "cold aisles." The servers

 


Server racks in a data center (Source: 123net, CC BY-SA 3.0 <https://creativecommons.org/licenses/by-sa/3.0>, via Wikimedia Commons)

exhaust heated air to the hot aisle, where the cooling system removes it. This arrangement isolates chilled air from the exhaust, boosting cooling efficiency.  The second system is for near-term and long-term data storage. These are discussed in more detail below. Third is network switches and high-speed, multi-mode optical fiber to interface the data center to the global internet. Next are the utilities. Transformers and other distribution equipment condition and deliver electric power. Industrial cooling systems with chillers, cooling towers, and fans remove the relentless heat from the IT equipment.  Banks of uninterruptable power sources (UPSs) and back-up generators ensure system operation during a power outage. Lastly, the facility wraps the core systems in layers of physical security. These are comprised of fences, guards, controlled-access doors, alarms, cameras, and sensors.

Data centers store your online life with a toolbelt of three technologies. The first is the traditional hard disk drive (HDD). HDDs provide high storage capacity at low cost (Iridian Spectral Technologies, 2023). Solid state drives (SSD) complement HDDs with higher speed in read and write operations. HDDs and SSDs assemble to form storage area networks (SANs) that curate data in terabyte blocks. Hence, the combination is referred to as Block Storage (Amazon Web Services, n.d.). The third technology is magnetic tape. Reliable and stable, magnetic tape is the cost-effective choice for long-term back-up and disaster recovery. As the next section will discuss, devices in the storage technology toolbelt require stable floor space, power, and cooling to operate effectively.  They contribute to the data center industry’s growing resource demands.

The fundamental component of servers and other IT equipment is, of course, the transistor. These nanometer-scale devices are, in essence, tiny electrical switches. Switching a field effect transistor (FET) involves applying an electric potential to the device. Switching causes current to flow between the device’s terminals. This consumes power that increases according to the square of the current.  Since electrical circuits have an inherent resistance, the current flow generates internal heat. FETs begin to fail above a limiting junction temperature Tj. To avoid this, external systems must remove enough heat from the chip to keep Tj under the operating limit. Conductive epoxy that contacts the underside of the chip that contains the FETs (see microelectronic package cross section below) moves heat out through the surrounding microelectronic package. The last mile of cooling is by convection, flowing refrigerated air over the microelectronic package and carrying heat away in the stream. Many data centers provide



(a)


 

(b)

(a)   Ball Grid Array Microelectronic Package Cross Section (Source: TubeTimeUS, CC BY-SA 4.0 <https://creativecommons.org/licenses/by-sa/4.0>, via Wikimedia Commons), (b) Cooling Tower (Source: Saud, CC BY-SA 4.0 <https://creativecommons.org/licenses/by-sa/4.0>, via Wikimedia Commons)

refrigerated air with industrial chillers. These systems typically use cooling towers, like the one pictured above, to reject heat to the exterior of the building. The cooling towers, especially the open-loop or evaporative type, need vast amounts of makeup water to replace the volume lost to evaporation and other sources (De La Casa, 2019). The construction industry is responding to this problem by installing alternative closed loop cooling systems that use reclaimed water, or refrigerant. This limits consumption to the amount of water required to initially charge the system during construction. Water demand is higher for data centers that generate their own electricity. The International Energy Agency estimates that the largest hyperscalers with tens of thousands of severs consume 530,000 gallons of water per day, the daily consumption of 6,500 households (Wikipedia, 2025). Meter-sized fans circulate cool air through the floor of the cold aisles. This also consumes electricity. Yearly average power consumption from IT, cooling, and other loads, varies with data center size. Smaller data centers that house between 500 and 2,000 servers consume between 1 – 5 MW (Data Center Knowledge, 2024). Hyperscalers can consume 100 MW or more. Goldman Sachs estimates that data center power demand will increase by 160% by 2030 (Foyer, 2024). According to the Electric Power Research Institute, this will amount to more than 9% of all power consumed in the U.S. (Wikipedia, 2025).  

We’ve defined the value proposition for the current generation of data centers and laid out their resource demands. With this background, Part III considers three forces that could shutter them. The first force is economics, a seismic shift in the marketplace. The second is a change in environmental regulation. Finally, there is disruptive technology. If the transformation occurs, it’s likely that a combination of these forces will set it in motion.

The author is grateful to K. Wallner for his contribution to this post.

References

Amazon Web Services. (n.d.). What is a Data Center? Retrieved from AWS: https://aws.amazon.com/what-is/data-center/

Foyer, A. (2024, August 7). Data Centers 101: What You Should Know. Retrieved from Insider: https://orennia.substack.com/p/data-centers-101-what-you-should

Wikipedia. (2025, July 28). Data Center. Retrieved from Wikipedia: https://en.wikipedia.org/wiki/Data_center

Wikipedia. (2025, August 13). Equinix. Retrieved from Wikipedia: https://en.wikipedia.org/wiki/Equinix

Comments

Popular posts from this blog

Ingenuity is Timeless

Cooking in 2050: A Journey Through Futuristic Culinary Tech

Disruption in Data Center Design Part III: The Disruptor