The Future is Liquid: How In Rack and Direct to Chip Cooling are Revolutionizing Data Centers

The Future is Liquid: How In-Rack and Direct-to-Chip Cooling are Revolutionizing Data Centers

Did you know that by 2026, close to 40% of data centers are expected to deploy liquid cooling solutions? As data processing demands skyrocket, traditional air cooling simply can't keep up. Welcome to the future of data center cooling.

In-Rack Liquid Cooling and Direct-to-Chip: Data Center Technology Liquid Cooling Series (Part 3 of 3)

This is the third of a three-part series on liquid cooling technologies. In the first post, Liquid Cooling in Hyperscale Data Centers: Innovation for the Future, we provided an overview of liquid cooling and the benefits for data center deployment. In the second post, Liquid Immersion Cooling: A Deep Dive into the Future of Data Center Cooling, we took a deeper look at immersion technology. This post looks at the basics of in-rack and direct cooling technologies.

Summary:

• Liquid Cooling in Data Centers: This blog discusses the growing demand for efficient cooling solutions in data centers due to increasing data processing power. It is the third post in a series on liquid cooling opportunities. Here, we look at in-rack and direct-to-chip cooling technologies, which are becoming popular because of their efficiency. These methods involve delivering coolant directly to the hot components of a server, allowing for more efficient heat transfer than traditional air cooling.
• Benefits and Challenges: Liquid cooling is more efficient than air cooling, reduces energy consumption, supports sustainability goals, and allows for the use of high-performance components in a confined space. However, as with most new technologies, there are some challenges to more rapid adoption.
• Future for Data Centers: Liquid cooling is not just a trend, but a necessity for the future of data centers, and is one that CyrusOne is fully embracing and staying on the forefront of with modern design and appropriate retrofit solutions. As data centers evolve, in-rack and direct-to-chip liquid cooling will play a crucial role in meeting the growing demand for processing power and reducing environmental impact.

Liquid Cooling Here to Stay

As the demand for data processing power grows, so does the need for efficient cooling solutions. According to the 2024 JLL Global Data Center Outlook report, hyperscale data centers are projected to increase their rack density at a compound annual growth rate (CAGR) of 7.8%.

This surge in density is driving the rapid adoption of liquid cooling technologies. Industry expert Sean Graham from IDC predicts that while roughly 22% of data centers currently use liquid cooling, this figure is expected to jump to nearly 50% within the next five years. At CyrusOne, we're not just following this trend - we're leading it.

In-rack vs Direct-to-chip Liquid Cooling

In-rack liquid cooling and direct-to-chip liquid cooling are often used interchangeably, but there can be a slight difference depending on the context.

In-rack liquid cooling is a general term that often refers to any liquid cooling method integrated at the row, cabinet or chip level.

Direct-to-chip liquid cooling is a specific type of in-rack liquid cooling. In this method, coolant is delivered directly onto the hot components (such as the CPU) of a server. This direct contact allows for more efficient heat transfer compared to other methods.

Both methods of heat removal deliver coolant directly to the rack or server's hot components meaning the heat removal is closer to the source of the heat. This method is more efficient than traditional air cooling because liquids can carry away more heat than air. The coolant is circulated through a closed loop, absorbing heat from the servers. The heated coolant is then cooled in a heat exchanger before being recirculated. This keeps the servers at an optimal operating temperature, even under heavy loads.

Why is in-rack liquid cooling is becoming more popular?

1. Efficiency: Liquid cooling removes more heat, allowing for higher density racks and more processing power in the same footprint. In fact, water has as much as 3,000 times the heat absorption capacity as air.
2. Sustainability: It can reduce data center energy consumption by up to 25%, significantly lowering the carbon footprint.
3. Reliability: The reduced operating temperature improves system reliability and extends equipment lifespan.
4. Performance: It allows for the development of denser and more powerful high-performance computing systems.

CyrusOne's Intelliscale™ solution leverages these benefits to address the growing needs of AI applications and services.

The Challenges of In-Rack Liquid Cooling & Direct-to-Chip

Despite its numerous benefits, the adoption of in-rack liquid cooling and direct-to-chip is not without some challenges.

In existing data centers, it rarely makes sense to convert to liquid cooling one rack at a time. The facilities team will have to manage two cooling systems instead of one, increasing operational costs and complexity. Some of the complexities of liquid cooling have resulted in challenges such as an increased number of IT equipment failures, liquid leakage, and liquid evaporation. As the industry transitions, the workforce is educated and trained on the use of liquid cooling, and best practices in maintenance procedures are developed and shared, these challenges, already very rare, will become even less of a concern.

At CyrusOne, we understand these concerns and have developed comprehensive strategies to mitigate risks:

1. Rigorous testing and quality control processes to ensure the integrity of cooling systems
2. Advanced leak detection and containment systems
3. Ongoing training programs for our staff to ensure proper maintenance and operation
4. Partnerships with leading equipment manufacturers for compatibility and reliability

We work closely with our clients to address any concerns and ensure a smooth transition to liquid cooling technologies.

Standard bodies such as the Institute of Electrical and Electronics Engineers Standards Association (IEEE SA) are working with technology developers, vendors, and data center developers to develop industry standards on liquid cooling which will improve adoption rates and drive greater development.

As data centers continue to evolve, in-rack liquid cooling and direct-to-chip liquid cooling will play a crucial role in ensuring they can meet the growing demand for processing power and reduce the impact on the environment. By adopting this technology, data centers can increase their efficiency, reduce their operating costs, and lessen their environmental impact.

Looking Forward

Liquid cooling is not just a trend, but a necessity for the future of data centers.

"In many cases the ability to support AI and HPC operations in the data center is no longer an add-on, but an integral part of data center planning," wrote Senior Editor David Chernicoff, in a recent article for Data Center Frontier. "The effort to make liquid-cooled solutions practical across the entire market is happening quickly and is no longer a stumbling block for putting an AI solution where your business needs it."

The drive for adoption of liquid cooling technology is supported by studies from organizations such as Iceotope and Meta, which confirmed the practicality, efficiency, and effectiveness of precision liquid cooling in meeting the cooling requirements of hyperscalers.

As a leading data center developer, CyrusOne is committed to staying at the forefront of this technology, providing our customers with the most efficient and effective solutions available. Our ongoing research and development efforts ensure that we will continue to offer cutting-edge cooling solutions that meet the evolving needs of our clients.

Stay tuned for more updates on our journey towards a cooler, greener future.

Public link

Please use the above public link if you want to share this noodl on another website.