IT in Manufacturing


Cooling today’s sizzling hot data centres

August 2013 IT in Manufacturing

Virtually all IT equipment is air-cooled i.e. each piece of IT equipment takes in ambient air and ejects waste heat into its exhaust air. Since a data centre may contain thousands of IT devices, the result is that there are thousands of hot airflow paths within the data centre that together represent the total waste heat output, which must be removed.

With power densities of modern IT equipment pushing peak power density to 20 kW per rack or more, simulation data and experience show traditional cooling, dependent on air mixing, no longer functions effectively. To address this problem, design approaches exist that focus on room, row, and rack-based cooling. In these approaches, the air conditioning systems are specifically integrated with the room, rows of racks, or individual rack in order to minimise air mixing.

Every data centre air conditioning system has two key functions. The first, bulk cooling capacity, is the same for room, row and rack-based cooling. The major difference lies in how each cooling system performs the second critical function – distribution of air to the loads. Controlling the airflow is therefore the main objective of the different cooling system design approaches.

Room-based cooling

With room-based cooling, the computer room air handler (CRAH) units operate concurrently to address the total heat load of the room. Room-based cooling may consist of one or more air conditioners supplying cool air completely unrestricted by ducts, dampers, vents and more; or the supply and return may be partially constrained by a raised floor system or overhead return plenum.

The room-based design is heavily affected by the specific constraints of the room, including the ceiling height, the room shape, obstructions above and under the floor, rack layout, CRAH location, the distribution of power among the IT loads and more. When the supply and return paths are uncontained, the result is that performance prediction and performance uniformity are poor, particularly as power density is increased. Therefore, with traditional designs, complex computer simulations called computational fluid dynamics (CFD) may be required to help understand the design performance of specific installations. Furthermore, alterations such as IT equipment moves, add-ons, and changes may invalidate the performance model and require further analysis and testing. In particular, the assurance of CRAH redundancy becomes a very complicated analysis that is difficult to validate.

Another significant shortcoming of uncontained room-based cooling is that in many cases the full rated capacity of the CRAH cannot be utilised. This condition occurs when a significant fraction of the air distribution pathways from the CRAH units bypass the IT loads and return directly to the CRAH. The result is that cooling requirements of the IT layout can exceed the cooling capacity of the CRAH despite the required amount of nameplate capacity.

Row-based cooling

With a row-based configuration, the CRAH units are associated with a row and assumed to be dedicated to a row for design purposes. The CRAH units may be located in between the IT racks or they may be mounted overhead.

Compared with the traditional uncontained room-based cooling, the airflow paths are shorter and more clearly defined. In addition, airflows are much more predictable, all of the rated capacity of the CRAH can be utilised and higher power density can be achieved.

Row-based cooling has a number of side benefits other than cooling performance. The reduction in the airflow path length reduces the CRAH fan power required, thus increasing efficiency.

This is not a minor benefit, when we consider that, in many lightly loaded data centres, the CRAH fan power losses alone exceed the total IT load power consumption. A row-based design allows cooling capacity and redundancy to be targeted to the actual needs of specific rows. For example, one row of racks can run high-density applications such as blade server, while another row satisfies lower power density applications such as communication enclosures.

For new data centres less than 200 kW, row-based cooling should be specified and can be implemented without a raised floor. For existing data centres row-based cooling should be considered when deploying higher density loads (5 kW per rack and above).

Rack-based cooling

With rack-based cooling, the CRAH units are associated with a rack and are assumed to be dedicated to a rack for design purposes. The CRAH units are directly mounted to, or within, the IT racks. Compared with room or row-based cooling, the rack-based airflow paths are even shorter and exactly defined so that airflows are immune to any installation variation or room constraints. All of the rated capacity of the CRAH can be utilised, and the highest power density (up to 50 kW per rack) can be achieved. The reduction in the airflow path length reduces the CRAH fan power required, increasing efficiency even further.

A rack-based design allows cooling capacity and redundancy to be targeted to the actual needs of specific racks, for example, different power densities for blade servers vs. communication enclosures. Furthermore, N+1 or 2N redundancy can be targeted to specific racks. By contrast, row-based cooling only allows these characteristics to be specified at the row level and room-based cooling only allows these characteristics to be specified at the room level.

As with row-based cooling, the deterministic geometry of rack-based cooling gives rise to predictable performance that can be completely characterised by the manufacturer. This allows simple specification of power density and design to implement the specified density. Rack-based cooling should be used in all data centre sizes where cooling is required for stand-alone high-density racks. The principal drawback of this approach is that it requires a large number of air conditioning devices and associated piping when compared to the other approaches, particularly at lower power density.

Hybrid cooling

Nothing prevents room, row and rack-based cooling from being used together in the same installation. Placing various cooling units in different locations in the same data centre is considered a hybrid approach. This approach is beneficial to data centres operating with a broad spectrum of rack power densities.

Another effective use of row and rack-based cooling is for density upgrades within an existing low-density room-based design. In this case, small groups of racks within an existing data centre are outfitted with row or rack-based cooling systems. The row or rack cooling equipment effectively isolates the new high-density racks, making them ‘thermally neutral’ to the existing room-based cooling system.

Another example of a hybrid approach is the use of a chimney rack cooling system to capture exhaust air at the rack level and duct it directly back to a room-based cooling system. This system has some of the benefits of a rack-based system but can integrate into an existing or planned room-based cooling system.

To make effective decisions regarding the choice between room, row, or rack-based cooling for new data centres or upgrades, it is essential to relate the performance characteristics of the cooling methods to practical issues that affect the design and operation of real data centres.

For more information contact Eben Owen, Schneider Electric SA, +27 (0)11 557 6600, [email protected], www.schneider-electric.com



Credit(s)



Share this article:
Share via emailShare via LinkedInPrint this page

Further reading:

Optimising the product design process
Siemens South Africa IT in Manufacturing
OPmobility is partnering with Siemens to adopt its Teamcenter X Product Lifecycle Management software. OPmobility’s increasingly complex products now include electronics and software, to create energy storage systems, which include battery and hydrogen electrification solutions and fuel tanks.

Read more...
Why turbomachinery should break free from vendor lock-in
Schneider Electric South Africa Motion Control & Drives
Today’s modern turbomachinery control systems form an important of operational efficiency, be it in heavy industries, traditional power generation or renewables such as hydroelectric facilities. Independence is the name of the game, and turbomachinery stands to gain lot from this newfound freedom.

Read more...
Smart milling for resilient, sustainable food production
IT in Manufacturing
As the global demand for food continues to rise due to increasing urbanisation, the milling industry faces the challenge of balancing efficiency with sustainability. Bühler is committed to making milling more energy-efficient while maintaining high operational performance. Its solutions allow mills to reduce energy costs and ensure long-term sustainability.

Read more...
The evolving landscape of data centres in the age of AI
Schneider Electric South Africa IT in Manufacturing
The data centre industry is undergoing a period of rapid transformation, driven primarily by the explosive growth of AI. It’s clear that the demands of AI are reshaping the very foundations of data infrastructure. This isn’t merely about incremental upgrades; it’s a fundamental shift in how we design, power and operate these critical facilities.

Read more...
Monitoring partial discharge on medium voltage switchgear
Schneider Electric South Africa Electrical Power & Protection
Schneider Electric South Africa has launched its EcoStruxure Service Plan (ESP) in the Anglophone African region for medium voltage (MV) switchgear

Read more...
SA Food Review
IT in Manufacturing
Food Review is a monthly trade journal for South Africa’s food and beverage manufacturing industry, for industry professionals seeking detailed information on trends, technologies, best practices and innovations.

Read more...
Keeping an eye on oil consumption with moneo
ifm - South Africa IT in Manufacturing
Manufacturing companies in the metal industry need oils and other fluids that are consumed by their machines. To make this consumption transparent and to establish a link to the ERP system, Arnold Umformtechnik relies on the IIoT platform, moneo, in combination with the SAP-based software solution Shop Floor Integration (SFI) – both from ifm.

Read more...
AI accelerates energy transformation
RJ Connect IT in Manufacturing
With the rapid expansion of generative AI applications, data centre power demand is reaching unprecedented levels.

Read more...
Revolutionising mining operations with MineOptimize
IT in Manufacturing
Now more than ever, mining and mineral processing companies need to boost productivity, ensure safety, and protect the environment. ABB’s comprehensive electrification, automation and digital solutions portfolio is ideally positioned to meet these challenges across all mining processes, from mine to port, transforming performance in a digital world.

Read more...
Buildings in Africa’s urban evolution
Schneider Electric South Africa IT in Manufacturing
Africa is now an urban continent. How does the continent mobilise to accommodate urban dwellers and maintain and implement critical infrastructure that allows for this expansion? Building management systems provide a tangible solution to optimise resource use, lower operations costs and ultimately contribute to a growing continent that also employs green practices.

Read more...