IT in Manufacturing


Cooling today’s sizzling hot data centres

August 2013 IT in Manufacturing

Virtually all IT equipment is air-cooled i.e. each piece of IT equipment takes in ambient air and ejects waste heat into its exhaust air. Since a data centre may contain thousands of IT devices, the result is that there are thousands of hot airflow paths within the data centre that together represent the total waste heat output, which must be removed.

With power densities of modern IT equipment pushing peak power density to 20 kW per rack or more, simulation data and experience show traditional cooling, dependent on air mixing, no longer functions effectively. To address this problem, design approaches exist that focus on room, row, and rack-based cooling. In these approaches, the air conditioning systems are specifically integrated with the room, rows of racks, or individual rack in order to minimise air mixing.

Every data centre air conditioning system has two key functions. The first, bulk cooling capacity, is the same for room, row and rack-based cooling. The major difference lies in how each cooling system performs the second critical function – distribution of air to the loads. Controlling the airflow is therefore the main objective of the different cooling system design approaches.

Room-based cooling

With room-based cooling, the computer room air handler (CRAH) units operate concurrently to address the total heat load of the room. Room-based cooling may consist of one or more air conditioners supplying cool air completely unrestricted by ducts, dampers, vents and more; or the supply and return may be partially constrained by a raised floor system or overhead return plenum.

The room-based design is heavily affected by the specific constraints of the room, including the ceiling height, the room shape, obstructions above and under the floor, rack layout, CRAH location, the distribution of power among the IT loads and more. When the supply and return paths are uncontained, the result is that performance prediction and performance uniformity are poor, particularly as power density is increased. Therefore, with traditional designs, complex computer simulations called computational fluid dynamics (CFD) may be required to help understand the design performance of specific installations. Furthermore, alterations such as IT equipment moves, add-ons, and changes may invalidate the performance model and require further analysis and testing. In particular, the assurance of CRAH redundancy becomes a very complicated analysis that is difficult to validate.

Another significant shortcoming of uncontained room-based cooling is that in many cases the full rated capacity of the CRAH cannot be utilised. This condition occurs when a significant fraction of the air distribution pathways from the CRAH units bypass the IT loads and return directly to the CRAH. The result is that cooling requirements of the IT layout can exceed the cooling capacity of the CRAH despite the required amount of nameplate capacity.

Row-based cooling

With a row-based configuration, the CRAH units are associated with a row and assumed to be dedicated to a row for design purposes. The CRAH units may be located in between the IT racks or they may be mounted overhead.

Compared with the traditional uncontained room-based cooling, the airflow paths are shorter and more clearly defined. In addition, airflows are much more predictable, all of the rated capacity of the CRAH can be utilised and higher power density can be achieved.

Row-based cooling has a number of side benefits other than cooling performance. The reduction in the airflow path length reduces the CRAH fan power required, thus increasing efficiency.

This is not a minor benefit, when we consider that, in many lightly loaded data centres, the CRAH fan power losses alone exceed the total IT load power consumption. A row-based design allows cooling capacity and redundancy to be targeted to the actual needs of specific rows. For example, one row of racks can run high-density applications such as blade server, while another row satisfies lower power density applications such as communication enclosures.

For new data centres less than 200 kW, row-based cooling should be specified and can be implemented without a raised floor. For existing data centres row-based cooling should be considered when deploying higher density loads (5 kW per rack and above).

Rack-based cooling

With rack-based cooling, the CRAH units are associated with a rack and are assumed to be dedicated to a rack for design purposes. The CRAH units are directly mounted to, or within, the IT racks. Compared with room or row-based cooling, the rack-based airflow paths are even shorter and exactly defined so that airflows are immune to any installation variation or room constraints. All of the rated capacity of the CRAH can be utilised, and the highest power density (up to 50 kW per rack) can be achieved. The reduction in the airflow path length reduces the CRAH fan power required, increasing efficiency even further.

A rack-based design allows cooling capacity and redundancy to be targeted to the actual needs of specific racks, for example, different power densities for blade servers vs. communication enclosures. Furthermore, N+1 or 2N redundancy can be targeted to specific racks. By contrast, row-based cooling only allows these characteristics to be specified at the row level and room-based cooling only allows these characteristics to be specified at the room level.

As with row-based cooling, the deterministic geometry of rack-based cooling gives rise to predictable performance that can be completely characterised by the manufacturer. This allows simple specification of power density and design to implement the specified density. Rack-based cooling should be used in all data centre sizes where cooling is required for stand-alone high-density racks. The principal drawback of this approach is that it requires a large number of air conditioning devices and associated piping when compared to the other approaches, particularly at lower power density.

Hybrid cooling

Nothing prevents room, row and rack-based cooling from being used together in the same installation. Placing various cooling units in different locations in the same data centre is considered a hybrid approach. This approach is beneficial to data centres operating with a broad spectrum of rack power densities.

Another effective use of row and rack-based cooling is for density upgrades within an existing low-density room-based design. In this case, small groups of racks within an existing data centre are outfitted with row or rack-based cooling systems. The row or rack cooling equipment effectively isolates the new high-density racks, making them ‘thermally neutral’ to the existing room-based cooling system.

Another example of a hybrid approach is the use of a chimney rack cooling system to capture exhaust air at the rack level and duct it directly back to a room-based cooling system. This system has some of the benefits of a rack-based system but can integrate into an existing or planned room-based cooling system.

To make effective decisions regarding the choice between room, row, or rack-based cooling for new data centres or upgrades, it is essential to relate the performance characteristics of the cooling methods to practical issues that affect the design and operation of real data centres.

For more information contact Eben Owen, Schneider Electric SA, +27 (0)11 557 6600, [email protected], www.schneider-electric.com



Credit(s)



Share this article:
Share via emailShare via LinkedInPrint this page

Further reading:

Bringing brownfield plants back to life
Schneider Electric South Africa IT in Manufacturing
Today’s brownfield plants are typically characterised by outdated equipment and processes, and face challenges ranging from inefficient operations to safety hazards. However, all is not lost, as these plants stand to gain a lot from digitalisation and automation.

Read more...
Power supply with scalability optimised
Schneider Electric South Africa Electrical Power & Protection
Schneider Electric has introduced the Easy UPS 3-Phase Modular to the South African marketplace. This robust uninterruptible power supply (UPS) is designed to protect critical loads while offering third-party verified Live Swap functionality.

Read more...
Generative AI for immersive real-time visualisation
Siemens South Africa IT in Manufacturing
Siemens will deepen its collaboration with NVIDIA to help build the industrial metaverse.

Read more...
Mesh networks: a multidirectional electrical superhighway
Schneider Electric South Africa Electrical Power & Protection
Today, many power industry stakeholders are faced with mounting requirements for improved grid reliability, resilience and distribution efficiency. It’s a challenge which requires power service providers to rethink their infrastructure. Enter mesh networks, which can overcome the limitations of traditional star networks.

Read more...
Award-winning Gen AI solutions
IT in Manufacturing
Amazon Web Services recently hosted an exclusive event in South Africa on ‘Elevating Possibilities with Partners - a Showcase of GenAI Excellence’. This event brought together ten esteemed partners, including Synthesis Software Technologies, to highlight innovative advancements in the field of Generative AI.

Read more...
Schneider Electric announces 2023 Global Alliance Partner Programme award winners
Schneider Electric South Africa News
Schneider Electric has announced the winners of the 2023 Global Alliance Excellence Awards. Throughout 2023, Schneider Electric’s Alliance Partners supported customers in the digitalisation of industrial automation, delivering value with innovative initiatives, solutions and services.

Read more...
AI is driving data centres to the edge
Schneider Electric South Africa IT in Manufacturing
The data centre has become the cornerstone that links our digitally interconnected world. At the same time, the rapid growth and application of AI and machine learning (ML) is shaping the design and operation of data centres.

Read more...
Full-scale central control room simulator
Valmet Automation IT in Manufacturing
Valmet will deliver a full-scale central control room simulator to Nordic Ren-Gas, the leading Nordic green hydrogen and e-methane developer in Finland.

Read more...
Re-imagining business operations with the power of AI
IT in Manufacturing
inq. has introduced a range of artificial intelligence solutions to assist organisations across industry verticals in optimising business operations and improving internal efficiencies.

Read more...
Safe, sustainable cycling helmet technology
Siemens South Africa IT in Manufacturing
Lazer Sport, one of Europe’s leading cycling helmet manufacturers, has adopted the Siemens Xcelerator portfolio of industry software to bring to market KinetiCore, its new proprietary rotational impact protection technology.

Read more...