By Ben Selier, VP of Secure Power for Anglophone Africa at Schneider Electric.
The rise in hardware density in data centres is gaining speed and is largely driven by the demands of artificial intelligence (AI) and machine learning (ML), requiring more powerful servers and specialised hardware. Kilowatt demands per rack can reach 18 kW or more, necessitating increased cooling and larger real estate, all of which adds to costs.
As data centres move towards higher density GPU-based systems, kilowatt demands per rack can soar with cabinets now running up to 40 kW, compared to the previous 3 to 7 kW. The resultant increase in concentrated heat load is like operating a heater inside the data centre, putting a huge amount of stress on the cooling systems.
One of the primary challenges that arises is that traditional cooling methods are proving inadequate. While it is possible to cool the high-density loads with air, the infrastructure required becomes almost impossible. As such, air cooling is reaching its limits as it requires producing a huge amount of slow-moving air, which is very difficult to do in the small spaces of a data centre.
Manage airflow better
This has led to the use of containments and wind walls to better manage the airflow inside the data centre in the latest designs, driven by the need to move beyond air cooling as it is inefficient and costly to cool these high-density loads with air.
Liquid cooling options such as cooling the chip, back door cooling and immersion cooling are better and more sustainable options for the current high-density loads. Additionally, liquid cooling solutions are necessary to achieve sustainable or green AI as air cooling will not be able to provide the required efficiency.
Ultimately, liquid cooling provides a more efficient solution for managing thermal output in high-density data centres as water is about 10 times more effective than air at removing heat. Liquid cooling also targets heat removal directly from equipment, such as the chips and GPUs, unlike air cooling, which cools the entire room − including less critical areas − resulting in unnecessary energy waste.
Increase in power demands
The increased power demands due to AI necessitate a significantly larger number of chillers and air-handling units. As these increase, so does the need to expand the UPS, battery and generator capacity. This means that while the floor space demand for data halls might become smaller due to increased density, the demands of AI will offset this.
Therefore, the key issue is responsible AI and responsible big data. It is easy to say we need these technologies and start building data centres, but we often overlook their environmental impact and the design considerations involved. The cost of AI becomes a significant concern when we do not factor in these aspects.
When we start building large data centres with significant loads, we need to adopt new design approaches rather than rely on historical methods. The responsibility for this is clear – responsible AI is not just about using the latest technology but about making thoughtful, sustainable choices.
All eyes on the modern DCS platform Schneider Electric South Africa
PLCs, DCSs & Controllers
Modernised DCS platforms are no longer confined to hardware-dependent architectures. These systems have evolved to combine the strengths of both PLCs and DCS while adding capabilities that make them more open, resilient and collaborative.
Read more...Why choose between Capex and Opex if you can Totex? Schneider Electric South Africa
IT in Manufacturing
In a sector marked by cyclical demand, high capital intensity, and increasing regulatory and sustainability pressures, mining, minerals and metals (MMM) companies are re-evaluating how they approach procurement and investment.
Read more...AI and the smart factory Schneider Electric South Africa
IT in Manufacturing
Imagine walking into a factory where machines can think ahead, predict problems before they happen and automatically make adjustments to realise peak performance. This isn’t science fiction, it’s happening right now as AI continues to transform how we run industrial operations.
Read more...Why your supply chain should be a competitive advantage Schneider Electric South Africa
IT in Manufacturing
The last five years have placed unprecedented strain on global supply chains. Leading companies are turning the challenge into an opportunity to transform their supply chains into a competitive advantage.
Read more...Real-time modelling is the key to a resilient, bi-directional energy grid Schneider Electric South Africa
Electrical Power & Protection
Utilities and municipalities are facing a challenge as the country’s legacy power grid, engineered for one-way energy delivery from centralised suppliers to end-users, must rapidly evolve to meet a new paradigm.
Read more...Shielding data centre growth from the looming power crunch Schneider Electric South Africa
Electrical Power & Protection
Today’s digital economy is placing unprecedented strain on the power grid. The good news is that these challenges are not insurmountable. By adopting proactive strategies such as alternative power sources, infrastructure planning and software, operators can secure capacity, build resilient facilities and scale sustainably.
Read more...Circuit breaker innovations Schneider Electric South Africa
Electrical Power & Protection
Recent advancements in circuit breaker technology have seen a major step forward in setting new standards for efficiency and sustainability in data centres, industrial and commercial infrastructure.
Read more...Why AI will never truly understand machines Wearcheck
IT in Manufacturing
Cutting-edge technology and solutions powered by AI are embraced by specialist condition monitoring company, WearCheck, where the extreme accuracy of data used to assess and diagnose machine health is paramount.
Read more...Buildings and microgrids for a greener future Schneider Electric South Africa
IT in Manufacturing
Buildings are no longer passive consumers of power. Structures of almost every size are evolving into dynamic energy ecosystems capable of generating, storing and distributing their own electricity. Forming part of this exciting transformation are microgrids.
Read more...Africa’s brightest young battery innovators Schneider Electric South Africa
News
Schneider Electric and Enactus, the international NGO dedicated to inspiring students through entrepreneurial action, have announced the winners of the 2025 Energy Transition Battery Innovation Challenge, funded by the Schneider Electric Foundation. It empowers young innovators to design battery solutions addressing the region’s most pressing energy challenges.
While every effort has been made to ensure the accuracy of the information contained herein, the publisher and its agents cannot be held responsible for any errors contained, or any loss incurred as a result. Articles published do not necessarily reflect the views of the publishers. The editor reserves the right to alter or cut copy. Articles submitted are deemed to have been cleared for publication. Advertisements and company contact details are published as provided by the advertiser. Technews Publishing (Pty) Ltd cannot be held responsible for the accuracy or veracity of supplied material.
printer friendly version