By Ben Selier, VP of Secure Power for Anglophone Africa at Schneider Electric.
The rise in hardware density in data centres is gaining speed and is largely driven by the demands of artificial intelligence (AI) and machine learning (ML), requiring more powerful servers and specialised hardware. Kilowatt demands per rack can reach 18 kW or more, necessitating increased cooling and larger real estate, all of which adds to costs.
As data centres move towards higher density GPU-based systems, kilowatt demands per rack can soar with cabinets now running up to 40 kW, compared to the previous 3 to 7 kW. The resultant increase in concentrated heat load is like operating a heater inside the data centre, putting a huge amount of stress on the cooling systems.
One of the primary challenges that arises is that traditional cooling methods are proving inadequate. While it is possible to cool the high-density loads with air, the infrastructure required becomes almost impossible. As such, air cooling is reaching its limits as it requires producing a huge amount of slow-moving air, which is very difficult to do in the small spaces of a data centre.
Manage airflow better
This has led to the use of containments and wind walls to better manage the airflow inside the data centre in the latest designs, driven by the need to move beyond air cooling as it is inefficient and costly to cool these high-density loads with air.
Liquid cooling options such as cooling the chip, back door cooling and immersion cooling are better and more sustainable options for the current high-density loads. Additionally, liquid cooling solutions are necessary to achieve sustainable or green AI as air cooling will not be able to provide the required efficiency.
Ultimately, liquid cooling provides a more efficient solution for managing thermal output in high-density data centres as water is about 10 times more effective than air at removing heat. Liquid cooling also targets heat removal directly from equipment, such as the chips and GPUs, unlike air cooling, which cools the entire room − including less critical areas − resulting in unnecessary energy waste.
Increase in power demands
The increased power demands due to AI necessitate a significantly larger number of chillers and air-handling units. As these increase, so does the need to expand the UPS, battery and generator capacity. This means that while the floor space demand for data halls might become smaller due to increased density, the demands of AI will offset this.
Therefore, the key issue is responsible AI and responsible big data. It is easy to say we need these technologies and start building data centres, but we often overlook their environmental impact and the design considerations involved. The cost of AI becomes a significant concern when we do not factor in these aspects.
When we start building large data centres with significant loads, we need to adopt new design approaches rather than rely on historical methods. The responsibility for this is clear – responsible AI is not just about using the latest technology but about making thoughtful, sustainable choices.
Read more...Hybrid DCS for an evolving industrial landscape Schneider Electric South Africa
PLCs, DCSs & Controllers
Today’s industrial automation continues to evolve at a blistering speed, which means traditional DCSs have to keep up to ensure continuous integration into modern, digital infrastructure.
Read more...Harnessing AI and satellite imagery to estimate water levels in dams
IT in Manufacturing
Farmers and water managers often struggle to accurately estimate and monitor the available water in dams. To address the challenge, International Water Management Institute researchers have worked with Digital Earth Africa to create an innovation that uses satellite images and AI to get timely and accurate dam volume measurements.
Read more...Why industry should enter the world of operator training simulators Schneider Electric South Africa
IT in Manufacturing
System-agnostic operator training simulator (OTS) software is a somewhat unsung hero of industry that trains plant operators in a virtual world that mirrors real-world operations. The benefits are multiple.
Read more...Track busway for scalable data centre power delivery
IT in Manufacturing
The latest generation Legrand Data Centre Track Busway technology addresses the operational pressures facing today’s high-density, AI-intensive computing environments and is being well received by data centre facilities around the world.
Read more...Energy audits pave the pathway to sustainability and savings Schneider Electric South Africa
Electrical Power & Protection
Energy audits serve as essential tools for businesses looking to reduce costs and meet environmental targets. By analysing energy consumption across systems such as lighting, HVAC, ICT and water infrastructure, audits identify inefficiencies and quantify carbon footprints, enabling data-driven decisions for operational and financial optimisation.
Read more...Poor heat management in data centre design
IT in Manufacturing
Designing a world-class data centre goes beyond simply keeping servers on during load shedding; it is about ensuring they run efficiently, reliably, and within the precise environmental conditions they were built and designed for.
Read more...Schneider Electric unveils new range of circuit breakers Schneider Electric South Africa
Electrical Power & Protection
Schneider Electric has launched its new MasterPacT MTZ Active range of circuit breakers in South Africa. This is a revolutionary new circuit breaker designed to set new benchmarks for safety, efficiency and sustainability while ensuring business continuity.
Read more...It’s time to fight AI with AI in the battle for cyber resilience
IT in Manufacturing
Cybercrime is evolving rapidly, and the nature of cyber threats has shifted dramatically. Attacks are now increasingly powered by AI, accelerating their speed, scale and sophistication. Cybersecurity needs to become part of business-critical strategy, powered by AI to match attackers’ speed with smarter, faster and more adaptive defences.
While every effort has been made to ensure the accuracy of the information contained herein, the publisher and its agents cannot be held responsible for any errors contained, or any loss incurred as a result. Articles published do not necessarily reflect the views of the publishers. The editor reserves the right to alter or cut copy. Articles submitted are deemed to have been cleared for publication. Advertisements and company contact details are published as provided by the advertiser. Technews Publishing (Pty) Ltd cannot be held responsible for the accuracy or veracity of supplied material.
printer friendly version