By Ben Selier, VP of Secure Power for Anglophone Africa at Schneider Electric.
The rise in hardware density in data centres is gaining speed and is largely driven by the demands of artificial intelligence (AI) and machine learning (ML), requiring more powerful servers and specialised hardware. Kilowatt demands per rack can reach 18 kW or more, necessitating increased cooling and larger real estate, all of which adds to costs.
As data centres move towards higher density GPU-based systems, kilowatt demands per rack can soar with cabinets now running up to 40 kW, compared to the previous 3 to 7 kW. The resultant increase in concentrated heat load is like operating a heater inside the data centre, putting a huge amount of stress on the cooling systems.
One of the primary challenges that arises is that traditional cooling methods are proving inadequate. While it is possible to cool the high-density loads with air, the infrastructure required becomes almost impossible. As such, air cooling is reaching its limits as it requires producing a huge amount of slow-moving air, which is very difficult to do in the small spaces of a data centre.
Manage airflow better
This has led to the use of containments and wind walls to better manage the airflow inside the data centre in the latest designs, driven by the need to move beyond air cooling as it is inefficient and costly to cool these high-density loads with air.
Liquid cooling options such as cooling the chip, back door cooling and immersion cooling are better and more sustainable options for the current high-density loads. Additionally, liquid cooling solutions are necessary to achieve sustainable or green AI as air cooling will not be able to provide the required efficiency.
Ultimately, liquid cooling provides a more efficient solution for managing thermal output in high-density data centres as water is about 10 times more effective than air at removing heat. Liquid cooling also targets heat removal directly from equipment, such as the chips and GPUs, unlike air cooling, which cools the entire room − including less critical areas − resulting in unnecessary energy waste.
Increase in power demands
The increased power demands due to AI necessitate a significantly larger number of chillers and air-handling units. As these increase, so does the need to expand the UPS, battery and generator capacity. This means that while the floor space demand for data halls might become smaller due to increased density, the demands of AI will offset this.
Therefore, the key issue is responsible AI and responsible big data. It is easy to say we need these technologies and start building data centres, but we often overlook their environmental impact and the design considerations involved. The cost of AI becomes a significant concern when we do not factor in these aspects.
When we start building large data centres with significant loads, we need to adopt new design approaches rather than rely on historical methods. The responsibility for this is clear – responsible AI is not just about using the latest technology but about making thoughtful, sustainable choices.
The next generation of engineers is building living labs of innovation Schneider Electric South Africa
IT in Manufacturing
Graduate engineers at Schneider Electric East Africa designed, integrated and commissioned the smart building systems in the company’s new Nairobi head office, demonstrating how practical, real-world project experience accelerates engineering capability and confidence.
Read more...Innodisk launches APEX series edge AI systems for industrial deployment Vepac Electronics
IT in Manufacturing
Innodisk has launched its APEX series edge AI systems, combining hardware, software and system design to simplify industrial AI deployment. The APEX-A100, powered by Qualcomm’s Dragonwing IQ9 processor, delivers up to 100 TOPS with guaranteed availability through 2038.
Read more...Pilot project to optimise material flow
IT in Manufacturing
WEBER-HYDRAULIK has commissioned autonomous transport robots at its Güglingen site to handle internal material transport between warehouse and assembly areas. The pilot project uses RFID integration and SAP connectivity to automate material flows and reduce manual transport tasks.
Read more...Accelerating pharmaceutical digital compliance and operational efficiency Schneider Electric South Africa
IT in Manufacturing
Cosmos Limited, one of Kenya’s leading pharmaceutical manufacturers, has partnered with Schneider Electric to implement an integrated monitoring, energy management and digital validation platform that has improved operational visibility, data integrity and regulatory compliance readiness.
Read more...How certified industrial automation channels become co-creators in the AI era Schneider Electric South Africa
System Integration & Control Systems Design
As industrial automation becomes software-driven and AI-enabled, the role of channel partners is shifting from equipment supply to outcome-based consulting, software integration and lifecycle services that require continuous certification and capability development.
Read more...Mining’s decarbonisation journey starts now Schneider Electric South Africa
Electrical Power & Protection
Mining companies are embedding decarbonisation into core operational strategies as technology, advisory services and digital platforms help translate ESG commitments into measurable environmental and business outcomes.
Read more...AI data centres, nature and innovation Schneider Electric South Africa
IT in Manufacturing
Artificial intelligence is driving unprecedented demand for data centre capacity, with liquid cooling now central to managing the heat generated by high-density GPU clusters. Schneider Electric examines how next-generation data centres can balance performance with environmental responsibility.
Read more...Siemens powers next-generation reusable spacecraft development Siemens South Africa
IT in Manufacturing
A European aerospace startup focused on reusable space systems, has adopted Siemens Xcelerator software to connect engineering disciplines, reduce rework and accelerate spacecraft development, cutting the path from concept to flight hardware to nine months for its orbital demonstration capsule.
Read more...Decarbonising the energies and chemical industry without the risk Schneider Electric South Africa
Electrical Power & Protection
Schneider Electric argues that decarbonisation in Africa’s energies and chemical industry need not compromise production or profitability. A phased, digitally enabled approach, starting with energy efficiency improvements, can reduce emissions while strengthening competitiveness.
Read more...How to navigate the high-stakes economics of AI infrastructure
IT in Manufacturing
Nearly 60% of data centre operators are expected to adopt liquid cooling within five years as AI workloads drive demand for higher rack densities. Understanding the full financial picture of liquid cooling, from capital investment to long-term operational savings, is now essential.
While every effort has been made to ensure the accuracy of the information contained herein, the publisher and its agents cannot be held responsible for any errors contained, or any loss incurred as a result. Articles published do not necessarily reflect the views of the publishers. The editor reserves the right to alter or cut copy. Articles submitted are deemed to have been cleared for publication. Advertisements and company contact details are published as provided by the advertiser. Technews Publishing (Pty) Ltd cannot be held responsible for the accuracy or veracity of supplied material.
printer friendly version