By Ben Selier, VP of Secure Power for Anglophone Africa at Schneider Electric.
The rise in hardware density in data centres is gaining speed and is largely driven by the demands of artificial intelligence (AI) and machine learning (ML), requiring more powerful servers and specialised hardware. Kilowatt demands per rack can reach 18 kW or more, necessitating increased cooling and larger real estate, all of which adds to costs.
As data centres move towards higher density GPU-based systems, kilowatt demands per rack can soar with cabinets now running up to 40 kW, compared to the previous 3 to 7 kW. The resultant increase in concentrated heat load is like operating a heater inside the data centre, putting a huge amount of stress on the cooling systems.
One of the primary challenges that arises is that traditional cooling methods are proving inadequate. While it is possible to cool the high-density loads with air, the infrastructure required becomes almost impossible. As such, air cooling is reaching its limits as it requires producing a huge amount of slow-moving air, which is very difficult to do in the small spaces of a data centre.
Manage airflow better
This has led to the use of containments and wind walls to better manage the airflow inside the data centre in the latest designs, driven by the need to move beyond air cooling as it is inefficient and costly to cool these high-density loads with air.
Liquid cooling options such as cooling the chip, back door cooling and immersion cooling are better and more sustainable options for the current high-density loads. Additionally, liquid cooling solutions are necessary to achieve sustainable or green AI as air cooling will not be able to provide the required efficiency.
Ultimately, liquid cooling provides a more efficient solution for managing thermal output in high-density data centres as water is about 10 times more effective than air at removing heat. Liquid cooling also targets heat removal directly from equipment, such as the chips and GPUs, unlike air cooling, which cools the entire room − including less critical areas − resulting in unnecessary energy waste.
Increase in power demands
The increased power demands due to AI necessitate a significantly larger number of chillers and air-handling units. As these increase, so does the need to expand the UPS, battery and generator capacity. This means that while the floor space demand for data halls might become smaller due to increased density, the demands of AI will offset this.
Therefore, the key issue is responsible AI and responsible big data. It is easy to say we need these technologies and start building data centres, but we often overlook their environmental impact and the design considerations involved. The cost of AI becomes a significant concern when we do not factor in these aspects.
When we start building large data centres with significant loads, we need to adopt new design approaches rather than rely on historical methods. The responsibility for this is clear – responsible AI is not just about using the latest technology but about making thoughtful, sustainable choices.
How smart signalling can transform Africa’s manufacturing future Schneider Electric South Africa
Industrial Wireless
Imagine a factory floor where humans and machines communicate in real time with issues flagged instantly, workflows adjusted seamlessly and downtime reduced to near zero. This is the reality unfolding across Africa as manufacturers embrace the next generation of intelligent signalling technologies.
Read more...Unpacking the technoeconomic case for cleaner power in wastewater plants Schneider Electric South Africa
Electrical Power & Protection
Behind every reliable wastewater plant is an electrical system exposed to the effects of harmonics, voltage distortion and overloaded networks caused by fleets of variable speed drives on pumps and aerators.Together, they steadily drive up maintenance demands and elevate the risk of failure.
Read more...Rethinking power for Africa’s data centres Schneider Electric South Africa
Electrical Power & Protection
Africa’s digital economy is scaling faster than its power systems. If it wants resilient, competitive and sustainable data centres, the starting point must be a grid-to-chip architecture rather than a genset-first mentality.
Read more...Siemens ecosystem strengthens data and AI integration Siemens South Africa
IT in Manufacturing
Siemens has announced significant expansions to its Industrial Edge ecosystem, accelerating data and AI integration and releasing enhanced cybersecurity functionalities. These enable a seamless integration of IT and OT environments, optimise processes and reduce operational disruptions.
Read more...Unifying building information into a sea of insight Schneider Electric South Africa
Electrical Power & Protection
Facility managers realise that in order to gain the most from building automation, they can longer deploy and operate technologies in isolation. Modern, integrated building management solutions address this challenge by bringing data from multiple sources and dispersed locations like HVAC, lighting, access control, lifts, generators, field devices, energy and
Read more...Why digital LV switchboards matter Schneider Electric South Africa
Electrical Power & Protection
Today’s buildings account for up to 40% of global energy consumption and CO2 emissions. However, buildings are also expected to deliver higher availability and stronger safety performance while also being sustainable. Digital swirchboards make a difference in the way buildings are developed, upgraded and managed.
Read more...Siemens manages shipbuilding process for HD Hyundai Siemens South Africa
IT in Manufacturing
Siemens has been selected by HD Korea Shipbuilding & Offshore Engineering as a preferred partner to establish an integrated platform to manage the entire shipbuilding process as a single data flow to help ensure consistency across all its global shipyard facilities.
Read more...The new energy landscape for buildings will be enabled by e-mobility Schneider Electric South Africa
Electrical Power & Protection
The adoption of the electric vehicle continues to proliferate, and buildings are becoming a vital part of the e-mobility movement, which requires a whole new approach to energy management.
Read more...Transforming the process industry through digitalisation Endress+Hauser South Africa
IT in Manufacturing
By connecting field devices, systems and people, digitalisation creates new opportunities to optimise operations, enhance maintenance strategies and support continuous improvement. As a leading instrumentation provider and major source of process data, Endress+Hauser plays a key role in enabling this transformation.
While every effort has been made to ensure the accuracy of the information contained herein, the publisher and its agents cannot be held responsible for any errors contained, or any loss incurred as a result. Articles published do not necessarily reflect the views of the publishers. The editor reserves the right to alter or cut copy. Articles submitted are deemed to have been cleared for publication. Advertisements and company contact details are published as provided by the advertiser. Technews Publishing (Pty) Ltd cannot be held responsible for the accuracy or veracity of supplied material.
printer friendly version