By Ben Selier, VP of Secure Power for Anglophone Africa at Schneider Electric.
The rise in hardware density in data centres is gaining speed and is largely driven by the demands of artificial intelligence (AI) and machine learning (ML), requiring more powerful servers and specialised hardware. Kilowatt demands per rack can reach 18 kW or more, necessitating increased cooling and larger real estate, all of which adds to costs.
As data centres move towards higher density GPU-based systems, kilowatt demands per rack can soar with cabinets now running up to 40 kW, compared to the previous 3 to 7 kW. The resultant increase in concentrated heat load is like operating a heater inside the data centre, putting a huge amount of stress on the cooling systems.
One of the primary challenges that arises is that traditional cooling methods are proving inadequate. While it is possible to cool the high-density loads with air, the infrastructure required becomes almost impossible. As such, air cooling is reaching its limits as it requires producing a huge amount of slow-moving air, which is very difficult to do in the small spaces of a data centre.
Manage airflow better
This has led to the use of containments and wind walls to better manage the airflow inside the data centre in the latest designs, driven by the need to move beyond air cooling as it is inefficient and costly to cool these high-density loads with air.
Liquid cooling options such as cooling the chip, back door cooling and immersion cooling are better and more sustainable options for the current high-density loads. Additionally, liquid cooling solutions are necessary to achieve sustainable or green AI as air cooling will not be able to provide the required efficiency.
Ultimately, liquid cooling provides a more efficient solution for managing thermal output in high-density data centres as water is about 10 times more effective than air at removing heat. Liquid cooling also targets heat removal directly from equipment, such as the chips and GPUs, unlike air cooling, which cools the entire room − including less critical areas − resulting in unnecessary energy waste.
Increase in power demands
The increased power demands due to AI necessitate a significantly larger number of chillers and air-handling units. As these increase, so does the need to expand the UPS, battery and generator capacity. This means that while the floor space demand for data halls might become smaller due to increased density, the demands of AI will offset this.
Therefore, the key issue is responsible AI and responsible big data. It is easy to say we need these technologies and start building data centres, but we often overlook their environmental impact and the design considerations involved. The cost of AI becomes a significant concern when we do not factor in these aspects.
When we start building large data centres with significant loads, we need to adopt new design approaches rather than rely on historical methods. The responsibility for this is clear – responsible AI is not just about using the latest technology but about making thoughtful, sustainable choices.
Transforming pulp and paper with automation and digitalisation ABB South Africa
IT in Manufacturing
The pulp and paper industry in South Africa is undergoing a significant transformation from traditional manual processes to embracing automation technologies. Automation in pulp and paper mills aims to improve various production stages, from raw material preparation to final product creation.
Read more...Medium voltage drive for enhanced energy efficiency and process optimisation Schneider Electric South Africa
Motion Control & Drives
Schneider Electric South Africa has unveiled its cutting-edge Altivar Process ATV6100 medium voltage (MV) drive range, designed to enhance energy efficiency and operational reliability across various industries.
Read more...New enhanced Breaker Status and Communication Module Schneider Electric South Africa
Electrical Power & Protection
Schneider Electric has launched its new Breaker Status and Communication Module (BSCM) Modbus SL/ULP, which delivers enhanced performance, improved connectivity and simplified integration for power distribution systems.
Read more...Schneider Electric honoured with Gender Leader Award Schneider Electric South Africa
News
Schneider Electric has been awarded the Gender Leader Award at this year’s Africa CEO Forum. This award acknowledges those organisations operating in Africa that have shown a significant and continuous commitment to gender diversity and inclusion.
Read more...Protecting industrial networks with resilient defence RJ Connect
IT in Manufacturing
Network security is no longer just about preventing hacking or data breaches. For operational technology networks, resilient defence and consistent uptime are crucial. They are the core tenets that underpin Moxa’s guarded uptime and resilient defence (GUARD).
Read more...The sensory reaction of building management systems Schneider Electric South Africa
Sensors & Transducers
Today’s building management systems (BMS) cannot function properly without sensors. This is so critical that if sensors start failing, they can become ‘blind’.
Read more...The metaverse is now: are you ready to reimagine your business?
IT in Manufacturing
The convergence of the digital and physical worlds, driven by spatial computing and the metaverse, is rapidly reshaping business landscapes. This transformation extends beyond the mere novelty of virtual reality headsets and augmented reality filters, signalling a fundamental shift in how organisations operate, collaborate and innovate.
Read more...Condition-based maintenance can revolutionise business continuity Schneider Electric South Africa
Electrical Power & Protection
As businesses experience growing pressure to enhance operational efficiency and reduce downtime due to electrical failure, condition-based maintenance becomes essential for preventing unforeseen equipment breakdowns by assessing the real-time health of electrical systems.
Read more...Ball valves and actuators optimise HVAC performance Schneider Electric South Africa
Valves, Actuators & Pump Control
Schneider Electric offers the full range of innovative SpaceLogic and EasyLogic ball valves and actuators. These cutting-edge products are designed to optimise HVAC system performance, ensuring comfort and energy efficiency in commercial and residential buildings.
printer friendly version