By Ben Selier, VP of Secure Power for Anglophone Africa at Schneider Electric.
The rise in hardware density in data centres is gaining speed and is largely driven by the demands of artificial intelligence (AI) and machine learning (ML), requiring more powerful servers and specialised hardware. Kilowatt demands per rack can reach 18 kW or more, necessitating increased cooling and larger real estate, all of which adds to costs.
As data centres move towards higher density GPU-based systems, kilowatt demands per rack can soar with cabinets now running up to 40 kW, compared to the previous 3 to 7 kW. The resultant increase in concentrated heat load is like operating a heater inside the data centre, putting a huge amount of stress on the cooling systems.
One of the primary challenges that arises is that traditional cooling methods are proving inadequate. While it is possible to cool the high-density loads with air, the infrastructure required becomes almost impossible. As such, air cooling is reaching its limits as it requires producing a huge amount of slow-moving air, which is very difficult to do in the small spaces of a data centre.
Manage airflow better
This has led to the use of containments and wind walls to better manage the airflow inside the data centre in the latest designs, driven by the need to move beyond air cooling as it is inefficient and costly to cool these high-density loads with air.
Liquid cooling options such as cooling the chip, back door cooling and immersion cooling are better and more sustainable options for the current high-density loads. Additionally, liquid cooling solutions are necessary to achieve sustainable or green AI as air cooling will not be able to provide the required efficiency.
Ultimately, liquid cooling provides a more efficient solution for managing thermal output in high-density data centres as water is about 10 times more effective than air at removing heat. Liquid cooling also targets heat removal directly from equipment, such as the chips and GPUs, unlike air cooling, which cools the entire room − including less critical areas − resulting in unnecessary energy waste.
Increase in power demands
The increased power demands due to AI necessitate a significantly larger number of chillers and air-handling units. As these increase, so does the need to expand the UPS, battery and generator capacity. This means that while the floor space demand for data halls might become smaller due to increased density, the demands of AI will offset this.
Therefore, the key issue is responsible AI and responsible big data. It is easy to say we need these technologies and start building data centres, but we often overlook their environmental impact and the design considerations involved. The cost of AI becomes a significant concern when we do not factor in these aspects.
When we start building large data centres with significant loads, we need to adopt new design approaches rather than rely on historical methods. The responsibility for this is clear – responsible AI is not just about using the latest technology but about making thoughtful, sustainable choices.
Looking into the future of machine vision Omron Electronics
IT in Manufacturing
Artificial intelligence (AI) is driving a significant transformation in all areas of industrial automation, and machine vision is no exception. Omron’s AI-powered machine vision systems seamlessly integrate state-of-the-art algorithms, enabling machines to analyse and interpret visual data meticulously.
Read more...Driving digital transformation in the truck industry Siemens South Africa
IT in Manufacturing
Tatra Trucks, a leading truck manufacturer in Czechia, has adopted the Siemens Xcelerator portfolio of industry software including Teamcenter software for product lifecycle management and the Mendix low code platform to help increase production volume and strengthen its ability to manufacture vehicles that meet specific customer requirements.
Read more...Opinion piece: Digital twins in manufacturing – design, optimise and expand Schneider Electric South Africa
IT in Manufacturing
Digital twin technology can help create better products, fast. It can also transform the work of product development. This strong statement from McKinsey reinforces how far digital twins have come in manufacturing.
Read more...UPS systems are key to keeping SA’s automotive industry up and running Schneider Electric South Africa
Electrical Power & Protection
During loadshedding, PLCs and OT systems often fail, not because they are directly tied to the factory’s core manufacturing process, but because they are now an integral part of IT infrastructure. When an IT system shuts down, the impact is far more complex than simply restarting machinery.
Read more...Asset tracking is key to driving operational excellence and sustainable growth Schneider Electric South Africa
IT in Manufacturing
Asset tracking plays a critical role in the success of industrial businesses. By effectively managing and monitoring assets, companies can optimise their operations, ensuring that resources are used efficiently. This leads to improved productivity and reduced costs.
Read more...Advanced contactor solution to revolutionise motor management Schneider Electric South Africa
Electrical Power & Protection
Schneider Electric South Africa has launched the TeSys Deca Advanced, an advanced contactor solution designed to revolutionise motor management with unparalleled efficiency, reliability, simplicity and sustainability.
Read more...Enhancing cyber security for industrial drives Siemens South Africa
IT in Manufacturing
The growing connection between production networks and office networks as part of IT/OT integration and the utilisation of IoT have many benefits for industrial companies. At the same time, they also increase the risk of cyber threats. Siemens ensures that your know-how and plants are protected at all times.
printer friendly version