IT in Manufacturing


AI is driving data centres to the edge

April 2024 IT in Manufacturing

The data centre has become the cornerstone that links our digitally interconnected world. At the same time, the rapid growth and application of artificial intelligence (AI) and machine learning (ML) is shaping the design and operation of data centres. The training requirements associated with AI are driving new chip and server technologies and the need for extreme rack power densities. The distinction between training and inference is critical when designing AI systems. Training workloads are used to train AI models like large language models (LLMs). These workloads require massive amounts of data fed to specialised servers with processors known as accelerators.


Ben Selier, vice president, Secure Power, Anglophone Africa at Schneider Electric.

Inference models might be deployed on edge devices or cloud servers, depending on the application’s needs, and take the previously trained AI model into production to predict the output of new queries (inputs). This demand for high-performance computing has led to increased requirements for powerful servers, GPUs and other specialised hardware within data centres to support workloads.

At the same time, the rise of edge computing, where computing resources are brought closer to the location where data is generated, is driven in part by AI applications. Edge data centres are deployed to reduce latency and enhance the performance of AI applications in scenarios where real-time processing is critical.

The servers supporting these AI applications use advanced AI chipsets, more commonly known as AI accelerators. These chipsets play a crucial role in enhancing the performance of AI applications across various domains.

Energy consumption and demand for power

Modern data centres use high-density servers and equipment that demand more power for processing. This leads to concentrated energy usage in smaller spaces, increasing the overall energy footprint, which can raise concerns about the amount of energy required to process AI operations.

For example, if your AI model is operating emergency vehicle routing, it will need to process high-definition videos and traffic patterns to perform real-time operations to clear the traffic. This would probably be an IT network of high speed, or networked edge AI data centres that could process a larger amount of data and deliver real time decisions and predictions. As the dependence on AI continues, new technologies and techniques will be deployed to make AI faster and more accurate and efficient.

One of these techniques is moving compressed models to the edge in the form of edge AI data centres. This will enable businesses to match the application to the model and optimise performance and the energy use.

The rapid growth in data traffic

The emergence of autonomous AI agents and decision-making programs holds the potential to revolutionise various aspects of business operations. These intelligent programs perform tasks independently, adapting and learning from its environment.

With increasing AI-driven automation, data centre employees can then automate routine tasks, reduce manual workloads and enhance overall efficiency, as responsibilities such as server system maintenance or system monitoring can be handled by these intelligence programs.

AI and data centre evolution

As AI technology advances, it will continue to influence the design and operation of data centres. While these advancements bring efficiency and innovation, this also poses challenges related to energy consumption, power and cooling systems.

This relentless advancement of AI is only going to continue, and to meet these evolving needs, the data centre industry needs to adapt. Schneider Electric offers guidance on best practices for embracing scalable and flexible infrastructure design to support intensive AI workloads. Strategies include deploying high-efficiency and high-capacity power systems and liquid cooling systems, 48U wide enclosures, upgrading hardware, and data centre infrastructure management.


Credit(s)



Share this article:
Share via emailShare via LinkedInPrint this page

Further reading:

Prefabricated data centres for an AI-focused future at the edge
Schneider Electric South Africa IT in Manufacturing
As AI technologies continue to advance, data centres are being pushed to the edge, reshaping their operations to meet daily demands. To meet the relentless demands of AI workloads at the edge, prefabricated data centre solutions offer a scalable, efficient and fast alternative to traditional builds.

Read more...
Quantum computing and its impact on data security: a double-edged sword for the digital age
IT in Manufacturing
Quantum computing is poised to redefine the boundaries of data security, offering groundbreaking solutions while threatening modern encryption’s foundations. For third-party IT providers, this duality presents both a challenge and an opportunity to lead organisations through one of the most significant technological transitions in decades.

Read more...
TechAccess and Schneider Electric partnership goes from strength to strength
Schneider Electric South Africa News
Schneider Electric, together with its longstanding partner TechAccess, is poised to take the Southern African market by storm.

Read more...
Next-generation road-legal race car.
Siemens South Africa IT in Manufacturing
Siemens Digital Industries Software has announced that Briggs Automotive Company (BAC) will move to the Siemens Xcelerator portfolio of industry software and use it to develop the next generation of its single-seater road-legal race car, Mono.

Read more...
Cybersecurity at a crossroads
IT in Manufacturing
here’s a growing unease in boardrooms, data centres and cabinet offices across South Africa. It’s not just about economic headwinds or political uncertainty, it’s about something quieter, more technical and yet just as dangerous - the rising tide of cyber threats.

Read more...
Enabling a sustainable industrial organisation
IT in Manufacturing
This article explains the top sustainability trends and key actions that you can leverage to become a more sustainable organisation.

Read more...
Navigating discrete manufacturing in South Africa through digitalisation
IT in Manufacturing
South Africa’s discrete manufacturing sector faces mounting pressure from global competition, fragmented supply chains and outdated infrastructure. In this complex environment, digitalisation is a critical lever for survival, resilience and growth.

Read more...
Africa’s pragmatic approach to AI and how data centres are enabling it
Schneider Electric South Africa IT in Manufacturing
In Africa, the current AI momentum is driven by a fundamental need, building a resilient digital infrastructure that addresses the real-world challenges of the continent’s communities.

Read more...
World first simulation of error-correctable quantum computers
IT in Manufacturing
Quantum computers still face a major hurdle on their pathway to practical use cases, their limited ability to correct the arising computational errors. In a world first, researchers from Chalmers University of Technology in Sweden have unveiled a method for simulating specific types of error-corrected quantum computations.

Read more...
Platform to accelerate supply chain decarbonisation
Schneider Electric South Africa IT in Manufacturing
Schneider Electric has launched Zeigo Hub by Schneider Electric, a powerful new digital platform designed to help organisations decarbonise their supply chains at scale.

Read more...









While every effort has been made to ensure the accuracy of the information contained herein, the publisher and its agents cannot be held responsible for any errors contained, or any loss incurred as a result. Articles published do not necessarily reflect the views of the publishers. The editor reserves the right to alter or cut copy. Articles submitted are deemed to have been cleared for publication. Advertisements and company contact details are published as provided by the advertiser. Technews Publishing (Pty) Ltd cannot be held responsible for the accuracy or veracity of supplied material.




© Technews Publishing (Pty) Ltd | All Rights Reserved