IT in Manufacturing


AI is driving data centres to the edge

April 2024 IT in Manufacturing

The data centre has become the cornerstone that links our digitally interconnected world. At the same time, the rapid growth and application of artificial intelligence (AI) and machine learning (ML) is shaping the design and operation of data centres. The training requirements associated with AI are driving new chip and server technologies and the need for extreme rack power densities. The distinction between training and inference is critical when designing AI systems. Training workloads are used to train AI models like large language models (LLMs). These workloads require massive amounts of data fed to specialised servers with processors known as accelerators.


Ben Selier, vice president, Secure Power, Anglophone Africa at Schneider Electric.

Inference models might be deployed on edge devices or cloud servers, depending on the application’s needs, and take the previously trained AI model into production to predict the output of new queries (inputs). This demand for high-performance computing has led to increased requirements for powerful servers, GPUs and other specialised hardware within data centres to support workloads.

At the same time, the rise of edge computing, where computing resources are brought closer to the location where data is generated, is driven in part by AI applications. Edge data centres are deployed to reduce latency and enhance the performance of AI applications in scenarios where real-time processing is critical.

The servers supporting these AI applications use advanced AI chipsets, more commonly known as AI accelerators. These chipsets play a crucial role in enhancing the performance of AI applications across various domains.

Energy consumption and demand for power

Modern data centres use high-density servers and equipment that demand more power for processing. This leads to concentrated energy usage in smaller spaces, increasing the overall energy footprint, which can raise concerns about the amount of energy required to process AI operations.

For example, if your AI model is operating emergency vehicle routing, it will need to process high-definition videos and traffic patterns to perform real-time operations to clear the traffic. This would probably be an IT network of high speed, or networked edge AI data centres that could process a larger amount of data and deliver real time decisions and predictions. As the dependence on AI continues, new technologies and techniques will be deployed to make AI faster and more accurate and efficient.

One of these techniques is moving compressed models to the edge in the form of edge AI data centres. This will enable businesses to match the application to the model and optimise performance and the energy use.

The rapid growth in data traffic

The emergence of autonomous AI agents and decision-making programs holds the potential to revolutionise various aspects of business operations. These intelligent programs perform tasks independently, adapting and learning from its environment.

With increasing AI-driven automation, data centre employees can then automate routine tasks, reduce manual workloads and enhance overall efficiency, as responsibilities such as server system maintenance or system monitoring can be handled by these intelligence programs.

AI and data centre evolution

As AI technology advances, it will continue to influence the design and operation of data centres. While these advancements bring efficiency and innovation, this also poses challenges related to energy consumption, power and cooling systems.

This relentless advancement of AI is only going to continue, and to meet these evolving needs, the data centre industry needs to adapt. Schneider Electric offers guidance on best practices for embracing scalable and flexible infrastructure design to support intensive AI workloads. Strategies include deploying high-efficiency and high-capacity power systems and liquid cooling systems, 48U wide enclosures, upgrading hardware, and data centre infrastructure management.


Credit(s)



Share this article:
Share via emailShare via LinkedInPrint this page

Further reading:

How AI is transforming software engineering in South Africa
IT in Manufacturing
Artificial intelligence is fundamentally reshaping the landscape of software engineering, particularly in South Africa, where the demand for innovative solutions is rapidly increasing.

Read more...
Turbomachinery controls: the call of duty
Schneider Electric South Africa Motion Control & Drives
There’s a lot to be said about the unsung heroes of this world; those men, women and machines that deliver such important functions, often overlooked and recognised. One such machine is turbomachinery, and while the name does sound quite obvious to the layman, its rich history and daily functions are not.

Read more...
Schneider Electric again named World’s Most Sustainable Corporation
Schneider Electric South Africa News
Schneider Electric has been named the World’s Most Sustainable Corporation 2025 by Corporate Knights, and is the only company to rank first in the Global 100 twice.

Read more...
Top five manufacturing automation trends for 2025
Omron Electronics IT in Manufacturing
As we step into 2025, the world of industrial automation is approaching a new chapter. According to OMRON’s SINIC Theory, which ties technological advances to societal change, we’re now moving from the Optimisation Society to the Autonomous Society.

Read more...
PDS expansion into southern Africa
IT in Manufacturing
Benefiting from South Africa’s role as a global pioneer in proximity detection systems, other countries in the region are embracing this safety and monitoring technology to great effect.

Read more...
Bridging the gap between cybersecurity risk and awareness
IT in Manufacturing
Much like the rest of the world, South Africa grapples with challenges emanating from a digital landscape fraught with escalating cyberthreats that pose significant risks to businesses and other organisations.

Read more...
Data has a massive carbon footprint
IT in Manufacturing
The exponential growth of data has led to significant business challenges and environmental concerns for organisations to address. Data sprawl and redundancy increase storage requirements, consuming vast amounts of resources and energy.

Read more...
Photorealism-enhanced digital twin with digital reality viewer
Siemens South Africa IT in Manufacturing
Siemens Digital Industries Software has announced its Teamcenter Digital Reality Viewer, a new software solution that brings the NVIDIA Omniverse platform and accelerated computing to Teamcenter, enabling high-quality, high-performance photorealistic visualisation of large, complex datasets common in engineering and manufacturing.

Read more...
Quantum refrigerator paves way for reliable quantum computers
IT in Manufacturing
Quantum computers require extreme cooling to perform reliable calculations. Researchers at Chalmers University of Technology, Sweden, and the University of Maryland, USA, have engineered a new type of refrigerator that can autonomously cool superconducting qubits to record low temperatures, paving the way for more reliable quantum computation.

Read more...
Quantum leap or quantum risk? Balancing innovation and security
IT in Manufacturing
The emergence of quantum computing represents a transformative shift in technology, promising unparalleled computational power while posing significant risks, particularly cybersecurity.

Read more...