IT in Manufacturing

AI is driving data centres to the edge

April 2024 IT in Manufacturing

The data centre has become the cornerstone that links our digitally interconnected world. At the same time, the rapid growth and application of artificial intelligence (AI) and machine learning (ML) is shaping the design and operation of data centres. The training requirements associated with AI are driving new chip and server technologies and the need for extreme rack power densities. The distinction between training and inference is critical when designing AI systems. Training workloads are used to train AI models like large language models (LLMs). These workloads require massive amounts of data fed to specialised servers with processors known as accelerators.

Ben Selier, vice president, Secure Power, Anglophone Africa at Schneider Electric.

Inference models might be deployed on edge devices or cloud servers, depending on the application’s needs, and take the previously trained AI model into production to predict the output of new queries (inputs). This demand for high-performance computing has led to increased requirements for powerful servers, GPUs and other specialised hardware within data centres to support workloads.

At the same time, the rise of edge computing, where computing resources are brought closer to the location where data is generated, is driven in part by AI applications. Edge data centres are deployed to reduce latency and enhance the performance of AI applications in scenarios where real-time processing is critical.

The servers supporting these AI applications use advanced AI chipsets, more commonly known as AI accelerators. These chipsets play a crucial role in enhancing the performance of AI applications across various domains.

Energy consumption and demand for power

Modern data centres use high-density servers and equipment that demand more power for processing. This leads to concentrated energy usage in smaller spaces, increasing the overall energy footprint, which can raise concerns about the amount of energy required to process AI operations.

For example, if your AI model is operating emergency vehicle routing, it will need to process high-definition videos and traffic patterns to perform real-time operations to clear the traffic. This would probably be an IT network of high speed, or networked edge AI data centres that could process a larger amount of data and deliver real time decisions and predictions. As the dependence on AI continues, new technologies and techniques will be deployed to make AI faster and more accurate and efficient.

One of these techniques is moving compressed models to the edge in the form of edge AI data centres. This will enable businesses to match the application to the model and optimise performance and the energy use.

The rapid growth in data traffic

The emergence of autonomous AI agents and decision-making programs holds the potential to revolutionise various aspects of business operations. These intelligent programs perform tasks independently, adapting and learning from its environment.

With increasing AI-driven automation, data centre employees can then automate routine tasks, reduce manual workloads and enhance overall efficiency, as responsibilities such as server system maintenance or system monitoring can be handled by these intelligence programs.

AI and data centre evolution

As AI technology advances, it will continue to influence the design and operation of data centres. While these advancements bring efficiency and innovation, this also poses challenges related to energy consumption, power and cooling systems.

This relentless advancement of AI is only going to continue, and to meet these evolving needs, the data centre industry needs to adapt. Schneider Electric offers guidance on best practices for embracing scalable and flexible infrastructure design to support intensive AI workloads. Strategies include deploying high-efficiency and high-capacity power systems and liquid cooling systems, 48U wide enclosures, upgrading hardware, and data centre infrastructure management.


Share this article:
Share via emailShare via LinkedInPrint this page

Further reading:

Bringing brownfield plants back to life
Schneider Electric South Africa IT in Manufacturing
Today’s brownfield plants are typically characterised by outdated equipment and processes, and face challenges ranging from inefficient operations to safety hazards. However, all is not lost, as these plants stand to gain a lot from digitalisation and automation.

Power supply with scalability optimised
Schneider Electric South Africa Electrical Power & Protection
Schneider Electric has introduced the Easy UPS 3-Phase Modular to the South African marketplace. This robust uninterruptible power supply (UPS) is designed to protect critical loads while offering third-party verified Live Swap functionality.

Control architecture leads to faster, easier product development for refrigeration
Opto Africa Automation Editor's Choice IT in Manufacturing
What’s the secret to providing superior service and staying competitive in a changing market? You might learn something from ALTA Refrigeration’s experience. Over ten years, it transformed itself from a custom engineering services company into a scalable industrial equipment manufacturer, using an edge-oriented control architecture to manage a growing installed base.

Comprehensive protection of the network against attacks
Phoenix Contact IT in Manufacturing
In recent years, the generation of data to create ever better transparency and control of production has become a decisive competitive factor. IIoT has also contributed to more manufacturing systems being connected to IT or cloud systems. This places higher demands on access security, which Phoenix Contact meets with the Secure Edge Box.

Embracing security as a core component of your technology
IT in Manufacturing
ABI Research recently undertook a comprehensive study to learn more about the product security assurance landscape from the perspective of enterprise customers, surveying 302 enterprise customers, and conducting in-depth interviews to complement the qualitative survey.

AI in manufacturing: a process engineer’s perspective
Editor's Choice IT in Manufacturing
The expert will tell you what to do, the philosopher will tell you why to do it, and the engineer will get on and actually do it. As the hype around AI intensifies, the number of ‘experts’ is increasing exponentially. In contrast, the number of engineers who actually know how to implement AI technology remains small.

Generative AI for immersive real-time visualisation
Siemens South Africa IT in Manufacturing
Siemens will deepen its collaboration with NVIDIA to help build the industrial metaverse.

Mesh networks: a multidirectional electrical superhighway
Schneider Electric South Africa Electrical Power & Protection
Today, many power industry stakeholders are faced with mounting requirements for improved grid reliability, resilience and distribution efficiency. It’s a challenge which requires power service providers to rethink their infrastructure. Enter mesh networks, which can overcome the limitations of traditional star networks.

Award-winning Gen AI solutions
IT in Manufacturing
Amazon Web Services recently hosted an exclusive event in South Africa on ‘Elevating Possibilities with Partners - a Showcase of GenAI Excellence’. This event brought together ten esteemed partners, including Synthesis Software Technologies, to highlight innovative advancements in the field of Generative AI.

Schneider Electric announces 2023 Global Alliance Partner Programme award winners
Schneider Electric South Africa News
Schneider Electric has announced the winners of the 2023 Global Alliance Excellence Awards. Throughout 2023, Schneider Electric’s Alliance Partners supported customers in the digitalisation of industrial automation, delivering value with innovative initiatives, solutions and services.