IT in Manufacturing


Agentic AI: are we building castles on quicksand?

May 2025 IT in Manufacturing

Artificial Intelligence is in a strange spot. With the explosion of AI tools and applications we find ourselves teetering between two inseparable yet intertwined paths – the promise of extraordinary capability and the peril of unmitigated risk.

This precarious balance gives rise to the question: “Are we building something truly enduring or are we rushing ahead on unstable foundations, building castles on quicksand?”

Agentic AI covers quite a diverse range spanning from simple chatbots to the vision of fully autonomous systems that can act, reason and take initiative. While the current hype often overshadows practical discussions there is undeniable potential for rapid advancements in this field. Agentic AI systems go well beyond mere button-based conversational interfaces offering tools that integrate into complex enterprise operations.


Stef Adonis, head of marketing at Helm.

While the appeal is undeniable, a leap of this magnitude toward fully autonomous systems in enterprise-level applications could lead to unforeseen risks. While the threat of these risks remains a reality, we should instead be focusing on human-led Agentic AI – a level where intelligent tools enhance operations while ensuring human oversight.

The key distinction lies in initiative and the ability to plan. For example, an LLM is like an incredibly well-read librarian who can instantly recall and synthesise vast amounts of information from books. When asked a question the librarian will provide a comprehensive, eloquent response, drawing from their extensive knowledge, or the wealth of information at their disposal. If prompted and asked really nicely, they might even respond as a pirate. They’re exceptional at retrieving and combining information, but they always wait for your specific query.

An agentic application, on the other hand, is like that same librarian, but instead of simply answering your question they take it a step further by showing some initiative. They might say, “Based on what you’re asking, I think you might also want to explore these related topics. I’ll go ahead and pull some additional resources, draft a preliminary research summary and even reach out to some subject matter experts who might provide deeper insights.”


Ari Ramkilowan, head of Machine Learning at Helm.

The agentic application introduces a layer of goal-oriented behaviour breaking down complex tasks into sub-tasks, making decisions, and taking actions beyond mere information retrieval. It has the capacity to perceive an environment and take purposeful actions toward a specific goal rather than following a specific query or a predetermined sequence of events. This holistic approach underlines its superiority to rigid, workflow-based tools that falter in handling edge cases.

While the journey toward fully autonomous agentic systems may still be on the horizon, enterprises are beginning to invest in the technology. The interest lies in faster iteration and broader scope where agentic systems introduce flexibility without replacing existing workflows.

However, the promise of agentic AI comes with a great deal of risk, especially for businesses – misalignment of goals, unpredictable behaviour, loss of human oversight, amplification of bias and security risks – all of which demand careful navigation.

So, we must ask ourselves not whether we can build this but should we build this.

There is a path forward that is more of a hybrid model – one that lies between structured processes and autonomous agents. This will give us the efficiency of agentic AI and the security of human involvement.

The allure of agentic AI is immense, but so are the responsibilities that come with it. Oversight, accountability and ethical alignment must serve as the foundation of our innovation. These systems should enable autonomy within controlled parameters, minimising risks while maximising potential.

As we look ahead, human-led Agentic AI may just emerge as the sweet spot - a balanced middle ground where technology supports rather than replaces human expertise.

The evolution of agentic AI is not just about technology; it’s about deliberate and thoughtful integration. While the idea of fully autonomous systems tempts us with the promise of efficiency and innovation it also demands vigilance. Building robust AI systems isn’t about surrendering control but exercising it wisely.

So we don’t need to build those castles on quicksand after all. We have the power to create a much firmer middle ground that combines the strengths of agentic AI and human expertise.

For more information contact Stef Adonis, Helm, +27 11 482 8684, [email protected], www.helm.africa




Share this article:
Share via emailShare via LinkedInPrint this page

Further reading:

The DeepSeek effect: navigating AI’s new frontier
IT in Manufacturing
DeepSeek has emerged as a game-changer in artificial intelligence, offering a robust platform redefining how businesses approach AI integration. This change is especially important since it opens up AI to a wider range of organisations, including small and medium-sized enterprises that could have previously been priced out of the market.

Read more...
Automation, is it 2049 already?
Schneider Electric South Africa IT in Manufacturing
It would come as no surprise that AI and ML are at the forefront of the increased efficiency movement, and are vital cogs in this sophisticated automated machine. A development that is extremely exciting, is autonomous systems.

Read more...
There’s a reason the A stands for Advanced in APC
Schneider Electric South Africa IT in Manufacturing
Today’s mineral processing companies face almost universal challenges, efficiently managing resources and high energy consumption, environmental compliance, barriers to technological adoption and the perpetual shortage of skilled labour. While there’s no miracle intervention, there are undoubtedly solutions that improve the above, and one is Advanced Process Control.

Read more...
Digital twins in manufacturing
Schneider Electric South Africa IT in Manufacturing
Digital twin technology can help create better products, fast. It can transform the work of product development too.

Read more...
New generative AI-powered maintenance offering
Siemens South Africa IT in Manufacturing
The Siemens Industrial Copilot is revolutionising industry by enabling customers to leverage generative AI across the entire value chain – from design and planning to engineering, operations and services.

Read more...
Building resilience in extreme environments
ACTOM Electrical Machines IT in Manufacturing
Extreme temperatures, corrosive substances and high pressures are just a few of the elements that make up the unforgiving operational environments characteristic of the petrochemical and oil and gas sectors. A proactive and nuanced approach to industrial maintenance is no longer optional for organisations, it is an absolute necessity to avoid disruptions and create the right conditions for success.

Read more...
Next-generation PLC technology with advanced chatbot functionality
Beckhoff Automation IT in Manufacturing
Beckhoff is taking automation technology to the next level with TwinCAT PLC++. Both engineering and runtime are noticeably faster, without compromising on TwinCAT’s signature strengths of seamless integration, compatibility and openness.

Read more...
Next milestone achieved for the Eplan Data Portal
IT in Manufacturing
The Eplan Data Portal offers users access to high-quality product catalogues from a continually growing pool of renowned component manufacturers.

Read more...
AI accelerates energy transformation
RJ Connect IT in Manufacturing
With the rapid expansion of generative AI applications, data centre power demand is reaching unprecedented levels.

Read more...
Optimising the product design process
Siemens South Africa IT in Manufacturing
OPmobility is partnering with Siemens to adopt its Teamcenter X Product Lifecycle Management software. OPmobility’s increasingly complex products now include electronics and software, to create energy storage systems, which include battery and hydrogen electrification solutions and fuel tanks.

Read more...