IT in Manufacturing


Agentic AI: are we building castles on quicksand?

May 2025 IT in Manufacturing

Artificial Intelligence is in a strange spot. With the explosion of AI tools and applications we find ourselves teetering between two inseparable yet intertwined paths – the promise of extraordinary capability and the peril of unmitigated risk.

This precarious balance gives rise to the question: “Are we building something truly enduring or are we rushing ahead on unstable foundations, building castles on quicksand?”

Agentic AI covers quite a diverse range spanning from simple chatbots to the vision of fully autonomous systems that can act, reason and take initiative. While the current hype often overshadows practical discussions there is undeniable potential for rapid advancements in this field. Agentic AI systems go well beyond mere button-based conversational interfaces offering tools that integrate into complex enterprise operations.


Stef Adonis, head of marketing at Helm.

While the appeal is undeniable, a leap of this magnitude toward fully autonomous systems in enterprise-level applications could lead to unforeseen risks. While the threat of these risks remains a reality, we should instead be focusing on human-led Agentic AI – a level where intelligent tools enhance operations while ensuring human oversight.

The key distinction lies in initiative and the ability to plan. For example, an LLM is like an incredibly well-read librarian who can instantly recall and synthesise vast amounts of information from books. When asked a question the librarian will provide a comprehensive, eloquent response, drawing from their extensive knowledge, or the wealth of information at their disposal. If prompted and asked really nicely, they might even respond as a pirate. They’re exceptional at retrieving and combining information, but they always wait for your specific query.

An agentic application, on the other hand, is like that same librarian, but instead of simply answering your question they take it a step further by showing some initiative. They might say, “Based on what you’re asking, I think you might also want to explore these related topics. I’ll go ahead and pull some additional resources, draft a preliminary research summary and even reach out to some subject matter experts who might provide deeper insights.”


Ari Ramkilowan, head of Machine Learning at Helm.

The agentic application introduces a layer of goal-oriented behaviour breaking down complex tasks into sub-tasks, making decisions, and taking actions beyond mere information retrieval. It has the capacity to perceive an environment and take purposeful actions toward a specific goal rather than following a specific query or a predetermined sequence of events. This holistic approach underlines its superiority to rigid, workflow-based tools that falter in handling edge cases.

While the journey toward fully autonomous agentic systems may still be on the horizon, enterprises are beginning to invest in the technology. The interest lies in faster iteration and broader scope where agentic systems introduce flexibility without replacing existing workflows.

However, the promise of agentic AI comes with a great deal of risk, especially for businesses – misalignment of goals, unpredictable behaviour, loss of human oversight, amplification of bias and security risks – all of which demand careful navigation.

So, we must ask ourselves not whether we can build this but should we build this.

There is a path forward that is more of a hybrid model – one that lies between structured processes and autonomous agents. This will give us the efficiency of agentic AI and the security of human involvement.

The allure of agentic AI is immense, but so are the responsibilities that come with it. Oversight, accountability and ethical alignment must serve as the foundation of our innovation. These systems should enable autonomy within controlled parameters, minimising risks while maximising potential.

As we look ahead, human-led Agentic AI may just emerge as the sweet spot - a balanced middle ground where technology supports rather than replaces human expertise.

The evolution of agentic AI is not just about technology; it’s about deliberate and thoughtful integration. While the idea of fully autonomous systems tempts us with the promise of efficiency and innovation it also demands vigilance. Building robust AI systems isn’t about surrendering control but exercising it wisely.

So we don’t need to build those castles on quicksand after all. We have the power to create a much firmer middle ground that combines the strengths of agentic AI and human expertise.

For more information contact Stef Adonis, Helm, +27 11 482 8684, [email protected], www.helm.africa




Share this article:
Share via emailShare via LinkedInPrint this page

Further reading:

Transforming pulp and paper with automation and digitalisation
ABB South Africa IT in Manufacturing
The pulp and paper industry in South Africa is undergoing a significant transformation from traditional manual processes to embracing automation technologies. Automation in pulp and paper mills aims to improve various production stages, from raw material preparation to final product creation.

Read more...
New world of process control: A completely web-based process control system
Siemens South Africa IT in Manufacturing
Control technology is crucial for gaining a competitive edge in the process industry. That’s why there’s SIMATIC PCS neo - the innovative ground-breaking process control system by Siemens.

Read more...
Protecting industrial networks with resilient defence
RJ Connect IT in Manufacturing
Network security is no longer just about preventing hacking or data breaches. For operational technology networks, resilient defence and consistent uptime are crucial. They are the core tenets that underpin Moxa’s guarded uptime and resilient defence (GUARD).

Read more...
The metaverse is now: are you ready to reimagine your business?
IT in Manufacturing
The convergence of the digital and physical worlds, driven by spatial computing and the metaverse, is rapidly reshaping business landscapes. This transformation extends beyond the mere novelty of virtual reality headsets and augmented reality filters, signalling a fundamental shift in how organisations operate, collaborate and innovate.

Read more...
AI and cyber security: South Africa’s next battleground
IT in Manufacturing
Artificial intelligence is rapidly becoming a double-edged sword in the world of cybersecurity. In South Africa, where cybercrime is on the rise, AI presents both an opportunity and a threat.Artificial intelligence is rapidly becoming a double-edged sword in the world of cybersecurity. In South Africa, where cybercrime is on the rise, AI presents both an opportunity and a threat.

Read more...
Technology won’t save your business from cyber threats
IT in Manufacturing
Artificial Intelligence is reshaping the landscape of information security, presenting both unprecedented opportunities and significant new threats.

Read more...
Addressing the cooling needs of the modern data centre
Schneider Electric South Africa IT in Manufacturing
The rise in hardware density in data centres is gaining speed and is largely driven by the demands of artificial intelligence and machine learning, requiring more powerful servers and specialised hardware.

Read more...
South Africa’s next cyber security frontier
IT in Manufacturing
AI-powered agents are rapidly transforming how South African businesses operate, from chatbots managing customer inquiries to automated systems processing financial transactions. While these AI-driven assistants increase efficiency and reduce operational costs, they also present a new, and often underestimated, cybersecurity challenge: identity management.

Read more...
Bombardier expands adoption of Siemens Xcelerator for aircraft developmen
Siemens South Africa IT in Manufacturing
Bombardier has expanded its adoption of the Siemens Xcelerator portfolio of industry software for aircraft development.

Read more...
The DeepSeek effect: navigating AI’s new frontier
IT in Manufacturing
DeepSeek has emerged as a game-changer in artificial intelligence, offering a robust platform redefining how businesses approach AI integration. This change is especially important since it opens up AI to a wider range of organisations, including small and medium-sized enterprises that could have previously been priced out of the market.

Read more...