PhoenixDX sat down with Naren Gangavarapu GAICD — Chief AI Officer, ranked #1 Technology Leader in Australia by iTnews — to talk about the realities of moving beyond the AI pilot phase.
This week, Naren will take the conversation further as a panellist in the fireside chat at our exclusive executive experience: The Last Competitive Advantage — Leading Agentic AI Before It Leads You.
Naren: For decisions that require regulatory compliance, audit trails, and fiduciary accountability, rules-based AI is outperforming Generative AI. Rules-based systems provide guarantees, testability, and clear inputs and outputs. Generative AI, by contrast, samples from a distribution—the coverage is never complete, and the output can drift, making it difficult to prove why a decision was made. I advocate for using rules-based AI to build the "backbone" of your system and using agentic AI on the edges for tasks like summarisation and user-facing interfaces where downstream impact is lower.
Naren: Yes, this is a recurring issue with new technology. Organisations often find a tech package and try to force it into their operations rather than identifying the root cause of a problem. The second mistake is over-engineering - using expensive generative models to solve problems that could be addressed by much simpler solutions. The key question should be: "Does this business area have proprietary data and knowledge worth protecting?" If you do, you should own the model rather than renting a subscription, which effectively hands your competitive edge over to the vendor.
Naren: For one of Australia's largest tourism and hospitality groups, we successfully implemented 25 agents across the booking, wholesale distribution, and cruise operations. The results were clear: a 34% drop in tier-one support escalations, a reduction in onboarding time from 23 days to 3, and a 24% rise in booking conversion. The secret is "boring" foundation work: building a solid backbone, using the source of truth for your data rather than spreadsheets, and avoiding manual manipulation. Treat agents like employees - they require foundation, structure, and accountability.
Naren: AI capability demonstrates that a technology can perform a task in a demo environment. Reliability demonstrates that it will perform consistently, repeatably, and compliantly in production. Building reliability is the hardest part. You cannot let an AI "self-mark" its own exam - you need rigorous, external testing mechanisms to ensure that the system isn't drifting.
Naren: Boards should focus on four critical questions to move beyond the hype:
Naren: It comes down to operational discipline. You must avoid the trap of measuring success by declining demand or "vanity metrics”. ROI comes from ensuring your data comes directly from the source of truth, measuring impact during peak operational windows, and ensuring your processes aren't just "automated" - they are optimised and defensible.
Naren: Go back to the basics. Stop chasing market pressure. Focus on your proprietary data and build your own models where you have a unique edge. Look at your operational habits - if you can treat AI as another employee whose performance and accountability are tracked, you will have a much higher chance of a successful implementation.
Naren: Challenge the idea that AI is the default solution for every problem. The conventional wisdom is that if you aren't using the latest AI models, you are falling behind. In reality, the leaders are those who are using the right type of AI - whether rules-based, prescriptive, or generative - to build a robust, reliable backbone for their specific business needs.
Naren Gangavarapu, GAICD, is a Chief AI Officer and senior technology executive based in Sydney, Australia. Ranked Australia's #1 Technology Leader by iTnews in 2024 and #5 CIO by CIO50 in 2022, he has spent 25+ years delivering more than $1B in business value across government, private equity and complex service industries.
Naren specialises in AI-powered transformation, post-merger integration and large-scale digital strategy, with a track record of deploying AI in production rather than in pilots, helping organisations embed it as a competitive advantage, not just a capability. His hands-on experience spans from early expert systems and machine learning through deep learning, NLP, and computer vision to today's agentic and GenAI applications, including Copilot rollouts, ESG reporting automation, customer sentiment analysis, and legal and compliance tooling.
Career highlights include establishing the award-winning omni-channel platform for Service NSW as the single window for government transactions, achieving 98% customer satisfaction and delivering a government priority three years early; halving state significant project assessment timeframes from 298 to 145 days to unlock $18B in capital investment and 59,000 jobs; and leading a $500M+ innovation program spanning digital licences, live traffic, IoT, facial recognition and payments.