AI at scale: from experimentation to real business value

This marks a clear shift. Organisations can no longer rely on speculative investment or scattergun implementation approaches. There was a time when momentum alone, fuelled by this escalating trend and a persuasive transformation pitch, was enough to secure budget and goodwill. Now, Investors and shareholders are equipped – and willing – to draw a much sharper distinction between AI hype and AI value. 

of C-suite leaders confirmed at the start of the year  that AI is having an impact on their organisation*

of leaders have restructured teams in the last  2 years to implement AI*

confirmed geopolitical developments in the past  6 months have accelerated their AI plans**

^{* C-suite barometer: outlook 2026; **C-suite barometer: 2026 mid-year insights}

AI workforce efficiencies and business transformation have had a significant impact, but it still hasn’t reached its full potential for some organisations, often despite enthusiastic and successful implementation. Pilots have proliferated, but few have scaled into habitual change to ways of working or something that materially changes the way a business operates and performs.  

To move from AI hype to AI value, organisations and their leaders must move from “capability talk”, which is focused more on deployment milestones and deliverables, to “performance talk”, which focuses squarely on the business value AI is generating.  ROI from AI is an essential step change. The shift from experimentation to measurement is what will ultimately unlock scale and turn any early gains into sustained competitive advantage. The impact for organisations unable to will impact, not just their bottom line and market position, but any justification for future investment.  

The AI ROI gap Every year, we conduct research to understand the priorities and issues at the heart of our clients’ businesses. Our C-suite barometer gathers the views of thousands of executives from all over the world, giving us valuable insight into the trends and transformations impacting businesses.   Six months on from our initial 2026 outlook, fresh findings from our mid-year insights reinforce the confidence leaders have in AI’s potential and now reveal initial returns from AI investments. However, you can’t really value the overall returns without considering the scale of investment. Now, the proportion of budget invested in AI rises steeply with revenue, as you would expect, but what we have found is 15% of organisations have invested more than a fifth of their budget in AI, and 35% have spent less than 10%. To what extent of ROI should leaders, their businesses (and their investors and stakeholders) be expecting?

• 86of C-suite leaders confirmed AI has made their teams more productive*
• 63C-suite leaders report up to 10% returns on their AI investments, with a fifth seeing higher gains** 
• 33Claim their business is fully equipped and ready to adapt its strategy in response to the pace of future AI developments* 

For most organisations, lack of ROI from AI investment tends to result from four critical components:  

1. Lack of strategy – Too often, the motivation has been simply to use AI, often based on pressures from investors or competition, rather than to solve a defined business problem. Implementation has followed the technology rather than the need. 
2. Poor use case definition – Organisations have leaned heavily on horizontal use cases instead of vertical ones, chosen the wrong tool for the job or set the wrong metrics and expectations for the use case. Often, all three misalignments are at play. 
3. Weak governance – Poor data quality and poorly defined boundaries or classifications have hampered even the most well-resourced efforts. Even huge tech companies like Google are still working through these challenges, showing the importance of right-size governance by design. 
4. Inadequate change management – A lack of workforce buy-in, weak leadership and insufficient enablement have prevented adoption from taking root in many organisations. 

None of this is to suggest that organisations should stall in their AI ambitions. The pace of innovation is not slowing; rather, it is accelerating exponentially. Those who do not embrace the transformational potential of AI are likely to be left behind. But the ROI picture is showing that implementation must be approached strategically and proportionally. Being strategic about use case evaluation and definition – along with laying strong foundations in data and governance – will allow organisations to move quickly and generate real value as the technology continues to evolve. 

How to use AI to generate real business value 

AI reflects such a fundamental shift in operating models and priorities, touching so many different parts of the business, that it cannot be approached as a bolt-on technology. This means a solid foundation of data and governance is required, as is clarity around the business problem the technology is actually helping to solve. 

“The most successful organisations are those that either already had the right foundations in data and governance before attempting to implement AI use cases, or those that have used AI as the impetus for a wider digital transformation, establishing those foundations before attempting to implement AI at scale.”  Michael Fried, Principal, Forvis Mazars US

In any use case, AI should be treated as a potential tool – albeit a very powerful one – for solving a strategic problem, rather than an end in itself. It is not a silver bullet, and approaching AI implementation with the sole priority of finding a way to leverage it is unlikely to yield real value and is likely to result in disproportionate, ineffective “solutions”. AI is one tool in a vast toolkit of technologies to leverage for any given business problem. The key lies in knowing when to reach for it, versus when something else will better solve the business problem at hand. 

However, simply identifying a business problem AI can solve is not enough. Effective, value-generating implementations require clarity of purpose, proportionality of response and a relentless focus on outcomes that matter. 

Horizontal vs vertical use cases 

This is where the distinction between horizontal and vertical implementations becomes important. This terminology comes from the IT world, with the concepts of “scaling out” (adding more lanes to a busy highway) vs “scaling up” (replacing existing vehicles with faster, more efficient ones).  

When applied to AI implementations, horizontal use cases often take the shape of general AI assistants aimed at increasing the productivity of individuals in the workforce. Not only is it hard to quantify, but employees are likely to make up for productivity gains in other ways when there are no clear, quantifiable metrics attached to their AI usage. An hour saved that is not redirected to a measurable outcome isn’t really a saving at all. 

Horizontal use cases are inherently broad and difficult to measure, and alone they’re unlikely to be worth the investment in measurable business value generated.  

Vertical use cases, on the other hand, are more capable AI implementations that automate previously manual tasks, whether tedious, data-heavy or both, or help orchestrate end-to-end business processes. Vertical implementations, tied to specific functions and outcomes, are easier to measure and easier to defend, even when a larger up-front investment is required. 

Valuable use cases for AI implementation are those that address real business problems and present with quantifiable success metrics. 

Once a business problem and corresponding vertical use case has been identified, these 3 questions will help leaders determine how (and if) AI can be used to generate business value:

Is AI the right tool for the job? 

AI is an extreme solution and should be proportionate to the business value of the problem it is solving. Leaders should resist the urge to crack a nut with a sledgehammer; if a rules-based automation, a process redesign or a better-built dashboard will do the job just as effectively, that is usually a better answer than AI implementation. Environmental concerns and data quality and availability should also be weighed at this stage, before any commitment is made. 

Indeed, sustainability concerns belong at the scoping stage rather than as an afterthought. Quantifying an AI footprint is difficult, even with your own GPUs, and AI is established to be environmentally damaging – this is especially true for agentic AI systems. It is important to consider sustainability ambitions, goals and compliance early, because there may be equally effective (or nearly as effective) solutions that are less environmentally taxing. Non-AI solutions can often get you most of the way there without the same sustainability (or even monetary) cost. 

What type of AI is best suited to this work? 

If AI is the right tool, the next question is what type. The benefits and challenges vary significantly across chat interfaces, retrieval-augmented generation, agentic systems and multi-agent architectures.  

Task-level AI is often a waste of potential; one use case's leveraging of AI can frequently enable another, and thinking in terms of capability ecosystems rather than isolated tasks tends to yield better returns. In this way, one implementation (or coordinated implementation) can help address multiple business problems, or a single business problem with multiple contributing factors across different areas of the business. 

“The organisations getting real value from AI aren't thinking task by task – they're thinking in capability ecosystems. One well-designed implementation can address several business problems at once, but only if you're willing to step back from the immediate use case and look at the wider operating model.”  – Laurent Inard, Partner, Head of Research & Development, Forvis Mazars in France

Established LLMs (versus proprietary models) are the most common design choice; they will usually be more robust and efficient and will be kept up to date with the right capabilities. They do, however, come with risks and requirements that must be considered, including heightened third party risk management (TPRM) considerations. Borrowed models do not reduce the maturity required for governance and oversight; if anything, they increase it. 

What are the right success metrics for this use case? 

One of the biggest hurdles for organisations in moving from “capability talk” to “performance talk” is defining the wrong success metrics for implementation. Every use case’s KPIs should be tied back to the strategic problem being solved and demonstrate real business value in their articulation. Quantifiable value like reduced turnaround time, improved exception rates and shortened value generation cycles will always be better than productivity, milestone or vague “efficiency” metrics. 

Is this use case operating effectively without AI?

Even if a use case isn’t performing against the relevant success metrics, in most instances, it should be operational without AI. If the process is poorly defined or ineffectual as is, adding AI will only exacerbate those failings, not solve them. 

Corporate tax: a use case primed for AI value 

Organisations are seeing clear short-term cash tax savings thanks to AI-enhanced processes and analysis, delivering clear ROI on the relevant AI implementations. This is because corporate tax is often ideally suited to AI implementation thanks to its strong operational and governance foundations: 

• Tax teams have well established and standardised operating processes 
• Data is often well structured and governed thanks to compliance requirements 
• Tax functions often involve manual processes and heavy data analysis  

The key to successful AI implementation is, as always, the quality and standardisation of data and processes. Decentralised corporate tax can get value from AI too, but centralised operations and data mean a clearer path to AI value. 

AI implementations have been particularly successful for data-heavy and repetitive use cases such as: 

• Compliance & reporting 
• E-invoicing and filing 
• Purchase & acquisition data analysis (and post-merger integration)

The guiding principle here is right-size governance. Safeguards and accountability must be aligned specifically to the nature, scale and criticality of each individual AI use case and the business impact it has. Proportionate controls require organisations to determine what category of risk a use case introduces and apply controls that are proportionate to that risk. A customer-facing decision-making system warrants a very different control environment than an internal summarisation tool.  

Maturity alignment also matters: ambitions should be aligned to the organisation's current readiness across data integration, architecture and workforce skills, not to where leadership wishes the organisation were. If ambitions and maturity don’t align in reality, that signals the need for deep transformation prior to implementation. 

Establishing a workflow contract 

To move from ambition to action, a "workflow contract" should be established for each use case. This contract sets out five key elements: 

Data readiness underpins all of this. Leaders must align their ambitions with the reality of their maturity along a practical maturity continuum, or their AI implementations are likely to fail. At best, premature or misaligned implementations will generate little to no value, even if “successfully” implemented. 

Security and compliance by design 

Security and compliance sit alongside governance and require similar discipline. The state of AI regulation in 2026 is more developed than it was even a year ago, with overlapping regional frameworks now placing concrete obligations on organisations deploying some kinds of AI. 

Compliance is a core consideration of AI implementations, but like other forms of governance, it should be applied in a right-size manner. It should be an extension of business strategy and risk management. The same applies to cybersecurity: measures should be risk-based and proportionate to the data, processes, people and systems involved. 

Both compliance and security should be embedded into the AI lifecycle from the beginning, during scoping and design, rather than as a final review gate. Repeatable governance approaches help here. Organisations should establish repeatable answers to common foundational questions for new use cases, including a standard data classification approach, standardised logging and retention patterns for audit expectations and, crucially, a clear "kill button" or fallback procedure for when quality drops or models behave inappropriately. 

A clear exit strategy is essential. Organisations should ask themselves, how will they know when AI quality has dropped? What is the process for disabling the AI and ensuring continuity of the underlying process? Who has ownership and decision-making authority for this? These are questions that need answers before deployment, not after an incident.

Workforce implications, and the fear factor 

The most strategic organisations seeing the greatest AI value are finding ways to embrace efficiency gains through better leveraging of their existing workforce, not by replacing it with AI tooling. However, that simple fact does little to assuage workers’ fears of being replaced by AI, especially when that message is not being shared internally. 

Realistically, employees will not adopt AI tooling – or at least not to its fullest extent – if they believe it will replace them. They must be assured that AI will help with workforce efficiency, but in the service of growth goals moving forward rather than headcount reduction. The AI-empowered path forward must be clear to everyone, especially those being asked to use it.  

Generating buy-in at the pilot stage 

Successfully moving from pilot to scale, especially where user adoption is required, relies on demonstrable, highly visible impacts. Results that show up in finance dashboards or weekly operations reviews help earn the permission required for broader transformation.  

Education is crucial throughout this transition. Employees must understand the benefits, boundaries and expectations around AI. The cybersecurity overlap deserves particular attention; employees should be well educated on the cybersecurity concerns around AI and data privacy, especially where AI chatbots and external tools are involved. 

Users and use case owners should also understand the ESG implications of their work. This understanding will help keep usage focused on critical and valuable processes and will encourage them to use lower-impact solutions first where these are available.  

Finally, the workforce should understand how new use cases are evaluated and governed, and this process should be highly visible. With repeatable governance in place, workers and leaders can bring forward new use cases for efficient and effective evaluation focused on improving business outcomes rather than chasing shiny objects.  

Leadership sets the tone 

Organisation leadership must set a strong example, both for AI enthusiasm and for day-to-day usage. The expectation is set from the top, and leadership defines the tone for how people across the organisation view the AI imperative. A leadership team that uses AI tools, talks openly about its capabilities and limitations and rewards thoughtful experimentation will see a very different adoption curve from one that ignores or rebukes AI in their own roles, delegating its use downward. 

So, how can leaders in different areas of the business enable real, tangible business value generation through AI? 

Define where value should be created  The main risk isn’t doing too little – it’s doing too much without delivering impact.  Anchor AI in business outcomes: require every AI initiative to be tied to a revenue lever, a cost driver or a key decision process   Narrow the focus to drive real impact: prioritise a limited number of high value, multifaceted use cases, and avoid spreading investments across too many initiatives  Own the transformation narrative: clearly position AI as a productivity and decision enhancement lever, not a workforce reduction programme; communicate consistently across the organisation    Align the leadership team on value and time horizon: ensure the CFO, CIO and business leaders agree on what success looks like, how value is measured and when returns are expected  Institutionalise adaptability in execution: move away from static transformation roadmaps, implementing quarterly reprioritisation of initiatives and rapid decision loops at the executive level  Champion compliance by design: demand rigorous right-size governance and compliance, even where regulation remains a moving goalpost. Advocate for proportionate, risk-based measures where clear frameworks may not be available.

Ensure value is measured and realised  Treating AI like a traditional IT investment is a mistake. Value is progressive, linked to adoption, and uneven across use cases.  Move the conversation from capability to performance: source and track operating metrics, not just technical outputs (cycle times, productivity gains, error reduction, capacity creation, etc.)  Build a robust ROI and value tracking framework: track real investment costs (including data, integration, change) and realised benefits (not just projected ones); distinguish between short-term efficiency gains and longer-term business impact  Fund capabilities, not fragmented initiatives: allocate budgets to data foundations, AI platforms and shared components  Stage investments and enforce discipline: link funding to milestones and measurable outcomes/adoption rates  Reallocate resources as value materialises: proactively adjust workforce allocation and cost structures  Include compliance concerns in “performance talk”: push for compliance and governance visibility as a part of use case performance conversations. Establish continuous audit controls to ensure ongoing alignment.

Make value scalable and sustainable  Chasing the latest AI trend without strong foundations will increase fragility rather than value. Prioritise data and governance as foundations: invest in data quality, accessibility and ownership, and integrate governance into all transformation initiatives, not just AI  Design for enterprise-wide transformation: move beyond tactical use cases, identify multipurpose capabilities, ensure reusability across functions and align AI initiatives with broader digital transformation  Establish repeatable patterns for scale: standardise data classification approaches, approved AI processing environments (“zones”) and human-in-the-loop validation mechanisms  Focus on integration into core workflows: embed AI into existing business processes and decision-making flows, and ensure interoperability across systems  Evaluate technology choices based on business needs: start with the problem, not the tool; select technical solutions that fit the use case, the data environment and the risk level Operationalise compliance: bridge the gap between compliance strategies and technical execution. Ensure transparency at every stage.

Pivoting from AI hype to AI value 

For organisations who have either delayed AI implementation or seen little value return from their use cases, how can they pivot quickly, establishing the right foundation without losing ground? The good news is that, while true transformation takes time, there are ways to pivot current AI endeavours effectively: 

“Ignore the headlines. Look at your organisation and build a central strategy based on delivering real value instead of serving whoever is yelling the loudest. This will enable you to build the business case for new use cases and establish the right foundation for your organisation’s goals, leading to tangible value generation, as well as more resilience and confidence as AI continues to evolve.”  Michael Fried, Principal, Forvis Mazars US