From model risk to AI risk: building trust in intelligent systems

Model Risk Management (MRM) was built to control models. The next decade will require us to control decisions.

In traditional systems, risk originated from a model. In agentic and GenAI environments, risk emerges from the interaction between models, agents, tools, memory, workflows and humans. Yet, most MRM frameworks still focus on validating models in isolation.

The uncomfortable question is whether MRM is becoming exceptionally good at managing a shrinking share of the risk landscape.

The future of MRM is not simply model risk management. It is decision risk management. Rather than creating entirely new AI risk frameworks, many organisations are extending existing MRM practices to address AI-specific challenges, including fairness, explainability, continuous validation and third-party model oversight.

Organisations that successfully balance innovation with effective governance will be best positioned to scale AI confidently, meet regulatory expectations, and build trust in AI-driven decisions and outcomes.

Get in touch

To learn how your organisation can strengthen AI governance, manage model risk and scale AI with confidence, get in touch with our model risk management specialists.

 

Scale AI with confidence. Speak to our model risk specialists. 

Contact us

Model risk and AI FAQs

1. Does every AI tool need to be included in the model inventory?

No. Organisations should first determine whether an AI capability meets their definition of a model. Productivity tools used to support individual tasks may require governance and controls, but not necessarily full model risk management requirements. AI capabilities that influence business decisions, customer outcomes, risk assessments or financial reporting should typically be considered for inclusion within the model inventory.

2. Can existing MRM frameworks be applied to AI?

Yes. Most firms are adapting existing MRM frameworks rather than creating standalone AI risk frameworks. However, additional controls are often required around explainability, fairness, model drift, continuous monitoring, third-party dependencies and AI-specific governance considerations.

3. What are the biggest AI model risk management challenges firms face today?

Common challenges include incomplete inventories, inconsistent model tiering, poorly defined risk appetite, insufficient specialist skills to effectively challenge AI models and underestimation of aggregate AI risk across multiple use cases.

4. Are firms accountable for risks arising from third-party AI models?

Yes. Outsourcing model development does not outsource accountability. Firms remain responsible for understanding model limitations, governance arrangements, monitoring requirements and residual risks, even when an external vendor provides the model.

5. Who should be accountable for AI model risk?

Accountability should remain with the business owner responsible for the model's outcomes, supported by risk, compliance, technology and independent validation functions. The use of AI does not remove management accountability for decisions or customer outcomes.

 

 

Document

From model risk to AI risk - Building trust in intelligent systems

Key contacts