Risk Academy, led by the Nexus Consortium · Course catalogue · Risk Science and Methods
Risk Management
مەترسیی مۆدێل و پشتڕاستکردنەوە
Model risk and validation, taught twice over: as the working methods of the field and as its frontier since 2024, with labs on the Academy's tools, open data and the Nexus Standards.
Model risk and validation: foundations and practice
This area covers the risk that decisions rest on models that are wrong or misused, and the controls that manage it: model inventories and governance, validation and back-testing, monitoring and drift, explainability and fairness, third-party and generative AI models, and human-in-the-loop controls.
Model risk and validation: foundations and practice
ئاست
L2 Intermediate
Study time
about 24 hours (planning estimate)
دۆخ
In authoring
Prerequisites
An L1 course in the area, or an entry review
Why now
It gives model risk functions an international reference for extending validation and monitoring to AI systems.
Define model risk and the other key terms of the discipline and use them correctly in a written case
Explain model risk governance and model validation with a worked example and its source
Apply the discipline's method to a documented case and explain each result with its source
Analyse a named case against model monitoring and drift, stating evidence, date and limits
Modules
01
Model risk governance
Model risk governance
Model validation
Model monitoring and drift
02
Explainability and fairness
Explainability and fairness
Third-party models
Generative AI in finance
03
Human-in-the-loop controls
Human-in-the-loop controls
Model inventories
04
Lab: the discipline's method
A model that claims a confidence level makes a testable promise about how often outcomes will exceed its figure; counting those exceptions over a test window and comparing the count with the expected distribution gives the verdict, and the verdict feeds the model's tier and its permitted use.
Work the method through a documented case and explain each result
Explain what changed in model risk and validation since 2024 and cite the studies, data or rules behind each change
Reproduce FSB finalised sound practices for adopting AI in finance on open data and state the uncertainty of the result
Evaluate a 2024 to 2026 study: its question, data, method, limits and what it changes for practice
Design an analysis that combines a frontier method with the faculty's instruments, and justify each choice
Modules
01
FSB finalised sound practices for adopting AI in finance
The Financial Stability Board set out 12 sound practices for financial institutions, grouped into organisation-wide AI governance and lifecycle risk management, covering use-case materiality, data governance, explainability, performance evaluation, human oversight and third-party AI dependencies.
It gives model risk functions an international reference for extending validation and monitoring to AI systems.
Financial Stability Board, 15 October 2026
02
Internal control guidance is mapped to generative AI risks
COSO published Achieving Effective Internal Control Over Generative AI, translating its Internal Control Integrated Framework into guidance for governing generative AI, with risks such as prompt manipulation, opaque reasoning, model drift and frequent configuration changes.
It helps validators and auditors frame generative AI controls in a framework boards and auditors already use.
COSO, 23 February 2026
03
US federal AI memo sets minimum practices for high-impact AI
OMB memorandum M-25-21 requires agencies to apply minimum risk management practices to high-impact AI, including pre-deployment testing, documented AI impact assessments with independent review, and processes for waivers and monitoring.
It defines testing and documentation expectations that suppliers of models to government must be able to evidence.
Office of Management and Budget (US), 3 April 2025
04
UK survey shows heavy reliance on third-party AI models in finance
The Bank of England and FCA survey found 75 per cent of firms use AI, a third of use cases are third-party implementations and 46 per cent of firms report only partial understanding of the AI they use.
Limited understanding of third-party models is a direct model risk that validation and vendor oversight must address.
Bank of England; Financial Conduct Authority, 21 November 2024
05
Reproduction lab
Extend the discipline's method with one frontier method and compare its results
State the uncertainty and the limits of the result
The Academy proposes how each discipline teaches toward the Nexus Standards; the mapping is open for public review. Bodies and standards are named so learners can find and apply their published work; the Academy teaches their use and links to the publisher, and no affiliation is implied.
04نەخشەی زیندوو
Connected activity in the Nordic and Baltic region
Night-time lights and population density, the footprint of electrified, connected activity, over the Nordic and Baltic region.
نەخشە کارلێککارەکە JavaScript پێویستە؛ لیستی چینەکان و سەرچاوەکان لە خوارەوەن.
Connected activity, framed on the Nordic and Baltic region.Satellite and model products as NASA publishes them, each with its own date. They are indicators, not assessments of any place.
سوپاسی بەکارهێنانی ئەو وێنانە دەکەین کە لەلایەن خزمەتگوزارییەکانی NASA's Global Imagery Browse Services (GIBS)ەوە دابین کراون، بەشێک لە NASA's Earth Science Data and Information System (ESDIS). ڕەنگەکان لە نەخشەی ڕەنگی بڵاوکراوە دووبارە کێشراونەتەوە؛ بەهاکان لە خانەکانی H3 دا تێکڕا کراون لەو شوێنەی نیشان دراون (دەستکاریکراو). داتای کراوەی NASA
سوپاسی بەکارهێنانی ئەو وێنانە دەکەین کە لەلایەن خزمەتگوزارییەکانی NASA's Global Imagery Browse Services (GIBS)ەوە دابین کراون، بەشێک لە NASA's Earth Science Data and Information System (ESDIS). ڕەنگەکان لە نەخشەی ڕەنگی بڵاوکراوە دووبارە کێشراونەتەوە؛ بەهاکان لە خانەکانی H3 دا تێکڕا کراون لەو شوێنەی نیشان دراون (دەستکاریکراو). داتای کراوەی NASA
VIIRS Black Marble night-time lights, NASA Goddard Space Flight Center; distributed by the NASA Level-1 and Atmosphere Archive and Distribution System (LAADS DAAC); imagery via NASA GIBS. ڕەنگەکان لە نەخشەی ڕەنگی بڵاوکراوە دووبارە کێشراونەتەوە؛ بەهاکان لە خانەکانی H3 دا تێکڕا کراون لەو شوێنەی نیشان دراون (دەستکاریکراو). داتای کراوەی NASA
Center for International Earth Science Information Network (CIESIN), Columbia University. 2018. Gridded Population of the World, Version 4 (GPWv4): Population Density, Revision 11. NASA Socioeconomic Data and Applications Center (SEDAC). Licensed under CC BY 4.0. Colours redrawn from the published colour map; values averaged into H3 cells where shown (modified). doi:10.7927/H49C6VHW. CC BY 4.0
بەرهەمە نزیک-کاتی-ڕاستەقینەکانی VIIRS (لافاو، پلەی گەرمیی ڕووی زەوی، بەفر، ڕەنگدانەوەی چاککراو)، NASA LANCE؛ imagery via NASA GIBS. ڕەنگەکان لە نەخشەی ڕەنگی بڵاوکراوە دووبارە کێشراونەتەوە؛ بەهاکان لە خانەکانی H3 دا تێکڕا کراون لەو شوێنەی نیشان دراون (دەستکاریکراو). داتای کراوەی NASA
ASTER GDEM بەرهەمی METI و NASA ە (ASTER Global Digital Elevation Model V003, NASA LP DAAC); imagery via NASA GIBS. ڕەنگەکان لە نەخشەی ڕەنگی بڵاوکراوە دووبارە کێشراونەتەوە؛ بەهاکان لە خانەکانی H3 دا تێکڕا کراون لەو شوێنەی نیشان دراون (دەستکاریکراو). Cite as: NASA/METI/AIST/Japan Spacesystems and U.S./Japan ASTER Science Team (2019). ASTER Global Digital Elevation Model V003. doi:10.5067/ASTER/ASTGTM.003. داتای کراوەی NASA
ڕووداوە ڕاستەوخۆکان: NASA Earth Observatory Natural Event Tracker (EONET)؛ ڕووداوەکان نیشانەدەرن و بەستەری سەرچاوەی ڕەسەنی خۆیان دەهێڵنەوە.
NASA GIBS: سوپاسی بەکارهێنانی ئەو وێنانە دەکەین کە لە خزمەتگوزارییەکانی NASA Global Imagery Browse Services (GIBS) وەرگیراون، بەشێک لە NASA Earth Science Data and Information System (ESDIS).
چینە هەڵبژاردەکان (3 سەرچاوە لە لیستی چینەکاندا: زیندوو، پێشبینی، چاودێریکراو و چوارچێوە) کاتێک چالاک دەکرێن، ناوی دابینکەرەکەیان لەسەر نەخشەکە و لێرە چاپ دەکەن؛ پێشبینییەکان دەرهاویشتەی مۆدێلن و نیشاندەرە وەرگیراوەکان خەمڵاندنن.
چین و بەروارەکان
ڕووناکی شەو، ڕۆژانە: VIIRS Black Marble (VNP46A2)، NASA LAADS DAAC · 12ی تشرینی یەکەمی 2026
Population density, 2020: Population: CIESIN, Columbia University, Gridded Population of the World v4.11 (2018), NASA SEDAC, CC BY 4.0 · static
University, student and national chapter teams. Open
A cell acts within its host's rules and never replaces an authority. A CERT works alongside the local emergency services, follows their direction and is not an emergency service.
The potential for loss or poor decisions from errors in models or their misuse.
پشتڕاستکردنەوە
Independent review that a model is sound and fit for its purpose.
Back-testing
Comparing model predictions with what happened.
لادان
Change in data or relationships that degrades a model over time.
ڕاپۆرتەکانبەشداری بکە
لەم لاپەڕەیەوە بەڵگە پێشکەش بکە.
Reports is the Consortium's quarterly publication, written by six desks. This page sits with the Academy Capability desk. What you know about this subject can become evidence, a case or a correction in the next edition, credited to you and published under CC BY 4.0 where it is your own work. Sent to the wrong desk, it is forwarded, not refused.