Risk Academy, led by the Nexus Consortium · Course catalogue · Technology and Digital Systems
Akili Bandia na Mifumo Inayojiendesha
Usalama wa AI na tathmini
AI safety and evaluation, taught twice over: as the working methods of the field and as its frontier since 2024, with labs on the Academy's tools, open data and the Nexus Standards.
AI safety and evaluation: foundations and practice
This area covers how the capabilities, reliability and risks of AI systems are tested before and after deployment: evaluation design, red-teaming, benchmarks and their limits, safety cases for frontier models and agentic systems, and incident reporting.
AI safety and evaluation: foundations and practice
Level
L2 Intermediate
Study time
about 24 hours (planning estimate)
Hali
In authoring
Prerequisites
An L1 course in the area, or an entry review
Why now
Shows why independent and held-out benchmarks matter when relying on vendor-reported evaluation results.
Define red-teaming and the other key terms of the discipline and use them correctly in a written case
Explain evaluation design and metrics and red-teaming and adversarial testing with a worked example and its source
Apply the discipline's method to a documented case and explain each result with its source
Analyse a named case against benchmarks and data contamination, stating evidence, date and limits
Modules
01
Evaluation design and metrics
Evaluation design and metrics
Red-teaming and adversarial testing
Benchmarks and data contamination
02
Dangerous capability evaluations
Dangerous capability evaluations
Safety cases for frontier models
Agentic system evaluation
03
Monitoring after deployment
Monitoring after deployment
Incident reporting and disclosure
04
Lab: the discipline's method
An attack success rate is measured per attempt against a stated attacker budget; the chance that at least one of k attempts succeeds grows as 1 minus (1 minus s) to the k, and a release gate compares that cumulative figure, after defences, with the level a safety case can tolerate.
Work the method through a documented case and explain each result
Explain what changed in AI safety and evaluation since 2024 and cite the studies, data or rules behind each change
Reproduce independent evaluation finds gap with developer self-reported scores on open data and state the uncertainty of the result
Evaluate a 2024 to 2026 study: its question, data, method, limits and what it changes for practice
Design an analysis that combines a frontier method with the faculty's instruments, and justify each choice
Modules
01
Independent evaluation finds gap with developer self-reported scores
NIST's Center for AI Standards and Innovation found DeepSeek V4 Pro scored better on the developer's own evaluations than on CAISI's, including non-public benchmarks, estimating it trails leading US models by about eight months.
Shows why independent and held-out benchmarks matter when relying on vendor-reported evaluation results.
National Institute of Standards and Technology, 1 May 2026
02
UK AI Security Institute publishes first Frontier AI Trends Report
Drawing on evaluations of over 30 frontier models since 2023, the institute reports fast capability growth in cyber, chemistry and biology tasks, universal jailbreaks found in every system tested, and rising self-replication precursors.
Offers government test results on dangerous capabilities and safeguard strength that evaluators can use to benchmark their own methods.
AI Security Institute (UK), 18 December 2025
03
Key update reviews technical safeguards and frontier risk management
The second key update finds prompt injection attacks still succeed about half the time with ten attempts, small data-poisoning attacks can be effective, and at least 12 companies now publish frontier safety frameworks with mostly implicit thresholds.
Clarifies how much assurance current safeguards provide, which shapes red-teaming scope and residual risk judgements.
International AI Safety Report, 25 November 2025
04
Time-horizon metric measures growth in autonomous task length
Researchers proposed measuring AI capability by the length of software tasks models complete reliably, and found this horizon has doubled roughly every seven months since 2019.
Gives evaluators a trend measure for agentic capability that can inform forecasts and thresholds in safety cases.
arXiv, 18 March 2025
05
UK renames AI Safety Institute as AI Security Institute
The UK government renamed the institute and refocused it on serious AI risks with security implications, such as chemical and biological misuse, cyber-attacks, fraud and child abuse material, adding a criminal misuse team.
Signals how a leading public evaluator now prioritises security-related misuse in its testing agenda.
UK Department for Science, Innovation and Technology, 14 February 2025
06
Reproduction lab
Extend the discipline's method with one frontier method and compare its results
State the uncertainty and the limits of the result
The Academy proposes how each discipline teaches toward the Nexus Standards; the mapping is open for public review. Bodies and standards are named so learners can find and apply their published work; the Academy teaches their use and links to the publisher, and no affiliation is implied.
04Ramani hai
Connected activity in the United Kingdom and Ireland
Night-time lights and population density, the footprint of electrified, connected activity, over the United Kingdom and Ireland.
Ramani shirikishi inahitaji JavaScript. Orodha ya tabaka na vyanzo imetolewa hapa chini.
kila siku; Mng'ao wa setilaiti, uliorekebishwa kwa mwanga wa mwezi na angahewa
Ya hivi karibuni wakati wa ujenzi
2026-10-12
Ubora wa picha
gridi ya takriban mita 500
Kutokuwa na uhakika
Mng'ao wa usiku kutoka setilaiti kwa tarehe iliyoonyeshwa; taa ni kiashiria cha matumizi na kukatika kwa umeme, si kipimo cha usambazaji au upatikanaji.
Imefikiwa kupitia
gibs.earthdata.nasa.gov, only after you allow the live map
Kuhusu tabaka hili
Ushahidi
Imekadiriwa
Chanzo
Gridded Population of the World v4.11 (NASA SEDAC (CIESIN, Chuo Kikuu cha Columbia))
Makadirio yanayotokana na sensa ya watu kwa kila kilomita ya mraba mwaka 2020, yanayoonyeshwa kama muktadha wa mfiduo; si hesabu ya watu walioathiriwa na janga lolote.
Imefikiwa kupitia
gibs.earthdata.nasa.gov, only after you allow the live map
Kuhusu tabaka hili
Ushahidi
Imeonekana
Chanzo
Mwangaza uliorekebishwa wa VIIRS NOAA-20 (NASA LANCE)
Picha ya satelaiti. Raster ya satelaiti au ya muundo kama mtoa huduma anavyoichapisha. Mawingu, mapengo ya ukanda na makosa ya upatikanaji huacha mapengo na kelele; thamani ni viashiria, si vipimo mahali fulani.
Imefikiwa kupitia
gibs.earthdata.nasa.gov, only after you allow the live map
Buruta ili kusogeza. Ctrl au ⌘ na usogeze, bana au tumia vitufe ili kukuza; elea juu ili kuona thamani zilizo chini ya kiashiria; weka upya hurudisha kwenye eneo.
Connected activity, framed on the United Kingdom and Ireland.Satellite and model products as NASA publishes them, each with its own date. They are indicators, not assessments of any place.
Tunatambua matumizi ya picha zilizotolewa na huduma za Global Imagery Browse Services (GIBS) ya NASA, sehemu ya Earth Science Data and Information System (ESDIS) ya NASA. Rangi zimechorwa upya kutoka ramani ya rangi iliyochapishwa; thamani zimewekwa wastani katika seli za H3 zinapoonyeshwa (zimerekebishwa). Data huria ya NASA
Tunatambua matumizi ya picha zilizotolewa na huduma za Global Imagery Browse Services (GIBS) ya NASA, sehemu ya Earth Science Data and Information System (ESDIS) ya NASA. Rangi zimechorwa upya kutoka ramani ya rangi iliyochapishwa; thamani zimewekwa wastani katika seli za H3 zinapoonyeshwa (zimerekebishwa). Data huria ya NASA
Taa za usiku za VIIRS Black Marble, NASA Goddard Space Flight Center. Zinasambazwa na NASA Level-1 and Atmosphere Archive and Distribution System (LAADS DAAC). Picha kupitia NASA GIBS. Rangi zimechorwa upya kutoka ramani ya rangi iliyochapishwa. Thamani zimewekwa wastani katika seli za H3 pale zinapoonyeshwa (imerekebishwa). Data huria ya NASA
Center for International Earth Science Information Network (CIESIN), Columbia University. 2018. Gridded Population of the World, Version 4 (GPWv4): Population Density, Revision 11. NASA Socioeconomic Data and Applications Center (SEDAC). Licensed under CC BY 4.0. Colours redrawn from the published colour map; values averaged into H3 cells where shown (modified). doi:10.7927/H49C6VHW. CC BY 4.0
Bidhaa za VIIRS za karibu wakati halisi (mafuriko, joto la uso wa ardhi, kifuniko cha theluji, mwakisiko uliosahihishwa), NASA LANCE. Picha kupitia NASA GIBS. Rangi zimechorwa upya kutoka ramani ya rangi iliyochapishwa. Thamani zimewekwa wastani katika seli za H3 pale zinapoonyeshwa (imerekebishwa). Data huria ya NASA
ASTER GDEM ni bidhaa ya METI na NASA (ASTER Global Digital Elevation Model V003, NASA LP DAAC); picha kupitia NASA GIBS. Rangi zimechorwa upya kutoka ramani ya rangi iliyochapishwa; thamani zimewekwa wastani katika seli za H3 zinapoonyeshwa (zimerekebishwa). Taja kama: NASA/METI/AIST/Japan Spacesystems and U.S./Japan ASTER Science Team (2019). ASTER Global Digital Elevation Model V003. doi:10.5067/ASTER/ASTGTM.003. Data huria ya NASA
Imetengenezwa kwa Natural Earth. Data huria za ramani za vekta na rasta @ naturalearthdata.com. Kikoa cha umma
Blue Marble, NASA Earth Observatory; picha kupitia NASA GIBS. Rangi zimechorwa upya kutoka ramani ya rangi iliyochapishwa; thamani zimewekwa wastani katika seli za H3 zinapoonyeshwa (zimerekebishwa). Data huria ya NASA
Matukio ya moja kwa moja: NASA Earth Observatory Natural Event Tracker (EONET); matukio ni ya kuashiria tu na yanabaki na viungo vya vyanzo vyao asili.
NASA GIBS: Tunakiri matumizi ya picha zinazotolewa na huduma za NASA Global Imagery Browse Services (GIBS), sehemu ya NASA Earth Science Data and Information System (ESDIS).
Tabaka za hiari (vyanzo 3 kwenye orodha ya tabaka: moja kwa moja, utabiri, vilivyoonekana na muktadha) huchapisha shukrani za mtoaji kwenye ramani na hapa vinapowashwa; utabiri ni matokeo ya modeli na fahirisi zilizotokana ni makadirio.
Tabaka na tarehe
Taa za usiku, kila siku: VIIRS Black Marble (VNP46A2), NASA LAADS DAAC · 12 Okt 2026
Population density, 2020: Population: CIESIN, Columbia University, Gridded Population of the World v4.11 (2018), NASA SEDAC, CC BY 4.0 · static
Rangi halisi: VIIRS NOAA-20 mng'ao uliosahihishwa, NASA LANCE · 13 Okt 2026
Jinsi kujifunza kunavyoendeshwa, kama mchakato unaoweza kuuendesha
8 steps · 4 stages · 2 gates · 16 processes
Chagua hali na ubonyeze Cheza: kozi, njia ya mafunzo, mazoezi, kitivo, seli na rekodi.
Risk Academy
Course, catalogue to completion
A free course pairs one discipline's methods with a real place, open data and standards, with module checks, assessed work and a completion record.
Scenarios Course · Practice · Record
01 Open
01
Choose a course
Start · the learner
Find the course in the catalogue, by faculty, level, kind or the standard it teaches.
02
Entry check
Gate · the course
The prerequisites say what to study first; an entry review stands in for them.
02 Study
03
Mafunzo
Step · the learner
Read and work through the lessons, self-paced or with a cohort.
04
Labs on the twin
Exercise · the learner, on the faculty twin
Run the discipline's method and the faculty instruments on the twin of a real place.
03 Assess
05
Module checks
Gate · the course
Each module ends with a short check against its outcomes.
06
Assessed work
Decision · reviewers and peers
A lab record, a case memo and a key terms check, with peer review where the course asks for it.
04 Record
07
Rekodi ya ukamilishaji
Record · the Academy
The record names the course, its version and the date; it is the learner's to share.
08
Next course
Outcome · the learner
The record stacks into the discipline and pathway achievements, and the next course opens.
How learning works · Courses An outline of how the work is designed to run; it does not report the status of any decision or record.
06Shiriki
Shiriki katika kazi
Anza na wewe ni nani.
Njia
Njia
Taasisi za kitaifa
Wizara, ofisi za takwimu na mashirika: dawati na tawi la kitaifa, na kiti katika vikundi kazi. Sura za kitaifa
Njia
Sekta na taaluma
Waendeshaji, wadhibiti, benki, makampuni ya bima na vyombo vya kitaaluma ambavyo kazi yao inagusa hatari za kimfumo. Kwa mashirika
Njia
Kujifunza
Kozi na mazoezi, pamoja na rekodi ya kila kozi iliyokamilishwa. Kusoma ni bure. Ujifunzaji huria
Njia
Viwango
Andaa rasimu, kagua na pitisha mbinu na viwango vya data pamoja na vikundi kazi. Vikundi kazi
Njia
Jumuiya na utafiti
Universities, civil society and individual experts: projects, data and review. Write to the Academy
Miito wazi
Mwito wazi
Inatafuta
Inafungwa
Mwito wa uanzishaji kwa wataalamu wa vikundi kazi CALL-FOUNDING-EXPERTS
mtaalamu, mhariri, mwenyekiti
2026-12-15
Uteuzi wazi kwa viti vitatu vya wataalamu huru vya Baraza la Viwango la Dunia CALL-GSC-IND
mjumbe wa baraza
2026-12-01
Uteuzi wa wanachama wa kikanda wa muda (unatumika tu ikiwa kifungu cha mpito kitaamuliwa) CALL-GSC-REG
mjumbe wa baraza
2026-12-15
Ukaguzi wa miongozo ya kiini cha hatari ya wimbi la 1 (C1, C2, C3, C4, C8, C10, C11) CALL-REVIEW-WAVE1
mchangiaji
2027-01-31
Wataalamu wa viwango vya msingi vya sayansi ya hatari: kutokuwa na uhakika na upangaji wa ushahidi, vipimo, maamuzi ya wataalamu yaliyopangwa, ustahimilivu, matukio makali na ya mchanganyiko, hatari za maafa makubwa na za kuwepo, maadili na usawa, vipimo na upimaji (NRS-C17 hadi NRS-C24) CALL-CORE-SCIENCE
mtaalamu, mhariri, mwenyekiti
2027-01-31
Wakaguzi huru wa familia za atlasi ya hatari, watatu kutoka angalau kanda mbili kwa kila familia (NHS2-R19), familia za kipaumbele kwanza CALL-ATLAS-REVIEW
mtaalamu
2027-03-31
Wajumbe wa Jopo la muda la Ukaguzi wa Usalama wa Mipaka Mipya na wakaguzi wa timu nyekundu (usalama wa kibiolojia na ulinzi wa kibiolojia, usalama na ulinzi wa AI, ulinzi wa miundombinu muhimu); maombi hushughulikiwa kwa usiri CALL-FRONTIER-SAFETY-REVIEW
mtaalamu
2026-11-30
Wataalamu wa ontolojia, metrolojia, uthibitishaji wa programu na tathmini ya ulinganifu kwa rejista ya mahitaji, uwakilishi wa mashine wa NHS-2, seti za majaribio ya ulinganifu na mpango wa tathmini ya ulinganifu CALL-CONFORMANCE-ONTOLOGY
mtaalamu, mhariri
2027-01-31
Miito iliyopita tarehe ya kufungwa hufichwa kiotomatiki. Kila mwito, pendekezo na njia: maeneo na miito wazi.
Cells
A cell is a small team with a clear mission, a host and a record of what it does. Choose the type that fits.
University, student and national chapter teams. Open
A cell acts within its host's rules and never replaces an authority. A CERT works alongside the local emergency services, follows their direction and is not an emergency service.
How a cell forms
01
Kusanya seli
Leta pamoja watu watatu hadi saba wenye ujuzi unaokamilishana: data, mazoezi ya uwandani, sera na mawasiliano.
02
Choose a type
Pick the kind of cell that fits the work, from the gallery below. A cell can add a second focus later. See the types
03
Isajili
Name the cell, its members, area and region, and who hosts it. You receive a reference and a contact. Form a cell
04
Jifunzeni pamoja
Fuata njia za pamoja za masomo katika Risk Academy, pamoja na mazoezi na rekodi ya kila kozi iliyokamilishwa. Hatari na ustahimilivu
05
Ongoza na uripoti
Hold regular sessions. Publish what the cell learns through Reports. Bring findings to the working groups. Working groups
Kielezo
What a national team or a local community can do on The Global Risks Index (NXS-GRX) today.
NXS-GRX
Your country's profile
Wasifu wazi wa hatari kwa nchi 195, pamoja na vyanzo na leseni kwa kila thamani. Fungua Faharasa
NXS-GRX
Sahihisha au jibu
Sahihisha thamani au jibu kwa niaba ya nchi yako. Mabadiliko yanarekodiwa pamoja na athari yake. Fungua Faharasa
NXS-GRX
Toa data
Toa seti ya data. Inaingia kupitia lango la leseni, ikiwa na utajo wako. Fungua Faharasa
Ndiyo. Kila kozi na nyenzo ya kujifunzia ya Risk Academy, inayoongozwa na Nexus Consortium, ni bure kusoma, kwa kasi yako mwenyewe au pamoja na kundi. Ushiriki wa kawaida hauna ada. Kazi inayolipwa, mafunzo kazini na ushirika wa kitaaluma ni mipango tofauti.
Kukamilisha kozi kunanipa nini?
Rekodi ya ukamilishaji: kozi, toleo lake, tarehe na kilichotathminiwa. Ni ya faragha kwa chaguo-msingi na huishiriki wewe mwenyewe. Hujumlishwa kuwa mafanikio ya taaluma, idara na programu. Rekodi inaeleza kilichosomwa na kutathminiwa na haithibitishi umahiri; si leseni, cheo cha kitaaluma wala hali ya ajira.
Data na maeneo yanatoka wapi?
Kila kitivo hufundisha kwa kutumia pacha wa mahali halisi uliojengwa kwa data huria. Kila tabaka lina mtoa data, leseni na tarehe yake, na kila matokeo ya Academy yanataja chanzo chake. Ramani na takwimu ni viashiria vya kufundishia, si tathmini ya mahali popote.
How do I take part beyond the course?
Unda seli ya umahiri ya watu watatu hadi saba, soma njia ya pamoja, chukua kazi inayosimamiwa katika Vikundi Kazi vya Kitaifa, au leta kundi la wanafunzi kutoka taasisi yako. Kwa mashirika.
Istilahi kuu
Red-teaming
Structured attempts to make a system fail or misbehave, to find weaknesses before others do.
Benchmark contamination
When test data have leaked into a model's training data, so scores overstate its ability.
Safety case
A structured argument, supported by evidence, that a system is acceptably safe for a given use.
Frontier model
A general-purpose AI model at or near the most capable level available at a given time.
RipotiChangia
Changia ushahidi kutoka ukurasa huu.
Reports is the Consortium's quarterly publication, written by six desks. This page sits with the Academy Capability desk. What you know about this subject can become evidence, a case or a correction in the next edition, credited to you and published under CC BY 4.0 where it is your own work. Sent to the wrong desk, it is forwarded, not refused.
Usitume kamwe data binafsi, maelezo nyeti ya miundombinu wala chochote ambacho huna haki ya kukishiriki. Mchango hupitiwa kabla ya kutumika; kuutuma hakutoi haki za uandishi wala za uhariri, na udhamini haununui matokeo.
Tovuti hii inatumia vidakuzi vya lazima kabisa pekee ili kufanya kazi na kukumbuka chaguo zako za faragha. Hakuna kinachopakiwa kutoka kampuni nyingine, na kamwe hatuuzi wala kushiriki taarifa zako binafsi.
Maelezo
Tovuti hii inatumia vidakuzi vya lazima kabisa pekee ili kufanya kazi na kukumbuka chaguo zako za faragha. Hakuna kinachopakiwa kutoka kampuni nyingine, na kamwe hatuuzi wala kushiriki taarifa zako binafsi. Hatuendeshi matangazo. Unaweza kukagua chaguo zako wakati wowote kupitia Chaguo za faragha chini ya kila ukurasa.