Skip to content

Risk Academy, led by the Nexus Consortium · Risk Science and Methods · Department of Decision, Behaviour and Communication

Types of uncertainty, likelihood language, decision analysis and deep uncertainty

غیر یقینی صورتحال اور فیصلہ سازی

Uncertainty is described before it is decided on: aleatory or epistemic, a probability or a confidence, a sampling error or a model disagreement.

Map uncertainty and decision making on a real placeOpen RAS-404

Illustrative: branching futures, each branch weighted by its probability

01دائرہ کار

What the discipline covers

The subtopics its courses and labs teach.

کورسز
1 course open
سطحیں
L2 Intermediate, L3 Advanced
تجربہ گاہیں
Trigger lab, Network lab, Map lab

Courses in development extend the scope to one further subject: Economic appraisal of resilience options.

02نقشے

Build a twin of any place

Search any place or open the world; the layers and generators follow uncertainty and decision making on the planet map, the globe and in 3D.

The central Apennines: L'Aquila, Amatrice and Norcia: a flat plan of the faculty twin. Terrain 24 to 2,805 m; 3 reference earthquakes, M6.2 to M6.6; Earthquakes M4.5 and above, past week: read live when the 3D twin opens; USGS ShakeMap intensity contours: read live when the 3D twin opens. Contours every 500 metres from the elevation grid; reference earthquakes as marks.
The central Apennines: L'Aquila, Amatrice and Norcia, Italy. Flat plan of the same data: relief, the three reference epicentres with magnitude and depth, and the numbers below; the sampler's figure shows one precomputed field with its parameters. The 3D twin opens on devices that can draw it, once its data and code have been checked.
  • Terrain 24 to 2,805 m
  • 3 reference earthquakes, M6.2 to M6.6
  • Earthquakes M4.5 and above, past week: read live when the 3D twin opens
  • USGS ShakeMap intensity contours: read live when the 3D twin opens
Credits and dates per layer are listed under the stage. Relief in the twin is exaggerated ×1.5 for legibility.

Drag to move, right drag or Shift with a drag to turn and tilt, Ctrl with the wheel to zoom. Keyboard: arrows move, Shift with arrows turn and tilt, + and – zoom, 0 resets, V steps through the views, Escape clears.

Flat plan of the same data: relief, the three reference epicentres with magnitude and depth, and the numbers below; the sampler's figure shows one precomputed field with its parameters. The 3D twin opens on devices that can draw it, once its data and code have been checked.

The boundaries, names and designations shown do not imply any judgement on the legal status of any territory, or any endorsement or acceptance of such boundaries. Countries: Natural Earth (public domain).

03The subject

The subject, methods and measures and debates and bodies

The discipline

The field and its scope

For analysts, planners and decision makers who must describe what is not known, say it in words and numbers that mean the same thing to everyone, and choose a course of action anyway.

Uncertainty and decision making studies how incomplete knowledge is described, quantified and communicated, and how decisions are made under it. The field distinguishes aleatory variability, which more data cannot remove, from epistemic uncertainty, which it can, and both from deep uncertainty, where the parties cannot agree on the models, the probabilities or the values that matter. It draws on decision theory, Bayesian statistics, operations research, psychology and the practice of climate and engineering assessment, and it serves anyone who must act before the evidence is complete.

Practice is organised around a toolkit. Decision analysis structures a choice as options, states, probabilities and payoffs and computes the expected value of each option and of further information; cost-loss reasoning gives the simplest case. Calibrated language, such as the IPCC likelihood and confidence scales, carries uncertainty into prose. Expert elicitation supplies probabilities where data are thin. For deep uncertainty, robust decision making, info-gap theory and dynamic adaptive pathways look for options that perform acceptably across many futures rather than best in one. The discipline's standing argument is between expected utility, which requires probabilities, and the methods that refuse to assign them.

Measures

Quantities and units

QuantityUnit or scaleWhat to know
Probability of an outcome or stateDimensionless, 0 to 1, with its basis (frequency, model, judgement)The core quantity. A subjective probability is a statement of belief and is only as good as its calibration; the IPCC likelihood scale maps ranges such as 66 to 100 per cent to the word likely so that words and numbers stay aligned.
Confidence levelOrdinal scale from very low to very high (IPCC), from the evidence and agreement behind a findingA judgement about the quality of the evidence, separate from the probability. Budescu and co-authors (2009) found readers interpret the words far more widely than the guidance intends.
Expected value and expected utility of an optionCurrency or utility unitsThe probability-weighted average payoff, with utility to represent attitude to risk. It depends on the probabilities and the utility function, both of which are often the least certain inputs.
Expected value of perfect and of sample informationCurrency or utility unitsWhat it would be worth to resolve the uncertainty before deciding. Bounds how much to spend on study; zero when no information would change the decision.
Regret and robustness metricsCurrency or performance shortfall relative to the best option in each future; proportion of futures where an option meets a thresholdThe measures of robust decision making. They depend on the set of futures sampled, which has no probability attached and can be chosen to favour an option.
Adaptation tipping pointThe value of a driver (sea level in metres, demand in units) at which an option stops meeting its objectiveThe quantity that structures adaptive pathways. Its timing is uncertain because the driver's trajectory is; the point itself is set by the performance threshold.

طریقے

Methods and their limits

Each method is listed with what it assumes and where it fails.

طریقہAssumesFails when
Decision analysis (decision trees, influence diagrams, expected utility)That options, states and payoffs can be enumerated, that probabilities can be assigned to states, and that the decision maker's preferences satisfy the axioms of expected utility.When probabilities are unavailable or disputed, when outcomes are incommensurable, when preferences violate the axioms (as prospect theory shows they do), or when the tree omits the option of waiting.
Calibrated uncertainty language (IPCC likelihood and confidence scales)That authors assess evidence and agreement consistently, that readers learn the mapping from words to numerical ranges, and that the two scales are used for distinct things.When readers do not see the guidance, when words are used without the numerical range beside them, or when a confidence judgement is read as a probability.
Cost-loss analysis and value of informationThat the decision is a choice between protecting at a cost and risking a loss, with a known probability, and that further information has a known accuracy.For graded decisions, for losses that are not monetary, and when the information's accuracy is itself unknown.
Robust decision makingThat many plausible futures can be generated, that options can be evaluated in each, and that decision makers prefer options that perform acceptably across futures to those optimal in one.When the future set omits the futures that matter, when the computational burden limits the options considered, or when the analysis is used to defer a decision indefinitely because no option is robust everywhere.
Dynamic adaptive policy pathwaysThat the driver can be monitored, that tipping points can be defined for each option, and that there is lead time to switch options before a tipping point is reached.When the signposts are noisy or lag the driver, when switching costs are high or options are foreclosed by earlier choices, or when institutions cannot sustain the monitoring over decades.
Structured expert elicitationThat experts hold relevant knowledge that can be expressed as probabilities under a protocol that controls bias and documents reasoning.When experts are selected for a view, when the protocol is informal, or when the aggregate is reported without the spread between experts.

Debates

What the field debates

Expected utility or methods for deep uncertainty?
The Bayesian decision tradition holds that any coherent decision maker has probabilities, that refusing to state them hides judgement rather than avoiding it, and that robust methods are expected utility with an unstated prior over futures. The deep uncertainty tradition, from Lempert and co-authors to the Decision Making under Deep Uncertainty society, holds that in long-lived decisions with contested models the probabilities are fictions, that decision makers reject them, and that searching for options that fail gracefully has produced better plans, citing water and coastal cases.
Does calibrated language help readers, or do numbers alone do better?
The IPCC guidance and its users argue that likelihood words with defined ranges make assessment consistent across thousands of findings and are more readable than numbers. Budescu, Broomell and Por (2009) and later studies show large interpretive spread for the words and better alignment when the numerical range is shown with the word; both sides now support the dual format, with disagreement about whether words add anything once numbers are present.
Is precaution a rational decision rule?
Advocates hold that for irreversible, catastrophic outcomes with unknown probabilities, acting to avoid the worst case is justified and that expected value analysis under-weights such outcomes. Critics reply that precaution without probabilities cannot rank options, that it is applied selectively, and that formal methods such as maximin or robust decision making make the same intuition explicit and testable.

Bodies and data

Bodies that set practice, and the data they publish

Bodies and standards are named so learners can find and apply their published work; the Academy teaches their use and links to the publisher, and no affiliation is implied.

BodyRole in the field
Intergovernmental Panel on Climate Change (IPCC)Issues the guidance note on the consistent treatment of uncertainties that defines the likelihood and confidence scales used in assessment reports and widely copied elsewhere.
Society for Decision Making under Deep Uncertainty (DMDU)The community that develops robust decision making, adaptive pathways and related methods and publishes their reference texts.
Decision Analysis Society of INFORMSThe professional home of decision analysis and its journal, where expected utility methods, value of information and elicitation are advanced.
Society for Risk Analysis (SRA)The learned society where risk, uncertainty and decision methods are debated across engineering, health and environment.
RAND CorporationOrigin of robust decision making and exploratory modelling, with published method guides and case studies.
DatasetSteward
IPCC WGI Interactive AtlasIntergovernmental Panel on Climate Change
Metaculus forecasting questions and resolutionsMetaculus
Copernicus Climate Data StoreCopernicus Climate Change Service, implemented by ECMWF

04طریقہ

From a probability to the worth of knowing more: expected loss, the protect-or-not rule and the value of perfect information

A decision under uncertainty has options, states and consequences; with a probability on the state, each option has an expected cost and the cheaper one is chosen; the gap between that expected cost and the cost with the state known in advance is the value of perfect information, and it says how much a better forecast or a study is worth.

Sources: Howard, Decision analysis: practice and promise, Management Science (1988); Howard, Information value theory, IEEE Transactions on Systems Science and Cybernetics (1966); Morgan and Henrion, Uncertainty: A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis (1990); Mastrandrea et al., Guidance Note for Lead Authors of the IPCC Fifth Assessment Report on Consistent Treatment of Uncertainties (2010); Haasnoot, Kwakkel, Walker and ter Maat, Dynamic adaptive policy pathways, Global Environmental Change (2013).

05At a glance

At a glance, with 5 related topics

3D گراف

فیکلٹی برائے سائنسِ خطرہ اور طریقۂ کار

265 nodes1,691 relations9 views

Explore the 3D graph: Faculty of Risk Science and Methods

06تجربہ گاہیں

How the subject is practised in labs

LabWhat you do in itCourses using it
Trigger labSet forecast thresholds, pre-agreed actions and messages2
Network labBuild dependency graphs, find critical nodes, trace cascades1
Map labRead hazard, exposure and boundaries on real maps1

07کنسول

How Uncertainty and decision making is taught, as a process you can run

Press Play to run this process from this page's own data.

غیر یقینی صورتحال اور فیصلہ سازی

How Uncertainty and decision making is taught

5 subjects in scope, 3 key terms, 1 course open, 1 lab, in the Decision, Behaviour and Communication department of Risk Science and Methods: from the scope to the method and its terms, the courses that teach it, the labs on the twin, the assessment and the record.

  1. 01 Scope

    1. 01

      Types of uncertainty

      Start · the discipline

      Types of uncertainty

    2. 02

      Confidence and…

      Start · the discipline

      Confidence and likelihood language

    3. 03

      Decision analysis

      Start · the discipline

      Decision analysis

    4. 04

      Cost-loss reasoning and…

      Start · the discipline

      Cost-loss reasoning and value of information

    5. 05

      گہری غیر یقینی صورتحال

      Start · the discipline

      گہری غیر یقینی صورتحال

  2. 02 Method and terms

    1. 06

      From a probability to…

      Model · the learner

      A decision under uncertainty has options, states and consequences; with a probability on the state, each option has an expected cost and…

    2. 07

      Aleatory and epistemic…

      Record · the discipline

      Uncertainty from natural randomness and uncertainty from limited knowledge.

    3. 09

      گہری غیر یقینی صورتحال

      Record · the discipline

      A situation in which parties cannot agree on models, probabilities or the value of outcomes.

    4. 11

      Value of information

      Record · the discipline

      The expected improvement in a decision from obtaining more information.

  3. 03 Courses

    1. 08

      RAS-404 Uncertainty and…

      Step · the learner

      Uncertainty and Confidence: Calibrated probability, confidence language and decisions under deep uncertainty

  4. 04 Labs

    1. 10

      جڑواں ماڈل

      Exercise · the learner, on the faculty twin

      The method runs on the faculty twin and the admitted map layers.

  5. 05 Assess

    1. 12

      Module checks

      Gate · the course

      Each module ends with a short check against its outcomes.

    2. 13

      Assessed work

      Decision · the learner

      The assessed work that closes a course: a lab record, a case memo or an assignment, reviewed against the rubric.

  6. 06 Record

    1. 14

      تکمیل کا ریکارڈ

      Outcome · the learner

      The record stacks into the discipline achievement.

    2. 15

      Discipline achievement

      Record · the Academy

      The discipline achievement follows the discipline rule, read from the records.

Uncertainty and decision making · Decision, Behaviour and Communication An outline of how the work is designed to run; it does not report the status of any decision or record.

08تعلیم

Learning, practice and connections

Achievements

Achievements in this discipline

  1. Course achievements

    One for each course with this as its primary discipline, earned when you pass the course's assessed activities. One can be earned now.

  2. Discipline: Uncertainty and decision making

    Complete 3 assessed courses in uncertainty and decision making, at least 2 with it as their primary discipline and at least 1 at Intermediate (L2) or above, totalling at least 45 measured learning hours. In development.

  3. Department: Decision, Behaviour and Communication

    Earn two discipline achievements in the Department of Decision, Behaviour and Communication. In development.

  4. Programme: Nexus-Based Risk Management flagship pathway

    Complete every core course of the Nexus-Based Risk Management flagship pathway under assessed completion, ending with its capstone. In development.

An achievement is a record of the learning completed and assessed here. How recognition works.

راستے

Pathways that teach it

Where this is practised

Where the subject is practised

Field platforms of the ecosystem where the subject is studied and applied.

Practised in

The Foundry system where it is practised

Foundry system pages describe what each system and its rooms are designed to do; the courses teach the methods these systems apply.

Across the ecosystem

Across the ecosystem

The science, platforms and standards this discipline draws on and contributes to across the ecosystem.

Foundations in the STEM Commons

Standards for the field

  • Nexus StandardsData and EvidenceThe subsite that keeps the standards this discipline teaches.
  • Systemic RisksThe subsite that keeps the standards this discipline teaches.

Pages of the ecosystem, cited so learners can follow the field into research, platforms, standards and national practice.

09حصہ لیں

Take part in Risk Science and Methods

اپنی شناخت سے شروع کریں۔

Routes

  • راستہ

    قومی ادارے

    Ministries, statistics offices and agencies: a national desk and chapter, and a seat in the working groups. National chapters

  • راستہ

    Sectors and professions

    Operators, regulators, banks, insurers and professional bodies whose work touches risk science and methods. For organisations

  • راستہ

    تعلیم

    Courses and practice, with a record of every course completed. Free to study. Open learning

  • راستہ

    معیارات

    Draft, review and adopt the methods and data standards with the working groups. Working groups

  • راستہ

    Communities and research

    Universities, civil society and individual experts: projects, data and review. Write to the Academy

Open calls

Open callSeeksCloses
Founding call for experts to the working groups CALL-FOUNDING-EXPERTSexpert, editor, chair2026-12-15
Open nomination for the three independent expert seats of the Global Standards Council CALL-GSC-INDکونسل کا رکن2026-12-01
Nominations of interim regional members (applies only if the transitional provision is decided) CALL-GSC-REGکونسل کا رکن2026-12-15
Review of the wave-1 risk core outlines (C1, C2, C3, C4, C8, C10, C11) CALL-REVIEW-WAVE1contributor2027-01-31
Experts for the core standards of risk science: uncertainty and evidence grading, scales, structured expert judgement, tolerability, extremes and compound events, catastrophic and existential risk, ethics and equity, units and measurement (NRS-C17 to NRS-C24) CALL-CORE-SCIENCEexpert, editor, chair2027-01-31
Independent reviewers for the families of the hazard atlas, three from at least two regions for each family (NHS2-R19), priority families first CALL-ATLAS-REVIEWماہر2027-03-31
Members of the interim Frontier Safety Review Panel and red-team reviewers (biosafety and biosecurity, AI safety and security, critical-infrastructure security); applications treated in confidence CALL-FRONTIER-SAFETY-REVIEWماہر2026-11-30
Experts in ontology, metrology, software verification and conformity assessment for the requirement register, the NHS-2 machine representation, the conformance test suites and the conformity assessment scheme CALL-CONFORMANCE-ONTOLOGYexpert, editor2027-01-31

Calls past their closing date are hidden automatically. Every call, proposal and route: open areas and calls.

Cells and CERTs

  1. Gather the cell

    Bring together three to seven people with complementary skills: data, field practice, policy and communication.

  2. Register it

    Write to the team with the cell's name, members, area and region. You receive a reference and a contact. Write to the Academy

  3. Choose a charter

    Pick one focus: research and evidence, data and maps, standards review, or community preparedness.

  4. Learn together

    Follow shared study paths at Risk Academy, with practice and a record of every course completed. Hazards and resilience

  5. Lead and report

    Hold regular sessions. Publish what the cell learns through Reports. Bring findings to the working groups. Working groups

  • Specialise as a Community Emergency Response Team (CERT)

    A CERT prepares its neighbourhood for the hazards it faces. It builds a local hazard profile from this site's map. It trains in household and street preparedness. It learns first aid and light search through recognised local providers, and it runs drills. A CERT works alongside the local emergency services and follows their direction. It never replaces them and is not an emergency service.

انڈیکس

What a national team or a local community can do on The Global Risks Index (NXS-GRX) today.

  • NXS-GRX

    Your country's profile

    Open risk profiles for 195 countries, with sources and licences on every value. Open the Index

  • NXS-GRX

    Correct or reply

    Correct a value or reply for your country. The change is logged with its effect. Open the Index

  • NXS-GRX

    Offer data

    Offer a dataset. It enters through the licence gate, with your credit. Open the Index

  • NXS-GRX

    Use the open data

    Layers, profiles and tiles through the open API. Open the Index

10References

Core references and where to begin

Start with Morgan, then Lempert, then Mastrandrea.

  1. Morgan, M. G. and Henrion, M., Uncertainty: A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis, Cambridge University Press (1990). DOI
  2. Mastrandrea, M. D. et al., Guidance Note for Lead Authors of the IPCC Fifth Assessment Report on Consistent Treatment of Uncertainties (2010). ipcc.ch
  3. Lempert, R. J., A new decision sciences for complex systems, Proceedings of the National Academy of Sciences (2002). DOI
  4. Howard, R. A., Decision analysis: practice and promise, Management Science (1988). DOI
  5. Kahneman, D. and Tversky, A., Prospect theory: an analysis of decision under risk, Econometrica (1979). DOI
  6. Lempert, R. J., Popper, S. W. and Bankes, S. C., Shaping the Next One Hundred Years: New Methods for Quantitative, Long-Term Policy Analysis, RAND (2003). rand.org
  7. Haasnoot, M., Kwakkel, J. H., Walker, W. E. and ter Maat, J., Dynamic adaptive policy pathways: a method for crafting robust decisions for a deeply uncertain world, Global Environmental Change (2013). DOI
  8. Marchau, V. A. W. J., Walker, W. E., Bloemen, P. J. T. M. and Popper, S. W. (eds), Decision Making under Deep Uncertainty: From Theory to Practice, Springer (2019). DOI
  9. Budescu, D. V., Broomell, S. and Por, H.-H., Improving communication of uncertainty in the reports of the Intergovernmental Panel on Climate Change, Psychological Science (2009). DOI
  10. Spiegelhalter, D. J. and Riesch, H., Don't know, can't know: embracing deeper uncertainties when analysing risks, Philosophical Transactions of the Royal Society A (2011). DOI
  11. Knight, F. H., Risk, Uncertainty and Profit, Houghton Mifflin (1921). econlib.org

11سوالات

سوالات، جوابات اور کلیدی اصطلاحات

کیا یہاں تعلیم مفت ہے؟

جی ہاں۔ Risk Academy، جس کی قیادت Nexus Consortium کرتا ہے، کا ہر کورس اور تعلیمی مواد مفت ہے، اپنی رفتار سے یا کسی گروپ کے ساتھ۔ عام شرکت کی کوئی فیس نہیں؛ معاوضے والا کام، انٹرن شپس اور فیلوشپس الگ انتظامات ہیں۔

کورس مکمل کرنے سے مجھے کیا ملتا ہے؟

A completion record: the course, its version, the date and what was assessed, private by default and shared by you. It stacks into discipline, department and programme achievements. A record states what was studied and assessed and does not certify competence; it is not a licence, a professional title or an employment status.

ڈیٹا اور مقامات کہاں سے آتے ہیں؟

Every faculty teaches on a twin of a real place built from open data; each layer carries its provider, licence and date, and every result on the Academy states its source. Maps and figures are indicators for teaching, never an assessment of a place.

How do I take part beyond the courses in uncertainty and decision making?

Form a competence cell of three to seven people, study a shared pathway, take a supervised assignment in the National Working Groups, or bring a cohort from your institution. For organisations.

کلیدی اصطلاحات

Aleatory and epistemic uncertainty
Uncertainty from natural randomness and uncertainty from limited knowledge.
گہری غیر یقینی صورتحال
A situation in which parties cannot agree on models, probabilities or the value of outcomes.
Value of information
The expected improvement in a decision from obtaining more information.
Robust decision making
Choosing options that perform acceptably across many plausible futures.

رپورٹیںتعاون کریں

اس صفحے سے شواہد فراہم کریں۔

Reports is the Consortium's quarterly publication. What you know about this subject can become evidence, a case or a correction in the next edition, credited to you and published under CC BY 4.0 where it is your own work.

Risk Academy

Never send personal data, sensitive infrastructure detail or anything you have no right to share. A contribution is reviewed before use; sending it confers no authorship or editorial rights, and sponsorship never buys a finding.

غیر یقینی صورتحال اور فیصلہ سازی

Start with an open course

The catalogue lists each course with its outcomes, labs, hours and level.

Open RAS-404Back to Department of Decision, Behaviour and Communication